Started by remote host 172.23.109.52 [EnvInject] - Loading node environment variables. Building remotely on slv-s63703-32g-12c (jython_slave P0-CAP bkrs3) in workspace /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Done Running Prebuild steps [windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1] $ /bin/sh -xe /tmp/jenkins8772976910388935893.sh + descriptor=collections-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1-Dec-23-05:20:05-7.2.4-7065: + '[' collections == transaction_disabled ']' ++ echo collections-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1-Dec-23-05:20:05-7.2.4-7065: ++ awk '{split($0,r,"-");print r[1],r[2]}' + desc='collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1' + echo Desc: 7.2.4-7065 - collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 - windows22 Desc: 7.2.4-7065 - collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 - windows22 + echo newState=available + newState=available Success build forhudson.tasks.Shell@36eff940 [description-setter] Description set: 7.2.4-7065 - collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 - windows22 Success build forhudson.plugins.descriptionsetter.DescriptionSetterBuilder@123c7165 [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'propfile' [EnvInject] - Variables injected successfully. Success build fororg.jenkinsci.plugins.envinject.EnvInjectBuilder@34f51e3f Cloning the remote Git repository Using shallow clone Cloning repository https://github.com/couchbaselabs/TAF.git > /usr/bin/git init /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git --version # timeout=10 > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* --depth=1 # timeout=30 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 > /usr/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* --depth=1 # timeout=30 > /usr/bin/git rev-parse origin/neo^{commit} # timeout=10 Checking out Revision d7e8fa4d8c2c5452706674aad5ec901a73a57323 (origin/neo) > /usr/bin/git config core.sparsecheckout # timeout=10 > /usr/bin/git checkout -f d7e8fa4d8c2c5452706674aad5ec901a73a57323 > /usr/bin/git rev-list d7e8fa4d8c2c5452706674aad5ec901a73a57323 # timeout=10 > /usr/bin/git tag -a -f -m Jenkins Build #297988 jenkins-test_suite_executor-TAF-297988 # timeout=10 No emails were triggered. [windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1] $ /bin/sh -xe /tmp/jenkins2815260797942078682.sh + echo Desc: collections-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1-Dec-23-05:20:05-7.2.4-7065 Desc: collections-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1-Dec-23-05:20:05-7.2.4-7065 [description-setter] Could not determine description. [windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1] $ /bin/bash /tmp/jenkins1043441964475000098.sh Jython 2.7.2 [windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1] $ /bin/bash /tmp/jenkins6362254153845276264.sh Cloning into 'guides'... Starting a Gradle Daemon, 11 busy Daemons could not be reused, use --status for details > Configure project : Using Transaction_client :: 1.2.1 Using Java_client :: 3.4.2 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/ssh.py 7.2.4-7065 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/eagles_all_around.py 7.2.4-7065 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main scripts/install.py 7.2.4-7065 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources testrunner.py 7.2.4-7065 --executor_jenkins_job --manual_run Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py 7.2.4-7065 --executor_jenkins_job --manual_run > Task :compileJava warning: unknown enum constant When.MAYBE reason: class file for javax.annotation.meta.When not found Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 warning > Task :rerun_job reading from windows22_collections_rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1_7.2.4-7065 Could not find a valid previous build to run with Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 24s 2 actionable tasks: 2 executed [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'rerun_props_file' [EnvInject] - Variables injected successfully. [windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1] $ /bin/bash /tmp/jenkins7836402636031882872.sh core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 95679 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 202400 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 95679 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Set ALLOW_HTP to False so test could run. the major release is 7 "172.23.137.252","172.23.137.253","172.23.137.254","172.23.137.255","172.23.138.0","172.23.138.1" Searching for httplib2 Best match: httplib2 0.17.0 Adding httplib2 0.17.0 to easy-install.pth file Using /usr/local/lib/python3.7/site-packages Processing dependencies for httplib2 Finished processing dependencies for httplib2 DEPRECATION: A future version of pip will drop support for Python 2.7. Requirement already satisfied: requests in /opt/jython/Lib/site-packages/requests-2.24.0-py2.7.egg (2.24.0) Requirement already satisfied: certifi>=2017.4.17 in /opt/jython/Lib/site-packages/certifi-2021.10.8-py2.7.egg (from requests) (2021.10.8) Requirement already satisfied: chardet<4,>=3.0.2 in /opt/jython/Lib/site-packages/chardet-3.0.4-py2.7.egg (from requests) (3.0.4) Requirement already satisfied: idna<3,>=2.5 in /opt/jython/Lib/site-packages/idna-2.10-py2.7.egg (from requests) (2.10) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /opt/jython/Lib/site-packages/urllib3-1.25.10-py2.7.egg (from requests) (1.25.10) ERROR: Certificate did not match expected hostname: pypi.org. Certificate: {'notAfter': 'Jul 30 16:48:42 2024 GMT', 'subject': ((('commonName', 'www.python.org'),),), 'subjectAltName': (('DNS', 'www.python.org'), ('DNS', '*.python.org'), ('DNS', 'docs.python.org'), ('DNS', 'downloads.python.org'), ('DNS', 'pypi.python.org'), ('DNS', 'python.org'))} Could not fetch URL https://pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by SSLError(CertificateError("hostname 'pypi.org' doesn't match either of 'www.python.org', '*.python.org', 'docs.python.org', 'downloads.python.org', 'pypi.python.org', 'python.org'",),)) - skipping DEPRECATION: A future version of pip will drop support for Python 2.7. Requirement already satisfied: futures in /opt/jython/Lib/site-packages/futures-3.3.0-py2.7.egg (3.3.0) ERROR: Certificate did not match expected hostname: pypi.org. Certificate: {'notAfter': 'Jul 30 16:48:42 2024 GMT', 'subject': ((('commonName', 'www.python.org'),),), 'subjectAltName': (('DNS', 'www.python.org'), ('DNS', '*.python.org'), ('DNS', 'docs.python.org'), ('DNS', 'downloads.python.org'), ('DNS', 'pypi.python.org'), ('DNS', 'python.org'))} Could not fetch URL https://pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by SSLError(CertificateError("hostname 'pypi.org' doesn't match either of 'www.python.org', '*.python.org', 'docs.python.org', 'downloads.python.org', 'pypi.python.org', 'python.org'",),)) - skipping Cloning into 'testrunner'... #### Testrunner last commit #### commit 280679e92099317483f0b1b35b770a91641b693f Author: mohsin-couchbase Date: Fri Dec 22 11:07:37 2023 +0530 Added negative test case for vector search store=True Change-Id: I6aee468ec7468f9b09806ab7487d788751fdb82b Reviewed-on: https://review.couchbase.org/c/testrunner/+/203002 Tested-by: Reviewed-by: Sarthak Dua Submodule 'java_sdk_client' (https://github.com/couchbaselabs/java_sdk_client) registered for path 'java_sdk_client' Submodule 'lib/capellaAPI' (https://github.com/couchbaselabs/CapellaRESTAPIs) registered for path 'lib/capellaAPI' Submodule 'magma_loader/DocLoader' (https://github.com/couchbaselabs/DocLoader.git) registered for path 'magma_loader/DocLoader' Cloning into 'java_sdk_client'... Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff' Cloning into 'lib/capellaAPI'... Submodule path 'lib/capellaAPI': checked out 'e98eb8225e9a714c77c670e807049f4480f05389' Cloning into 'magma_loader/DocLoader'... Submodule path 'magma_loader/DocLoader': checked out 'e86f652b9f5bce31f54ee58822f5f0d2e3d51a32' ################################ [global] username:root password:couchbase data_path:/data [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:dynamic port:8091 [_2] ip:dynamic port:8091 [_3] ip:dynamic port:8091 [_4] ip:dynamic port:8091 [_5] ip:dynamic port:8091 [_6] ip:dynamic port:8091 python3 scripts/populateIni.py -s "172.23.137.252","172.23.137.253","172.23.137.254","172.23.137.255","172.23.138.0","172.23.138.1" -d None -a None -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_reformat.14086.ini -p windows22 -o /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -k {} INFO:root:SSH Connecting to 172.23.137.252 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.137.254 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.137.253 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.137.255 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.138.1 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connecting to 172.23.138.0 with username:Administrator, attempt#1 of 5 INFO:root:SSH Connected to 172.23.138.1 as Administrator INFO:root:SSH Connected to 172.23.137.255 as Administrator INFO:root:SSH Connected to 172.23.137.252 as Administrator INFO:root:SSH Connected to 172.23.137.254 as Administrator INFO:root:SSH Connected to 172.23.137.253 as Administrator INFO:root:SSH Connected to 172.23.138.0 as Administrator INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:get windows information INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:running command.raw on 172.23.138.1: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:get windows information INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:get windows information INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.138.1: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:get windows information INFO:root:running command.raw on 172.23.137.255: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.254: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:running command.raw on 172.23.137.252: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.255: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:File /cygdrive/c/Windows/win.ini was found INFO:root:This is windows server! INFO:root:get windows information INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.252: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.253: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.254: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with Administrator INFO:root:command executed successfully with Administrator INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.137.253: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with Administrator INFO:root:File /cygdrive/c/tmp/windows_info.txt was found INFO:root:get windows information INFO:root:running command.raw on 172.23.138.0: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat INFO:root:command executed successfully with Administrator INFO:root:running command.raw on 172.23.138.0: sh -c 'if [[ "$OSTYPE" == "darwin"* ]]; then sysctl hw.memsize|grep -Eo [0-9]; else grep MemTotal /proc/meminfo|grep -Eo [0-9]; fi' INFO:root:command executed successfully with Administrator in main the ini file is /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_reformat.14086.ini the given server info is "172.23.137.252","172.23.137.253","172.23.137.254","172.23.137.255","172.23.138.0","172.23.138.1" Collecting memory info from 172.23.138.1 Collecting memory info from 172.23.137.255 Collecting memory info from 172.23.137.252 Collecting memory info from 172.23.137.254 Collecting memory info from 172.23.137.253 Collecting memory info from 172.23.138.0 the servers memory info is [('172.23.138.1', 6282864), ('172.23.137.255', 6282864), ('172.23.137.252', 6282864), ('172.23.137.254', 6282864), ('172.23.137.253', 6282864), ('172.23.138.0', 6282864)] [global] username:Administrator password:Membase123 data_path:/data [membase] rest_username:Administrator rest_password:password [servers] 1:_1 2:_2 3:_3 4:_4 5:_5 6:_6 [_1] ip:172.23.138.1 port:8091 [_2] ip:172.23.137.255 port:8091 [_3] ip:172.23.137.252 port:8091 [_4] ip:172.23.137.254 port:8091 [_5] ip:172.23.137.253 port:8091 [_6] ip:172.23.138.0 port:8091 extra install is > Configure project : Using Transaction_client :: 1.2.1 Using Java_client :: 3.4.2 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/ssh.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_root.14086.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/eagles_all_around.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_root.14086.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main scripts/install.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_root.14086.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources testrunner.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_root.14086.ini iptables -F Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.2/2e55dabbcc58c842d9edb85d90f75f06d5488dcc/java-client-3.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.2/46b78709c77b6e722682db97d1067d3ba74135b0/core-io-2.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.0/83749d14f5795905e5b8e8c258c917d4707b586c/reactor-core-3.5.0.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec_root.14086.ini iptables -F > Task :iptables ERROR StatusLogger No Log4j 2 configuration file found. Using default configuration (logging only errors to the console), or user programmatically provided configurations. Set system property 'log4j2.debug' to show Log4j 2 internal initialization logging. See https://logging.apache.org/log4j/2.x/manual/configuration.html for instructions on how to configure Log4j 2 172.23.138.0 bash: iptables: command not found 172.23.138.1 bash: iptables: command not found 172.23.137.255 bash: iptables: command not found 172.23.137.252 bash: iptables: command not found 172.23.137.253 bash: iptables: command not found 172.23.137.254 bash: iptables: command not found Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 9s 1 actionable task: 1 executed /tmp/jenkins7836402636031882872.sh: line 171: [windows22: command not found warning: unable to rmdir lib/capellaAPI: Directory not empty warning: unable to rmdir magma_loader/DocLoader: Directory not empty Switched to a new branch 'neo' Branch neo set up to track remote branch neo from origin. From https://github.com/couchbase/testrunner * branch neo -> FETCH_HEAD Already up-to-date. Submodule path 'java_sdk_client': checked out 'de89b059ce28567dbac18afb032271a4eaa674ff' Server install cmd: python3 scripts/new_install.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -p timeout=2000,skip_local_download=True,get-cbcollect-info=True,version=7.2.4-7065,product=cb,ntp=True,debug_logs=True,url=,cb_non_package_installer_url= 2023-12-23 05:28:09,559 - root - WARNING - URL: is not valid, will use version to locate build 2023-12-23 05:28:09,560 - root - WARNING - URL: is not valid, will use default url to locate installer 2023-12-23 05:28:09,561 - root - INFO - SSH Connecting to 172.23.138.1 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:09,708 - root - INFO - SSH Connected to 172.23.138.1 as Administrator 2023-12-23 05:28:10,192 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:10,192 - root - INFO - This is windows server! 2023-12-23 05:28:10,349 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:10,457 - root - INFO - get windows information 2023-12-23 05:28:10,597 - root - INFO - running command.raw on 172.23.138.1: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:10,751 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:10,753 - root - INFO - SSH Connecting to 172.23.137.255 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:10,900 - root - INFO - SSH Connected to 172.23.137.255 as Administrator 2023-12-23 05:28:11,449 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:11,449 - root - INFO - This is windows server! 2023-12-23 05:28:11,607 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:11,744 - root - INFO - get windows information 2023-12-23 05:28:11,982 - root - INFO - running command.raw on 172.23.137.255: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:12,147 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:12,149 - root - INFO - SSH Connecting to 172.23.137.252 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:12,323 - root - INFO - SSH Connected to 172.23.137.252 as Administrator 2023-12-23 05:28:12,901 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:12,901 - root - INFO - This is windows server! 2023-12-23 05:28:13,057 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:13,182 - root - INFO - get windows information 2023-12-23 05:28:13,340 - root - INFO - running command.raw on 172.23.137.252: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:13,508 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:13,510 - root - INFO - SSH Connecting to 172.23.137.254 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:13,683 - root - INFO - SSH Connected to 172.23.137.254 as Administrator 2023-12-23 05:28:14,277 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:14,277 - root - INFO - This is windows server! 2023-12-23 05:28:14,421 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:14,558 - root - INFO - get windows information 2023-12-23 05:28:14,689 - root - INFO - running command.raw on 172.23.137.254: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:14,881 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:14,882 - root - INFO - SSH Connecting to 172.23.137.253 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:15,030 - root - INFO - SSH Connected to 172.23.137.253 as Administrator 2023-12-23 05:28:15,624 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:15,624 - root - INFO - This is windows server! 2023-12-23 05:28:15,796 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:15,936 - root - INFO - get windows information 2023-12-23 05:28:16,108 - root - INFO - running command.raw on 172.23.137.253: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:16,287 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:16,289 - root - INFO - SSH Connecting to 172.23.138.0 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:16,431 - root - INFO - SSH Connected to 172.23.138.0 as Administrator 2023-12-23 05:28:16,947 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:16,947 - root - INFO - This is windows server! 2023-12-23 05:28:17,104 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:17,213 - root - INFO - get windows information 2023-12-23 05:28:17,351 - root - INFO - running command.raw on 172.23.138.0: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:17,509 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:17,510 - root - INFO - SSH Connecting to 172.23.138.1 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:17,645 - root - INFO - SSH Connected to 172.23.138.1 as Administrator 2023-12-23 05:28:18,145 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:18,145 - root - INFO - This is windows server! 2023-12-23 05:28:18,302 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:18,411 - root - INFO - get windows information 2023-12-23 05:28:18,552 - root - INFO - running command.raw on 172.23.138.1: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:18,701 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:18,703 - root - INFO - SSH Connecting to 172.23.137.255 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:18,853 - root - INFO - SSH Connected to 172.23.137.255 as Administrator 2023-12-23 05:28:19,416 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:19,416 - root - INFO - This is windows server! 2023-12-23 05:28:19,588 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:19,713 - root - INFO - get windows information 2023-12-23 05:28:19,825 - root - INFO - running command.raw on 172.23.137.255: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:19,988 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:19,990 - root - INFO - SSH Connecting to 172.23.137.252 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:20,135 - root - INFO - SSH Connected to 172.23.137.252 as Administrator 2023-12-23 05:28:20,651 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:20,651 - root - INFO - This is windows server! 2023-12-23 05:28:20,807 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:20,932 - root - INFO - get windows information 2023-12-23 05:28:21,053 - root - INFO - running command.raw on 172.23.137.252: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:21,217 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:21,219 - root - INFO - SSH Connecting to 172.23.137.254 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:21,355 - root - INFO - SSH Connected to 172.23.137.254 as Administrator 2023-12-23 05:28:21,918 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:21,918 - root - INFO - This is windows server! 2023-12-23 05:28:22,090 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:22,214 - root - INFO - get windows information 2023-12-23 05:28:22,363 - root - INFO - running command.raw on 172.23.137.254: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:22,532 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:22,533 - root - INFO - SSH Connecting to 172.23.137.253 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:22,686 - root - INFO - SSH Connected to 172.23.137.253 as Administrator 2023-12-23 05:28:23,358 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:23,358 - root - INFO - This is windows server! 2023-12-23 05:28:23,530 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:23,655 - root - INFO - get windows information 2023-12-23 05:28:23,804 - root - INFO - running command.raw on 172.23.137.253: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:23,973 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:23,975 - root - INFO - SSH Connecting to 172.23.138.0 with username:Administrator, attempt#1 of 5 2023-12-23 05:28:24,119 - root - INFO - SSH Connected to 172.23.138.0 as Administrator 2023-12-23 05:28:24,591 - root - INFO - File /cygdrive/c/Windows/win.ini was found 2023-12-23 05:28:24,591 - root - INFO - This is windows server! 2023-12-23 05:28:24,730 - root - INFO - File /cygdrive/c/tmp/windows_info.txt was found 2023-12-23 05:28:24,838 - root - INFO - get windows information 2023-12-23 05:28:24,943 - root - INFO - running command.raw on 172.23.138.0: echo "ipconfig" > /tmp/cmd.bat; chmod u=rwx /tmp/cmd.bat; /tmp/cmd.bat 2023-12-23 05:28:25,089 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:25,090 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,092 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,092 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,093 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,093 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,093 - root - INFO - Check if ntp is installed 2023-12-23 05:28:25,206 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.138.1 2023-12-23 05:28:25,214 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.138.0 2023-12-23 05:28:25,234 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.137.255 2023-12-23 05:28:25,235 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.137.252 2023-12-23 05:28:25,239 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.137.254 2023-12-23 05:28:25,240 - root - INFO - ['Sat Dec 23 05:28:25 PST 2023'] IP: 172.23.137.253 2023-12-23 05:28:25,241 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,244 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:25,244 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,245 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:25,245 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,247 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:25,247 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,248 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:25,248 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,249 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:25,250 - root - INFO - Trying to check is this url alive: http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:25,251 - root - INFO - This url http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi is live 2023-12-23 05:28:37,270 - root - INFO - running command.raw on 172.23.138.0: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:37,375 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:37,375 - root - INFO - running command.raw on 172.23.138.0: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:37,443 - root - INFO - running command.raw on 172.23.138.1: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:37,502 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:37,502 - root - INFO - running command.raw on 172.23.138.0: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:37,531 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:37,531 - root - INFO - running command.raw on 172.23.138.1: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:37,645 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:37,678 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:37,678 - root - INFO - running command.raw on 172.23.138.1: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:37,819 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:39,912 - root - INFO - Done with uninstall on 172.23.138.1. 2023-12-23 05:28:40,046 - root - INFO - Done with uninstall on 172.23.138.0. 2023-12-23 05:28:40,182 - root - INFO - running command.raw on 172.23.137.252: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:40,185 - root - INFO - running command.raw on 172.23.137.253: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:40,219 - root - INFO - running command.raw on 172.23.137.254: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:40,307 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:40,307 - root - INFO - running command.raw on 172.23.137.252: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:40,315 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:40,315 - root - INFO - running command.raw on 172.23.137.253: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:40,340 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:40,340 - root - INFO - running command.raw on 172.23.137.254: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:40,479 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:40,479 - root - INFO - running command.raw on 172.23.137.252: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:40,480 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:40,480 - root - INFO - running command.raw on 172.23.137.253: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:40,513 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:40,513 - root - INFO - running command.raw on 172.23.137.254: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:40,526 - root - INFO - running command.raw on 172.23.137.255: cat /cygdrive/c/Program\ Files/Couchbase/Server/VERSION.txt 2023-12-23 05:28:40,639 - root - INFO - command executed with Administrator but got an error ["cat: '/cygdrive/c/Program Files/Couchbase/Server/VERSION.txt': No such file or directory"] ... 2023-12-23 05:28:40,639 - root - INFO - running command.raw on 172.23.137.255: taskkill /F /IM MicrosoftEdge.exe /T 2023-12-23 05:28:40,647 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:40,654 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:40,672 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:40,800 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "MicrosoftEdge.exe" not found.'] ... 2023-12-23 05:28:40,801 - root - INFO - running command.raw on 172.23.137.255: taskkill /F /IM iexplore.exe /T 2023-12-23 05:28:40,977 - root - INFO - command executed with Administrator but got an error ['ERROR: The process "iexplore.exe" not found.'] ... 2023-12-23 05:28:43,353 - root - INFO - Done with uninstall on 172.23.137.254. 2023-12-23 05:28:43,382 - root - INFO - Done with uninstall on 172.23.137.253. 2023-12-23 05:28:43,490 - root - INFO - Done with uninstall on 172.23.137.252. 2023-12-23 05:28:43,625 - root - INFO - Done with uninstall on 172.23.137.255. 2023-12-23 05:28:45,274 - root - INFO - running command.raw on 172.23.138.1: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:52,823 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:52,825 - root - INFO - running command.raw on 172.23.138.1: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:53,750 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:53,750 - root - INFO - running command.raw on 172.23.138.1: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:53,927 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:53,927 - root - INFO - running command.raw on 172.23.137.255: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:56,498 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:56,500 - root - INFO - running command.raw on 172.23.137.255: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:56,644 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:56,644 - root - INFO - running command.raw on 172.23.137.255: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:56,774 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:56,774 - root - INFO - running command.raw on 172.23.137.252: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:59,154 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:59,156 - root - INFO - running command.raw on 172.23.137.252: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:59,301 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:59,302 - root - INFO - running command.raw on 172.23.137.252: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:28:59,587 - root - INFO - command executed successfully with Administrator 2023-12-23 05:28:59,587 - root - INFO - running command.raw on 172.23.137.254: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:01,723 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:01,724 - root - INFO - running command.raw on 172.23.137.254: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:01,974 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:01,974 - root - INFO - running command.raw on 172.23.137.254: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:02,095 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:02,095 - root - INFO - running command.raw on 172.23.137.253: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:04,342 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:04,344 - root - INFO - running command.raw on 172.23.137.253: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:04,484 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:04,484 - root - INFO - running command.raw on 172.23.137.253: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:04,597 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:04,597 - root - INFO - running command.raw on 172.23.138.0: cd /cygdrive/c/tmp/; wget -Nq -O couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi http://172.23.126.166/builds/latestbuilds/couchbase-server/neo/7065/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:12,170 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:12,172 - root - INFO - running command.raw on 172.23.138.0: cd /cygdrive/c/tmp/ && wc -c couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:12,921 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:12,921 - root - INFO - running command.raw on 172.23.138.0: ls -lh /cygdrive/c/tmp/couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi 2023-12-23 05:29:13,019 - root - INFO - command executed successfully with Administrator 2023-12-23 05:29:13,019 - root - INFO - running command.raw on 172.23.138.1: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:29:13,020 - root - INFO - running command.raw on 172.23.137.255: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:29:13,020 - root - INFO - running command.raw on 172.23.137.252: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:29:13,021 - root - INFO - running command.raw on 172.23.137.254: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:29:13,023 - root - INFO - running command.raw on 172.23.137.253: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:29:13,023 - root - INFO - running command.raw on 172.23.138.0: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:30:26,735 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:26,735 - root - INFO - Waiting 50s for install to complete on 172.23.137.252.. 2023-12-23 05:30:26,933 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:26,933 - root - INFO - Waiting 50s for install to complete on 172.23.137.255.. 2023-12-23 05:30:27,185 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:27,186 - root - INFO - Waiting 50s for install to complete on 172.23.137.254.. 2023-12-23 05:30:27,806 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:27,806 - root - INFO - Waiting 50s for install to complete on 172.23.137.253.. 2023-12-23 05:30:30,564 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:30,564 - root - INFO - Waiting 50s for install to complete on 172.23.138.1.. 2023-12-23 05:30:41,145 - root - INFO - command executed successfully with Administrator 2023-12-23 05:30:41,145 - root - INFO - Waiting 50s for install to complete on 172.23.138.0.. 2023-12-23 05:31:16,784 - root - INFO - running command.raw on 172.23.137.252: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:16,984 - root - INFO - running command.raw on 172.23.137.255: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:17,218 - root - INFO - running command.raw on 172.23.137.254: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:17,857 - root - INFO - running command.raw on 172.23.137.253: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:20,608 - root - INFO - running command.raw on 172.23.138.1: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:31,195 - root - INFO - running command.raw on 172.23.138.0: cd /cygdrive/c/tmp/; msiexec /i couchbase-server-enterprise_7.2.4-7065-windows_amd64.msi /passive /L*V install_status.txt 2023-12-23 05:31:52,602 - root - INFO - command executed successfully with Administrator 2023-12-23 05:31:52,602 - root - INFO - Waiting 50s for install to complete on 172.23.137.255.. 2023-12-23 05:31:55,246 - root - INFO - command executed successfully with Administrator 2023-12-23 05:31:55,247 - root - INFO - Waiting 50s for install to complete on 172.23.137.254.. 2023-12-23 05:31:55,669 - root - INFO - command executed successfully with Administrator 2023-12-23 05:31:55,670 - root - INFO - Waiting 50s for install to complete on 172.23.137.253.. 2023-12-23 05:31:57,998 - root - INFO - command executed successfully with Administrator 2023-12-23 05:31:57,999 - root - INFO - Waiting 50s for install to complete on 172.23.138.1.. 2023-12-23 05:32:01,213 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:01,214 - root - INFO - Waiting 50s for install to complete on 172.23.137.252.. 2023-12-23 05:32:03,258 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:03,258 - root - INFO - Waiting 50s for install to complete on 172.23.138.0.. 2023-12-23 05:32:42,653 - root - INFO - running command.raw on 172.23.137.255: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:44,993 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:44,993 - root - INFO - Done with install on 172.23.137.255. 2023-12-23 05:32:44,993 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:45,012 - root - INFO - running command.raw on 172.23.137.255: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.137.255 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:45,297 - root - INFO - running command.raw on 172.23.137.254: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:45,719 - root - INFO - running command.raw on 172.23.137.253: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:47,685 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:47,685 - root - INFO - Done with install on 172.23.137.254. 2023-12-23 05:32:47,685 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:47,703 - root - INFO - running command.raw on 172.23.137.254: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.137.254 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:48,039 - root - INFO - running command.raw on 172.23.138.1: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:48,334 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:48,334 - root - INFO - Done with install on 172.23.137.253. 2023-12-23 05:32:48,334 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:48,354 - root - INFO - running command.raw on 172.23.137.253: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.137.253 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:49,730 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:49,735 - root - INFO - running command.raw on 172.23.137.255: rm -rf /data/* 2023-12-23 05:32:49,896 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:49,897 - root - INFO - running command.raw on 172.23.137.255: chown -R couchbase:couchbase /data 2023-12-23 05:32:50,057 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:50,057 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:50,060 - root - ERROR - POST http://172.23.137.255:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:50,062 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:32:50,546 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:50,546 - root - INFO - Done with install on 172.23.138.1. 2023-12-23 05:32:50,546 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:50,560 - root - INFO - running command.raw on 172.23.138.1: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.138.1 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:51,067 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.137.255 2023-12-23 05:32:51,067 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:32:51,085 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:32:51,085 - root - INFO - node/controller/setupServices params on 172.23.137.255: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:32:51,192 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:32:51,192 - root - INFO - settings/web params on 172.23.137.255:8091:port=8091&username=Administrator&password=password 2023-12-23 05:32:51,264 - root - INFO - running command.raw on 172.23.137.252: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:51,313 - root - INFO - --> status:True 2023-12-23 05:32:51,313 - root - INFO - Done with init on 172.23.137.255. 2023-12-23 05:32:51,313 - root - INFO - running command.raw on 172.23.137.255: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:32:51,534 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:51,534 - root - INFO - Done with cleanup on 172.23.137.255. 2023-12-23 05:32:52,208 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:52,212 - root - INFO - running command.raw on 172.23.137.254: rm -rf /data/* 2023-12-23 05:32:52,358 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:52,358 - root - INFO - running command.raw on 172.23.137.254: chown -R couchbase:couchbase /data 2023-12-23 05:32:52,516 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:52,517 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:52,520 - root - ERROR - POST http://172.23.137.254:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:52,521 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:32:53,309 - root - INFO - running command.raw on 172.23.138.0: cd /cygdrive/c/tmp/; vi +"set nobomb | set fenc=ascii | x" install_status.txt; grep '7.2.4-7065.*[Configuration\|Installation] completed successfully.' install_status.txt && echo 1 || echo 0 2023-12-23 05:32:53,525 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.137.254 2023-12-23 05:32:53,526 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:32:53,542 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:32:53,542 - root - INFO - node/controller/setupServices params on 172.23.137.254: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:32:53,636 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:32:53,636 - root - INFO - settings/web params on 172.23.137.254:8091:port=8091&username=Administrator&password=password 2023-12-23 05:32:53,734 - root - INFO - --> status:True 2023-12-23 05:32:53,734 - root - INFO - Done with init on 172.23.137.254. 2023-12-23 05:32:53,735 - root - INFO - running command.raw on 172.23.137.254: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:32:53,947 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:53,947 - root - INFO - Done with cleanup on 172.23.137.254. 2023-12-23 05:32:53,979 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:53,980 - root - INFO - Done with install on 172.23.137.252. 2023-12-23 05:32:53,980 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:53,999 - root - INFO - running command.raw on 172.23.137.252: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.137.252 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:54,110 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:54,114 - root - INFO - running command.raw on 172.23.138.1: rm -rf /data/* 2023-12-23 05:32:54,246 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:54,246 - root - INFO - running command.raw on 172.23.138.1: chown -R couchbase:couchbase /data 2023-12-23 05:32:54,383 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:54,384 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:54,386 - root - ERROR - POST http://172.23.138.1:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:54,387 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:32:54,473 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:54,477 - root - INFO - running command.raw on 172.23.137.253: rm -rf /data/* 2023-12-23 05:32:54,602 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:54,602 - root - INFO - running command.raw on 172.23.137.253: chown -R couchbase:couchbase /data 2023-12-23 05:32:54,747 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:54,747 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:54,751 - root - ERROR - POST http://172.23.137.253:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:54,751 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:32:55,391 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.138.1 2023-12-23 05:32:55,391 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:32:55,405 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:32:55,405 - root - INFO - node/controller/setupServices params on 172.23.138.1: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:32:55,452 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:32:55,453 - root - INFO - settings/web params on 172.23.138.1:8091:port=8091&username=Administrator&password=password 2023-12-23 05:32:55,531 - root - INFO - --> status:True 2023-12-23 05:32:55,531 - root - INFO - Done with init on 172.23.138.1. 2023-12-23 05:32:55,531 - root - INFO - running command.raw on 172.23.138.1: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:32:55,593 - root - INFO - command executed with Administrator but got an error ['Vim: Warning: Output is not to a terminal', 'Vim: Warning: Input is not from a terminal'] ... 2023-12-23 05:32:55,593 - root - INFO - Done with install on 172.23.138.0. 2023-12-23 05:32:55,593 - root - INFO - Waiting for couchbase to be reachable 2023-12-23 05:32:55,607 - root - INFO - running command.raw on 172.23.138.0: /cygdrive/c/Program\ Files/Couchbase/Server/bin/couchbase-cli node-init -c 172.23.138.0 -u Administrator -p password > /dev/null && echo 1 || echo 0; 2023-12-23 05:32:55,718 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:55,718 - root - INFO - Done with cleanup on 172.23.138.1. 2023-12-23 05:32:55,755 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.137.253 2023-12-23 05:32:55,756 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:32:55,774 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:32:55,774 - root - INFO - node/controller/setupServices params on 172.23.137.253: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:32:55,872 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:32:55,872 - root - INFO - settings/web params on 172.23.137.253:8091:port=8091&username=Administrator&password=password 2023-12-23 05:32:55,983 - root - INFO - --> status:True 2023-12-23 05:32:55,983 - root - INFO - Done with init on 172.23.137.253. 2023-12-23 05:32:55,983 - root - INFO - running command.raw on 172.23.137.253: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:32:56,176 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:56,176 - root - INFO - Done with cleanup on 172.23.137.253. 2023-12-23 05:32:58,865 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:58,868 - root - INFO - running command.raw on 172.23.138.0: rm -rf /data/* 2023-12-23 05:32:58,997 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:58,998 - root - INFO - running command.raw on 172.23.138.0: chown -R couchbase:couchbase /data 2023-12-23 05:32:59,119 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:59,119 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:59,123 - root - ERROR - POST http://172.23.138.0:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:59,123 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:32:59,285 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:59,289 - root - INFO - running command.raw on 172.23.137.252: rm -rf /data/* 2023-12-23 05:32:59,414 - root - INFO - command executed successfully with Administrator 2023-12-23 05:32:59,414 - root - INFO - running command.raw on 172.23.137.252: chown -R couchbase:couchbase /data 2023-12-23 05:32:59,539 - root - INFO - command executed with Administrator but got an error ["chown: invalid user: 'couchbase:couchbase'"] ... 2023-12-23 05:32:59,540 - root - INFO - nodes/self/controller/settings : path=%2Fdata 2023-12-23 05:32:59,543 - root - ERROR - POST http://172.23.137.252:8091/nodes/self/controller/settings body: path=%2Fdata headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["An absolute path is required for path"]' auth: Administrator:password 2023-12-23 05:32:59,543 - root - ERROR - Unable to set data_path /data : b'["An absolute path is required for path"]' 2023-12-23 05:33:00,127 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.138.0 2023-12-23 05:33:00,127 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:33:00,141 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:33:00,142 - root - INFO - node/controller/setupServices params on 172.23.138.0: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:33:00,222 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:33:00,222 - root - INFO - settings/web params on 172.23.138.0:8091:port=8091&username=Administrator&password=password 2023-12-23 05:33:00,300 - root - INFO - --> status:True 2023-12-23 05:33:00,300 - root - INFO - Done with init on 172.23.138.0. 2023-12-23 05:33:00,300 - root - INFO - running command.raw on 172.23.138.0: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:33:00,478 - root - INFO - command executed successfully with Administrator 2023-12-23 05:33:00,478 - root - INFO - Done with cleanup on 172.23.138.0. 2023-12-23 05:33:00,548 - root - INFO - Setting KV memory quota as 3288 MB on 172.23.137.252 2023-12-23 05:33:00,548 - root - INFO - pools/default params : memoryQuota=3288 2023-12-23 05:33:00,565 - root - INFO - --> init_node_services(Administrator,password,None,8091,['kv']) 2023-12-23 05:33:00,566 - root - INFO - node/controller/setupServices params on 172.23.137.252: 8091:hostname=None&user=Administrator&password=password&services=kv 2023-12-23 05:33:00,655 - root - INFO - --> in init_cluster...Administrator,password,8091 2023-12-23 05:33:00,655 - root - INFO - settings/web params on 172.23.137.252:8091:port=8091&username=Administrator&password=password 2023-12-23 05:33:00,768 - root - INFO - --> status:True 2023-12-23 05:33:00,768 - root - INFO - Done with init on 172.23.137.252. 2023-12-23 05:33:00,768 - root - INFO - running command.raw on 172.23.137.252: ls -td /cygdrive/c/tmp/couchbase*.msi | awk 'NR>2' | xargs rm -f 2023-12-23 05:33:00,955 - root - INFO - command executed successfully with Administrator 2023-12-23 05:33:00,955 - root - INFO - Done with cleanup on 172.23.137.252. 2023-12-23 05:33:03,249 - root - INFO - ---------------------------------------------------------------------------------------------------- 2023-12-23 05:33:03,279 - root - INFO - cluster:C1 node:172.23.138.1:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - cluster:C2 node:172.23.137.255:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - cluster:C3 node:172.23.137.252:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - cluster:C4 node:172.23.137.254:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - cluster:C5 node:172.23.137.253:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - cluster:C6 node:172.23.138.0:8091 version:7.2.4-7065-enterprise aFamily:inet services:['kv'] 2023-12-23 05:33:03,280 - root - INFO - ---------------------------------------------------------------------------------------------------- 2023-12-23 05:33:03,280 - root - INFO - ---------------------------------------------------------------------------------------------------- 2023-12-23 05:33:03,280 - root - INFO - ---------------------------------------------------------------------------------------------------- 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.138.1 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.137.255 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.137.252 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.137.254 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.137.253 2023-12-23 05:33:03,280 - root - INFO - INSTALL COMPLETED ON: 172.23.138.0 2023-12-23 05:33:03,281 - root - INFO - ---------------------------------------------------------------------------------------------------- 2023-12-23 05:33:03,281 - root - INFO - TOTAL INSTALL TIME = 294 seconds Need to set ALLOW_HTP back to True to do git pull branch Switched to a new branch 'neo' Branch neo set up to track remote branch neo from origin. From https://github.com/couchbaselabs/TAF * branch neo -> FETCH_HEAD Already up-to-date. Set ALLOW_HTP to False so test could run. HEAD is now at d7e8fa4 CBQE-8052 : Fixing usage of old_vbuckets and new_vbuckets find: ‘/root/jenkins/workspace/’: No such file or directory find: ‘/root/workspace/*/logs/*’: No such file or directory find: ‘/root/workspace/’: No such file or directory python: no process found jython: no process found GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 Timeout: 1200 minutes > Configure project : Using Transaction_client :: 1.2.1 Using Java_client :: 3.4.10 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/ssh.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -c conf/collections/collections_rebalance_crud_on_collections.conf -p GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/eagles_all_around.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -c conf/collections/collections_rebalance_crud_on_collections.conf -p GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main scripts/install.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -c conf/collections/collections_rebalance_crud_on_collections.conf -p GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources testrunner.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -c conf/collections/collections_rebalance_crud_on_collections.conf -p GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini -c conf/collections/collections_rebalance_crud_on_collections.conf -p GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -m rest > Task :compileJava warning: unknown enum constant When.MAYBE reason: class file for javax.annotation.meta.When not found Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. 1 warning > Task :testrunner Filename: conf/collections/collections_rebalance_crud_on_collections.conf Prefix: bucket_collections.collections_rebalance.CollectionsRebalance Global Test input params: {'GROUP': 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY', 'cluster_name': 'testexec.14086', 'conf_file': 'conf/collections/collections_rebalance_crud_on_collections.conf', 'get-cbcollect-info': 'True', 'ini': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini', 'num_nodes': 6, 'rerun': 'False', 'sirius_url': 'http://172.23.120.103:4000', 'spec': 'collections_rebalance_crud_on_collections', 'upgrade_version': '7.2.4-7065'} Only cases in GROUPs 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY' will be executed Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=before,scrape_interval=5,rebalance_moves_per_node=32,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=before,scrape_interval=5,rebalance_moves_per_node=32,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=4,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=before,scrape_interval=5,rebalance_moves_per_node=32,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=4,nodes_swap=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=2,nodes_out=1,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=before,scrape_interval=5,rebalance_moves_per_node=32,quota_percent=80,skip_validations=False,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=1,nodes_out=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=4,nodes_swap=2,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=2,nodes_out=1,override_spec_params=durability;replicas,durability=MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_rebalance_cycles,nodes_init=4,nodes_in=2,durability=MAJORITY,replicas=2,bucket_spec=single_bucket.default_ephemeral,num_items=10000,bulk_api_crud=True,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_Orchestrator_Node_failover,nodes_init=4,nodes_in=2,durability=MAJORITY,replicas=2,bucket_spec=single_bucket.default_ephemeral,num_items=10000,bulk_api_crud=True,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,oso_dcp_backfill=disabled,GROUP=rebalance_with_collection_crud_durability_MAJORITY' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,override_spec_params=durability;replicas,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,override_spec_params=durability;replicas,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=4,nodes_swap=2,override_spec_params=durability;replicas,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,oso_dcp_backfill=disabled,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=2,nodes_out=1,override_spec_params=durability;replicas,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_rebalance_cycles,nodes_init=4,nodes_in=2,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=single_bucket.default,num_items=10000,bulk_api_crud=True,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_Orchestrator_Node_failover,nodes_init=4,nodes_in=2,durability=MAJORITY_AND_PERSIST_TO_ACTIVE,replicas=2,bucket_spec=single_bucket.default,num_items=10000,bulk_api_crud=True,GROUP=rebalance_with_collection_crud_durability_MAJORITY_AND_PERSIST_TO_ACTIVE,graceful=False' skipped, GROUP not satisfied Logs will be stored at /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,override_spec_params=durability;replicas,durability=PERSIST_TO_MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY' Test Input params: {'load_collections_exponentially': 'True', 'data_load_stage': 'during', 'quota_percent': '80', 'test_oso_backfill': 'True', 'conf_file': 'conf/collections/collections_rebalance_crud_on_collections.conf', 'upgrade_version': '7.2.4-7065', 'index_quota_percent': '15', 'nodes_in': '2', 'spec': 'collections_rebalance_crud_on_collections', 'rerun': 'False', 'num_nodes': 6, 'kv_quota_percent': '85', 'GROUP': 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY', 'services_init': 'kv:index:n1ql-kv:index:n1ql-kv:index:n1ql', 'bucket_spec': 'multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections', 'case_number': 1, 'data_load_spec': 'volume_test_load_with_CRUD_on_collections', 'cluster_name': 'testexec.14086', 'ini': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini', 'get-cbcollect-info': 'True', 'replicas': '2', 'durability': 'PERSIST_TO_MAJORITY', 'skip_validations': 'False', 'logs_folder': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_1', 'nodes_init': '3', 'sirius_url': 'http://172.23.120.103:4000', 'override_spec_params': 'durability;replicas'} test_data_load_collections_with_rebalance_in (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2023-12-23 05:33:25,926 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionsRebalance setup started for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:33:26,260 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup started for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:33:27,226 | test | INFO | MainThread | [basetestcase:initialize_cluster:487] Initializing cluster : C1 2023-12-23 05:33:44,763 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:44,815 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:44,855 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:44,895 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:45,055 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:45,461 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:46,778 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:46,826 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:46,865 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:46,904 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:47,065 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:47,470 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:48,788 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:48,835 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:48,874 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:48,913 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:49,075 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:49,480 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:50,796 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:50,842 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:50,881 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:50,921 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:51,085 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:51,490 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:52,805 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:52,851 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:52,890 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:52,928 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:53,094 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:53,497 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:54,812 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:54,858 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:54,897 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:54,936 | test | ERROR | pool-5-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:55,101 | test | ERROR | pool-5-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:55,506 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:56,819 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:56,867 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:56,905 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:57,516 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:58,828 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:58,874 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:58,914 | test | ERROR | pool-5-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:33:59,525 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:00,838 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:00,881 | test | ERROR | pool-5-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:01,532 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:02,845 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:03,539 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:04,855 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:05,548 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:06,862 | test | ERROR | pool-5-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:07,555 | test | ERROR | pool-5-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 05:34:37,391 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.1:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:37,397 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:37,440 | infra | CRITICAL | pool-5-thread-25 | [task:call:6274] mcdMemoryReserved reported in nodes/self is: 4908 2023-12-23 05:34:37,440 | test | CRITICAL | pool-5-thread-25 | [table_view:display:72] Memory quota allocated: +---------------------+---------+ | Service | RAM MiB | +---------------------+---------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 576 | | ftsMemoryQuota | 256 | | memoryQuota | 3269 | +---------------------+---------+ 2023-12-23 05:34:37,667 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.255:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:37,670 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:37,861 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.252:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:37,865 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:38,078 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.254:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:38,082 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:38,289 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.253:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:38,292 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:38,500 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.0:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 05:34:38,503 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 05:34:38,503 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:738] RAM quota was defined less than 100 MB: 2023-12-23 05:34:50,793 | test | INFO | MainThread | [basetestcase:initialize_cluster:513] Cluster C1 initialized 2023-12-23 05:34:50,823 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup finished for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:34:50,855 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup started for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:35:33,864 | test | INFO | pool-5-thread-26 | [table_view:display:72] Rebalance Overview +----------------+-------------------+-----------------------+---------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+-------------------+-----------------------+---------------+--------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 7.2.4-7065-enterprise | 19.1972775498 | Cluster node | active / none | | 172.23.137.255 | ['kv,index,n1ql'] | | | <--- IN --- | | | 172.23.137.252 | ['kv,index,n1ql'] | | | <--- IN --- | | +----------------+-------------------+-----------------------+---------------+--------------+-----------------------+ 2023-12-23 05:35:33,897 | test | INFO | pool-5-thread-26 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 05:35:48,950 | test | INFO | pool-5-thread-26 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 05:35:48,969 | test | INFO | pool-5-thread-26 | [task:check:480] Rebalance completed with progress: 100% in 15.1050000191 sec 2023-12-23 05:35:49,131 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 1.68664668665 | 5.99 GiB | 4.07 GiB | 2.11 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | index, kv, n1ql | 10.0266666667 | 5.99 GiB | 4.28 GiB | 1.66 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | index, kv, n1ql | 15.4780956191 | 5.99 GiB | 3.98 GiB | 2.13 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 05:35:49,132 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup complete for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:35:49,132 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup started for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 05:35:49,381 | test | INFO | MainThread | [collections_base:deploy_buckets_from_spec_file:470] Creating bucket from spec: multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections 2023-12-23 05:35:49,382 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1980] Creating required buckets from template 2023-12-23 05:36:35,933 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2742] Waiting for all collections to be created 2023-12-23 05:36:36,028 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 52.5730877052 | 5.99 GiB | 3.85 GiB | 2.37 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | index, kv, n1ql | 73.7368684342 | 5.99 GiB | 3.73 GiB | 2.44 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | index, kv, n1ql | 50.6746626687 | 5.99 GiB | 3.69 GiB | 2.42 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 05:36:36,855 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 0 | 600.00 MiB | 5.94 MiB | 64.16 KiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 0 | 600.00 MiB | 219.82 MiB | 122.11 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 0 | 4.39 GiB | 3.97 MiB | 44.51 KiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2023-12-23 05:36:36,858 | test | INFO | MainThread | [collections_base:create_clients_for_sdk_pool:491] Creating required SDK clients for client_pool 2023-12-23 05:37:47,993 | test | INFO | MainThread | [collections_base:load_data_from_spec_file:501] Loading data using spec: initial_load 2023-12-23 05:37:48,006 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 05:37:48,019 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 05:58:51,877 | test | INFO | pool-5-thread-1 | [table_view:display:72] Ops trend for bucket 'default' +---------+------------------------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | *******.....*******X | 44.900 | | 28.100 | ..********..****......**.....**X | 135.971 | | 91.171 | ..........X | 91.171 | | 19.700 | .********....***........*......*****X | 170.200 | | 110.300 | ............X | 110.300 | | 56.700 | .....*********......*******X | 104.100 | | 90.000 | .........*******.....................*****X | 261.800 | | 159.600 | ..................**...............******X | 283.550 | | 253.700 | .............................**.........******X | 326.300 | | 273.900 | ................................*....*****X | 305.200 | | 270.400 | ...............................X | 270.400 | | 229.700 | ...........................X | 229.700 | | 227.600 | ..........................*******............***..*********...............**........................****X | 656.200 | | 633.400 | ............................................................................*.**......................**X | 819.700 | | 590.700 | .......................................................................*X | 590.700 | | 325.800 | ......................................**X | 325.800 | | 195.700 | ......................*****...........*......................*.......................***X | 648.000 | | 552.100 | ..................................................................X | 552.100 | | 490.800 | ..........................................................*****X | 490.800 | | 344.100 | ........................................X | 344.100 | | 271.000 | ................................******X | 271.000 | | 234.000 | ...........................*********X | 234.000 | | 197.185 | .......................***........................****X | 395.685 | | 230.785 | ...........................**.***.........***X | 314.511 | | 275.311 | ................................***X | 275.311 | | 185.500 | .....................*X | 185.500 | | 70.700 | .......X | 70.700 | | 43.000 | ....******X | 43.000 | | 5.700 | **.***********....................................**.................****X | 444.700 | | 334.400 | .......................................***.***X | 341.200 | | 314.400 | .....................................*X | 314.400 | | 193.000 | ......................**..********......*........**................**X | 453.100 | | 191.400 | ......................X | 191.400 | | 144.000 | ................******......X | 194.900 | | 165.800 | ...................**.....*****...**...****.............******.....................X | 535.600 | | 484.000 | ..........................................................***X | 484.000 | | 428.300 | ...................................................***......................*******X | 611.000 | | 407.300 | ................................................*..........................***X | 617.700 | | 552.600 | ..................................................................*X | 552.600 | | 519.500 | ..............................................................*X | 519.500 | | 501.600 | ............................................................*****X | 501.600 | | 336.600 | ........................................**....................**.................****X | 641.300 | | 497.400 | ...........................................................X | 497.400 | | 380.100 | .............................................*....*******........*......*........****X | 596.900 | | 312.000 | .....................................X | 312.000 | | 202.100 | .......................****X | 202.100 | | 197.600 | .......................X | 197.600 | | 191.600 | ......................**********...........*................*..............****X | 527.800 | | 458.400 | ......................................................*X | 458.400 | | 447.600 | .....................................................****X | 447.600 | | 281.700 | .................................*..*X | 302.000 | | 228.050 | ..........................*****...................***..*********.......*.............****X | 564.100 | | 463.000 | .......................................................X | 463.000 | | 280.400 | .................................*****X | 280.400 | | 215.100 | .........................X | 215.100 | | 186.800 | .....................X | 186.800 | | 154.700 | .................*******.....X | 191.100 | | 187.400 | .....................**.......********...............**...................*********..........*..........................***X | 815.000 | | 658.700 | ...............................................................................*X | 658.700 | | 346.400 | .........................................***X | 346.400 | | 97.600 | ..........**********.........................*.................*******X | 436.800 | | 334.700 | .......................................*********.........*...****X | 428.500 | | 92.100 | ..........*********..........**..........*...........******X | 351.000 | | 328.500 | .......................................X | 328.500 | | 264.800 | ...............................*****X | 264.800 | | 201.000 | .......................*X | 201.000 | | 190.300 | ......................*******......X | 237.900 | | 219.500 | .........................*****X | 219.500 | | 173.700 | ....................***...*****X | 204.900 | | 125.000 | ..............*....*.....******......***..******X | 264.500 | | 216.600 | .........................**..*****..X | 248.200 | | 224.700 | ..........................*****X | 227.900 | | 181.300 | .....................***...*.....*********........................**********..........................*****X | 662.000 | | 609.800 | .........................................................................X | 609.800 | | 552.600 | ..................................................................X | 552.600 | | 527.700 | ...............................................................**X | 527.700 | | 217.900 | .........................X | 217.900 | | 88.800 | .........*********........................................***...................*****X | 571.100 | | 420.300 | ..................................................**X | 420.300 | | 353.100 | ..........................................**X | 353.100 | | 255.700 | ..............................X | 255.700 | | 252.400 | .............................****X | 252.400 | | 223.500 | ..........................*X | 223.500 | | 152.600 | .................*..*********......**********............................*...............****X | 566.900 | | 521.500 | ..............................................................**X | 521.500 | | 518.455 | ..............................................................*X | 518.455 | | 319.855 | ......................................X | 319.855 | | 56.700 | .....***********..............................................*..........................*****X | 642.000 | | 322.600 | ......................................*X | 322.600 | | 186.900 | .....................*********...............................*..........**X | 518.400 | | 347.600 | .........................................X | 347.600 | | 39.000 | ...***********.........................................................****X | 504.600 | | 434.000 | ...................................................*X | 434.000 | | 371.800 | ............................................*X | 371.800 | | 281.500 | .................................*********................................*****X | 547.100 | | 445.700 | .....................................................X | 445.700 | | 237.000 | ...........................****X | 237.000 | | 114.400 | ............X | 114.400 | | 69.800 | .......**********...................*...........********.*..****X | 338.100 | | 282.600 | .................................X | 282.600 | | 242.000 | ............................X | 242.000 | | 216.900 | .........................****X | 216.900 | | 160.100 | ..................*X | 160.100 | | 142.000 | ................**********.................*......********..*X | 350.000 | | 114.500 | ............X | 114.500 | | 5.500 | **********...............*..............*...............******X | 364.100 | | 340.500 | ........................................*X | 340.500 | | 309.800 | ....................................*****X | 309.800 | | 284.900 | .................................**..*..**X | 314.800 | | 194.600 | ......................X | 194.600 | | 56.100 | .....**********...........*....................*********..********.***X | 328.100 | | 131.500 | ...............X | 131.500 | | 42.700 | ....*********...........*........................********X | 328.300 | | 321.600 | ......................................*******X | 327.400 | | 319.400 | .....................................X | 319.400 | | 318.700 | .....................................**X | 318.700 | | 13.500 | ***********...............*..............*..............******X | 366.900 | | 359.800 | ..........................................*X | 359.800 | | 333.900 | .......................................***X | 333.900 | | 274.200 | ................................*X | 274.200 | | 243.400 | ............................X | 243.400 | | 228.000 | ..........................**X | 228.000 | | 105.500 | ...........**.**********...............*........********.*.*X | 312.489 | | 100.000 | ...........****X | 100.000 | | 79.381 | ........******.......................X | 262.481 | | 218.878 | .........................**********.................*******X | 356.200 | | 341.700 | ........................................X | 341.700 | | 340.300 | ........................................*X | 340.300 | | 19.400 | .***********.......................*.............*********X | 318.300 | | 317.900 | .....................................********..*X | 331.300 | | 229.200 | ..........................X | 229.200 | | 18.700 | .*********..........**...........*............*****X | 291.400 | | 266.800 | ...............................X | 266.800 | | 241.000 | ............................X | 241.000 | | 229.800 | ...........................******X | 229.800 | +---------+------------------------------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 05:58:52,667 | test | INFO | pool-5-thread-3 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | *******.............................................*******X | 18.600 | | 12.300 | ............................********X | 12.300 | | 8.300 | ...................****...............................*...............................***..X | 35.018 | | 30.918 | .........................................................................X | 30.918 | | 28.800 | ....................................................................*******.........................***X | 38.900 | | 38.300 | ...........................................................................................*........****X | 41.300 | | 39.200 | .............................................................................................X | 39.200 | | 37.900 | ..........................................................................................X | 37.900 | | 35.200 | ....................................................................................****X | 35.200 | | 24.500 | ..........................................................***X | 24.500 | | 19.300 | .............................................****X | 19.300 | | 18.300 | ...........................................**X | 18.300 | | 7.600 | .................*******..........................****X | 18.200 | | 8.250 | ..................***.....................*****X | 16.850 | | 8.250 | ..................**X | 8.250 | | 0.000 | ****************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************X | 0.000 | +--------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 05:58:52,930 | test | INFO | pool-5-thread-5 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | *******.......................................................*******X | 28.900 | | 8.100 | ..............********............****.....................................**....................................**X | 52.005 | | 26.976 | ..................................................X | 26.976 | | 7.800 | .............********...............***......................*......................****X | 38.200 | | 31.400 | ...........................................................X | 31.400 | | 26.200 | .................................................X | 26.200 | | 21.900 | .........................................****X | 21.900 | | 19.100 | ...................................****.****X | 19.600 | | 17.700 | .................................*X | 17.700 | | 17.300 | ................................********.....****X | 20.200 | | 8.300 | ..............**X | 8.300 | | 3.500 | .....*****X | 3.500 | | 1.700 | ..**X | 1.700 | | 0.000 | ***************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************************X | 0.000 | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 05:58:53,494 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 69.0664266907 | 5.99 GiB | 3.40 GiB | 2.72 GiB / 6.99 GiB | 127635 / 255734 | 7.2.4-7065-enterprise | | 172.23.137.252 | index, kv, n1ql | 57.4890603601 | 5.99 GiB | 3.59 GiB | 2.71 GiB / 6.99 GiB | 128228 / 257266 | 7.2.4-7065-enterprise | | 172.23.137.255 | index, kv, n1ql | 56.874208808 | 5.99 GiB | 3.63 GiB | 2.65 GiB / 6.99 GiB | 128097 / 255167 | 7.2.4-7065-enterprise | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 05:58:59,273 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4976] Validating collection stats and item counts 2023-12-23 05:59:34,423 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 6.98101244703 | 5.99 GiB | 3.38 GiB | 2.73 GiB / 6.99 GiB | 128429 / 257571 | 7.2.4-7065-enterprise | | 172.23.137.252 | index, kv, n1ql | 18.7685732412 | 5.99 GiB | 3.55 GiB | 2.73 GiB / 6.99 GiB | 128603 / 257397 | 7.2.4-7065-enterprise | | 172.23.137.255 | index, kv, n1ql | 8.64740577827 | 5.99 GiB | 3.59 GiB | 2.68 GiB / 6.99 GiB | 128968 / 257032 | 7.2.4-7065-enterprise | +----------------+-----------------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 05:59:34,974 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 3000 | 600.00 MiB | 175.22 MiB | 177.14 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 3000 | 600.00 MiB | 157.99 MiB | 312.86 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 380000 | 4.39 GiB | 357.80 MiB | 307.35 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2023-12-23 05:59:34,977 | test | CRITICAL | MainThread | [collections_base:create_indexes_for_all_collections:179] Testing oso_backfill by creating indexes 2023-12-23 05:59:34,979 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:181] Creating indexes for collections in bucket bucket2 2023-12-23 06:00:13,499 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:192] Building deferred indexes 2023-12-23 06:00:34,644 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:208] Waiting for index build to complete 2023-12-23 06:03:57,240 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:224] Validating num_items using created indexes 2023-12-23 06:03:58,138 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:181] Creating indexes for collections in bucket bucket1 2023-12-23 06:05:07,625 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:192] Building deferred indexes 2023-12-23 06:05:31,144 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:208] Waiting for index build to complete 2023-12-23 06:08:46,585 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:224] Validating num_items using created indexes 2023-12-23 06:08:47,803 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:181] Creating indexes for collections in bucket default 2023-12-23 06:10:43,448 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:192] Building deferred indexes 2023-12-23 06:11:20,704 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:208] Waiting for index build to complete 2023-12-23 06:14:54,796 | test | INFO | MainThread | [collections_base:create_indexes_for_all_collections:224] Validating num_items using created indexes 2023-12-23 06:14:55,588 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup complete for test #1 test_data_load_collections_with_rebalance_in ========= 2023-12-23 06:15:00,911 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1069] Doing collection data load during rebalance_in 2023-12-23 06:15:00,913 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:375] Starting rebalance operation of type : rebalance_in 2023-12-23 06:15:00,986 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 06:15:06,770 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 06:15:19,322 | test | INFO | pool-5-thread-18 | [table_view:display:72] Rebalance Overview +----------------+-----------------+-----------------------+---------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+-----------------+-----------------------+---------------+--------------+-----------------------+ | 172.23.138.1 | index, kv, n1ql | 7.2.4-7065-enterprise | 97.3435989734 | Cluster node | active / none | | 172.23.137.252 | index, kv, n1ql | 7.2.4-7065-enterprise | 94.8961562823 | Cluster node | active / none | | 172.23.137.255 | index, kv, n1ql | 7.2.4-7065-enterprise | 68.3818381838 | Cluster node | active / none | | 172.23.137.254 | None | | | <--- IN --- | | | 172.23.137.253 | None | | | <--- IN --- | | +----------------+-----------------+-----------------------+---------------+--------------+-----------------------+ 2023-12-23 06:15:19,365 | test | INFO | pool-5-thread-18 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:15:29,538 | test | INFO | pool-5-thread-18 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:15:39,690 | test | ERROR | pool-5-thread-18 | [rest_client:_rebalance_status_and_progress:1573] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'type': u'rebalance', u'masterRequestTimedOut': False, u'statusId': u'89d613a6804535ee899a6f645d85a920', u'subtype': u'rebalance', u'statusIsStale': False, u'lastReportURI': u'/logs/rebalanceReport?reportID=7996efb7f3f9e73e608db6c5ea331223', u'status': u'notRunning'} - rebalance failed 2023-12-23 06:15:39,717 | test | INFO | pool-5-thread-18 | [rest_client:print_UI_logs:2738] Latest logs from UI on 172.23.138.1: 2023-12-23 06:15:39,717 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.138.1', u'tstamp': 1703340933416L, u'shortText': u'message', u'serverTime': u'2023-12-23T06:15:33.416Z', u'text': u'Rebalance exited with reason {pre_rebalance_janitor_run_failed,"default",\n {error,wait_for_memcached_failed,\n [\'ns_1@172.23.137.252\']}}.\nRebalance Operation Id = 7f122b019b91d96977bbee426c07f1e0'} 2023-12-23 06:15:39,719 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'info', u'node': u'ns_1@172.23.138.1', u'tstamp': 1703340919100L, u'shortText': u'message', u'serverTime': u'2023-12-23T06:15:19.100Z', u'text': u"Starting rebalance, KeepNodes = ['ns_1@172.23.138.1','ns_1@172.23.137.254',\n 'ns_1@172.23.137.252','ns_1@172.23.137.255',\n 'ns_1@172.23.137.253'], EjectNodes = [], Failed over and being ejected nodes = []; no delta recovery nodes; Operation Id = 7f122b019b91d96977bbee426c07f1e0"} 2023-12-23 06:15:39,719 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 3, u'module': u'ns_cluster', u'type': u'info', u'node': u'ns_1@172.23.137.253', u'tstamp': 1703340917883L, u'shortText': u'message', u'serverTime': u'2023-12-23T06:15:17.883Z', u'text': u'Node ns_1@172.23.137.253 joined cluster'} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 0, u'module': u'memcached_config_mgr', u'type': u'info', u'node': u'ns_1@172.23.137.253', u'tstamp': 1703340917883L, u'shortText': u'message', u'serverTime': u'2023-12-23T06:15:17.883Z', u'text': u'Hot-reloaded memcached.json for config change of the following keys: [<<"scramsha_fallback_salt">>]'} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 1, u'module': u'menelaus_web_sup', u'type': u'info', u'node': u'ns_1@172.23.137.253', u'tstamp': 1703340917803L, u'shortText': u'web start ok', u'serverTime': u'2023-12-23T06:15:17.803Z', u'text': u'Couchbase Server has started on web port 8091 on node \'ns_1@172.23.137.253\'. Version: "7.2.4-7065-enterprise".'} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 0, u'module': u'memcached_config_mgr', u'type': u'info', u'node': u'ns_1@172.23.138.1', u'tstamp': 1703340913959L, u'shortText': u'message', u'serverTime': u'2023-12-23T06:15:13.959Z', u'text': u'Hot-reloaded memcached.json for config change of the following keys: [<<"scramsha_fallback_salt">>]'} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.137.255', u'tstamp': 1703340911736L, u'shortText': u'node up', u'serverTime': u'2023-12-23T06:15:11.736Z', u'text': u"Node 'ns_1@172.23.137.255' saw that node 'ns_1@172.23.137.253' came up. Tags: []"} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.137.252', u'tstamp': 1703340911708L, u'shortText': u'node up', u'serverTime': u'2023-12-23T06:15:11.708Z', u'text': u"Node 'ns_1@172.23.137.252' saw that node 'ns_1@172.23.137.253' came up. Tags: []"} 2023-12-23 06:15:39,720 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.138.1', u'tstamp': 1703340911451L, u'shortText': u'node up', u'serverTime': u'2023-12-23T06:15:11.451Z', u'text': u"Node 'ns_1@172.23.138.1' saw that node 'ns_1@172.23.137.253' came up. Tags: []"} 2023-12-23 06:15:39,721 | test | ERROR | pool-5-thread-18 | [rest_client:print_UI_logs:2740] {u'code': 4, u'module': u'ns_node_disco', u'type': u'info', u'node': u'ns_1@172.23.137.254', u'tstamp': 1703340911442L, u'shortText': u'node up', u'serverTime': u'2023-12-23T06:15:11.442Z', u'text': u"Node 'ns_1@172.23.137.254' saw that node 'ns_1@172.23.137.253' came up. Tags: []"} 2023-12-23 06:15:39,721 | test | ERROR | pool-5-thread-18 | [task:call:332] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'type': u'rebalance', u'masterRequestTimedOut': False, u'statusId': u'89d613a6804535ee899a6f645d85a920', u'subtype': u'rebalance', u'statusIsStale': False, u'lastReportURI': u'/logs/rebalanceReport?reportID=7996efb7f3f9e73e608db6c5ea331223', u'status': u'notRunning'} - rebalance failed FAIL 2023-12-23 06:15:40,802 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 3000 | 600.00 MiB | 184.82 MiB | 237.69 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 3000 | 600.00 MiB | 166.98 MiB | 380.70 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 380000 | 4.39 GiB | 367.64 MiB | 360.34 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2023-12-23 06:15:42,924 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket2, Active Resident ratio(DGM): 100% 2023-12-23 06:15:42,924 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2023-12-23 06:15:57,119 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket1, Active Resident ratio(DGM): 100% 2023-12-23 06:15:57,121 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2023-12-23 06:17:39,384 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: default, Active Resident ratio(DGM): 100% 2023-12-23 06:17:39,384 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: default, Replica Resident ratio(DGM): 100% 2023-12-23 06:18:14,799 | test | WARNING | MainThread | [rest_client:get_nodes:1804] 172.23.137.253 - Node not part of cluster inactiveAdded 2023-12-23 06:18:14,801 | test | WARNING | MainThread | [rest_client:get_nodes:1804] 172.23.137.254 - Node not part of cluster inactiveAdded 2023-12-23 06:18:14,801 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1211] Running cbcollect on node ns_1@172.23.137.252,ns_1@172.23.137.253,ns_1@172.23.137.254,ns_1@172.23.137.255,ns_1@172.23.138.1 2023-12-23 06:18:24,844 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1214] ns_1@172.23.137.252,ns_1@172.23.137.253,ns_1@172.23.137.254,ns_1@172.23.137.255,ns_1@172.23.138.1 - cbcollect status: True 2023-12-23 06:18:24,845 | test | INFO | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1219] Polling active_tasks to check cbcollect status 2023-12-23 06:25:17,236 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1253] ns_1@172.23.137.252: Copying cbcollect ZIP file to Client 2023-12-23 06:25:19,595 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1253] ns_1@172.23.137.253: Copying cbcollect ZIP file to Client 2023-12-23 06:25:20,436 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1253] ns_1@172.23.137.254: Copying cbcollect ZIP file to Client 2023-12-23 06:25:21,371 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1253] ns_1@172.23.137.255: Copying cbcollect ZIP file to Client 2023-12-23 06:25:24,062 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1253] ns_1@172.23.138.1: Copying cbcollect ZIP file to Client 2023-12-23 06:25:28,358 | test | CRITICAL | MainThread | [basetestcase:tearDownEverything:632] Skipping get_trace !! ====================================================================== FAIL: test_data_load_collections_with_rebalance_in (bucket_collections.collections_rebalance.CollectionsRebalance) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/bucket_collections/collections_rebalance.py", line 1179, in test_data_load_collections_with_rebalance_in self.load_collections_with_rebalance(rebalance_operation="rebalance_in") File "pytests/bucket_collections/collections_rebalance.py", line 1142, in load_collections_with_rebalance self.wait_for_rebalance_to_complete(rebalance) File "pytests/bucket_collections/collections_rebalance.py", line 899, in wait_for_rebalance_to_complete self.assertTrue(task.result, "Rebalance Failed") AssertionError: Rebalance Failed ---------------------------------------------------------------------- Ran 1 test in 3127.855s FAILED (failures=1) During the test, Remote Connections: 113, Disconnections: 113 SDK Connections: 31, Disconnections: 31 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 0 , fail 1 failures so far... bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in testrunner logs, diags and results are available under /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_1 Logs will be stored at /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_2 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,override_spec_params=durability;replicas,durability=PERSIST_TO_MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY' Test Input params: {'data_load_stage': 'during', 'cluster_name': 'testexec.14086', 'quota_percent': '80', 'ini': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini', 'get-cbcollect-info': 'True', 'replicas': '2', 'durability': 'PERSIST_TO_MAJORITY', 'conf_file': 'conf/collections/collections_rebalance_crud_on_collections.conf', 'upgrade_version': '7.2.4-7065', 'skip_validations': 'False', 'spec': 'collections_rebalance_crud_on_collections', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_2', 'nodes_init': '5', 'GROUP': 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY', 'nodes_out': '2', 'sirius_url': 'http://172.23.120.103:4000', 'bucket_spec': 'multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections', 'case_number': 2, 'data_load_spec': 'volume_test_load_with_CRUD_on_collections', 'override_spec_params': 'durability;replicas'} test_data_load_collections_with_rebalance_out (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2023-12-23 06:25:33,915 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionsRebalance setup started for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:25:34,065 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup started for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:26:05,772 | test | INFO | MainThread | [rest_client:monitorRebalance:1506] Rebalance done. Taken 24.3309998512 seconds to complete 2023-12-23 06:26:05,779 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2023-12-23 06:26:14,645 | test | INFO | MainThread | [basetestcase:initialize_cluster:487] Initializing cluster : C1 2023-12-23 06:26:31,461 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:31,671 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:31,680 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:31,907 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:33,470 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:33,678 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:33,686 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:33,915 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:33,918 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:34,380 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:35,476 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:35,686 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:35,694 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:35,924 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:35,926 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:36,388 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:37,486 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:37,703 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:37,709 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:37,930 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:37,950 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:38,394 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:39,494 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:39,716 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:39,717 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:39,940 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:39,960 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:40,434 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:41,505 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:41,727 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:41,737 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:41,950 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:41,973 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:42,440 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:43,513 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:43,733 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:43,744 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:43,960 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:43,993 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:44,447 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:45,532 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:45,742 | test | ERROR | pool-7-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:45,759 | test | ERROR | pool-7-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:45,973 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:46,000 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:46,457 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:47,539 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:47,979 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:48,006 | test | ERROR | pool-7-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:48,467 | test | ERROR | pool-7-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:49,546 | test | ERROR | pool-7-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:26:49,999 | test | ERROR | pool-7-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:27:14,454 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.1:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:14,457 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:14,520 | infra | CRITICAL | pool-7-thread-25 | [task:call:6274] mcdMemoryReserved reported in nodes/self is: 4908 2023-12-23 06:27:14,522 | test | CRITICAL | pool-7-thread-25 | [table_view:display:72] Memory quota allocated: +---------------------+---------+ | Service | RAM MiB | +---------------------+---------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+---------+ 2023-12-23 06:27:14,700 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.255:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:14,703 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:14,891 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.252:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:14,892 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:15,082 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.254:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:15,085 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:15,279 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.253:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:15,282 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:15,604 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.0:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:27:15,605 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:27:15,605 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:738] RAM quota was defined less than 100 MB: 2023-12-23 06:27:27,243 | test | INFO | MainThread | [basetestcase:initialize_cluster:513] Cluster C1 initialized 2023-12-23 06:27:27,298 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup finished for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:27:27,346 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup started for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:27:53,108 | test | INFO | pool-7-thread-26 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+-------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+----------+-----------------------+-------+--------------+-----------------------+ | 172.23.138.1 | kv | 7.2.4-7065-enterprise | 14.27 | Cluster node | active / none | | 172.23.137.255 | None | | | <--- IN --- | | | 172.23.137.252 | None | | | <--- IN --- | | | 172.23.137.254 | None | | | <--- IN --- | | | 172.23.137.253 | None | | | <--- IN --- | | +----------------+----------+-----------------------+-------+--------------+-----------------------+ 2023-12-23 06:27:53,140 | test | INFO | pool-7-thread-26 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:28:08,213 | test | INFO | pool-7-thread-26 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 06:28:08,230 | test | INFO | pool-7-thread-26 | [task:check:480] Rebalance completed with progress: 100% in 15.1239998341 sec 2023-12-23 06:28:08,414 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 3.34299903343 | 5.99 GiB | 4.14 GiB | 2.00 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 10.1746659326 | 5.99 GiB | 4.29 GiB | 1.88 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 0.572869693021 | 5.99 GiB | 4.21 GiB | 1.91 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 8.91924802749 | 5.99 GiB | 4.25 GiB | 1.91 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.253 | kv | 0.664734106357 | 5.99 GiB | 4.31 GiB | 1.87 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:28:08,414 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup complete for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:28:08,415 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup started for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:28:08,635 | test | INFO | MainThread | [collections_base:deploy_buckets_from_spec_file:470] Creating bucket from spec: multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections 2023-12-23 06:28:08,637 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1980] Creating required buckets from template 2023-12-23 06:28:55,003 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2742] Waiting for all collections to be created 2023-12-23 06:28:55,130 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 28.7428742874 | 5.99 GiB | 4.00 GiB | 2.21 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 48.2928211797 | 5.99 GiB | 4.15 GiB | 2.07 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 69.9127469662 | 5.99 GiB | 4.06 GiB | 2.11 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 43.3219977329 | 5.99 GiB | 4.10 GiB | 2.12 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.253 | kv | 57.6668330837 | 5.99 GiB | 4.17 GiB | 2.04 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:28:55,703 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+-------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+-------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 0 | 1000.00 MiB | 9.92 MiB | 112.36 KiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 0 | 1000.00 MiB | 194.99 MiB | 145.38 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 0 | 7.32 GiB | 49.68 MiB | 22.68 KiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+-------------+------------+------------+-----+ 2023-12-23 06:28:55,704 | test | INFO | MainThread | [collections_base:create_clients_for_sdk_pool:491] Creating required SDK clients for client_pool 2023-12-23 06:34:12,507 | test | INFO | MainThread | [collections_base:load_data_from_spec_file:501] Loading data using spec: initial_load 2023-12-23 06:34:12,509 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 06:34:12,516 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 06:44:53,983 | test | INFO | pool-7-thread-1 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ***.....*......*..............*..******...............**...................*.....................................***X | 99.600 | | 98.700 | ................................................................................................*X | 98.700 | | 96.200 | .............................................................................................*.....*.****X | 101.500 | | 62.700 | ............................................................X | 62.700 | | 33.800 | ................................X | 33.800 | | 7.400 | ......X | 7.400 | | 0.400 | **X | 0.400 | | 0.100 | *X | 0.100 | | 0.000 | **********************************************************************************************************************************************************************************************************************************************************************************************************................................*..................*...................*****X | 70.500 | | 56.400 | ......................................................*X | 56.400 | | 42.300 | ........................................X | 42.300 | | 0.000 | *******************************************************************************************************************************X | 0.000 | +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 06:44:54,686 | test | INFO | pool-7-thread-2 | [table_view:display:72] Ops trend for bucket 'default' +---------+------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +---------+------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | ***....*.......*...............*.........*****......***......*.......***X | 576.200 | | 549.900 | ...................................................X | 549.900 | | 400.300 | ....................................X | 400.300 | | 341.400 | ...............................X | 341.400 | | 315.500 | ............................****X | 315.500 | | 312.000 | ............................*.*...*.**X | 364.600 | | 354.700 | ................................*X | 354.700 | | 284.000 | .........................**....*...**X | 352.000 | | 197.100 | .................**..*.......**.........**X | 383.500 | | 316.900 | ............................***X | 316.900 | | 245.800 | ......................*..............****X | 398.800 | | 391.500 | ....................................X | 391.500 | | 371.200 | ..................................X | 371.200 | | 351.600 | ................................****X | 351.600 | | 336.900 | ..............................X | 336.900 | | 292.400 | ..........................*..X | 313.800 | | 265.500 | ........................*.......*X | 345.300 | | 236.100 | .....................*.**........*.......*X | 402.100 | | 284.000 | .........................**.X | 293.400 | | 204.650 | ..................*.............******.........X | 439.900 | | 389.300 | ...................................********...............*..................****X | 737.900 | | 566.400 | ....................................................X | 566.400 | | 492.800 | .............................................***X | 492.800 | | 467.800 | ...........................................X | 467.800 | | 422.500 | ......................................***........*......****......**...........*X | 740.000 | | 724.200 | ...................................................................*X | 724.200 | | 720.600 | ...................................................................*X | 720.600 | | 602.200 | .......................................................X | 602.200 | | 476.900 | ............................................******X | 476.900 | | 474.400 | ...........................................**........................***X | 722.300 | | 670.600 | ..............................................................X | 670.600 | | 553.900 | ...................................................X | 553.900 | | 392.000 | ....................................*****X | 392.000 | | 381.200 | ...................................X | 381.200 | | 355.100 | ................................*.............******X | 488.400 | | 442.700 | ........................................*.............**.....**X | 627.600 | | 400.100 | ....................................X | 400.100 | | 352.000 | ................................X | 352.000 | | 342.400 | ...............................*****.................***...........*......**X | 700.200 | | 688.100 | ................................................................X | 688.100 | | 626.700 | ..........................................................X | 626.700 | | 517.000 | ...............................................*****X | 517.000 | | 456.100 | ..........................................**..................****X | 647.700 | | 585.100 | ......................................................*X | 585.100 | | 450.700 | .........................................*.........****X | 546.500 | | 544.400 | ..................................................*.....X | 593.800 | | 543.800 | ..................................................***X | 543.800 | | 493.900 | .............................................**....*....*.....................****X | 799.400 | | 359.800 | .................................X | 359.800 | | 342.800 | ...............................*****....*.....********........*..................*......****X | 778.500 | | 778.200 | ........................................................................X | 778.200 | | 728.800 | ...................................................................*.......*******.....*.....*.*X | 916.200 | | 715.300 | ..................................................................X | 715.300 | | 362.300 | .................................X | 362.300 | | 12.600 | ********.................................*...........................................................*******X | 992.500 | | 904.500 | ....................................................................................X | 904.500 | | 776.500 | ........................................................................****X | 776.500 | | 759.100 | ......................................................................*..**...***X | 813.900 | | 645.900 | ............................................................X | 645.900 | | 355.900 | ................................*****.....****.......................................*****...****..*X | 875.900 | | 706.300 | .................................................................X | 706.300 | | 688.300 | ................................................................X | 688.300 | | 597.700 | .......................................................X | 597.700 | | 526.700 | ................................................X | 526.700 | | 453.800 | .........................................**X | 453.800 | | 422.800 | ......................................*X | 422.800 | | 376.900 | ..................................*...............******........**..........................................***X | 1057.100 | | 926.300 | ......................................................................................**X | 926.300 | | 632.400 | ..........................................................X | 632.400 | | 556.000 | ...................................................**X | 556.000 | | 528.100 | ................................................X | 528.100 | | 374.400 | ..................................X | 374.400 | | 308.200 | ............................******.....**..............*......................................****X | 910.800 | | 871.900 | .................................................................................*X | 871.900 | | 857.200 | ................................................................................**X | 859.000 | | 377.600 | ..................................X | 377.600 | | 285.650 | ..........................*****.......****.......................................................*****X | 944.900 | | 916.200 | .....................................................................................**..X | 931.000 | | 917.500 | .....................................................................................****X | 919.400 | | 790.600 | .........................................................................X | 790.600 | | 774.500 | ........................................................................***X | 774.500 | | 709.600 | ..................................................................*X | 709.600 | | 518.100 | ................................................X | 518.100 | | 503.400 | ..............................................*****...**........*.......................*X | 866.500 | | 796.600 | ..........................................................................X | 796.600 | | 537.100 | .................................................**X | 537.100 | | 499.800 | ..............................................****...........X | 616.500 | | 597.900 | .......................................................*..******X | 618.800 | | 580.000 | .....................................................X | 580.000 | | 578.600 | .....................................................*.......................****.**..*....**X | 892.600 | | 835.100 | .............................................................................X | 835.100 | | 291.881 | ..........................******.***........*.........................................****.....***.*....*X | 925.600 | | 849.800 | ...............................................................................X | 849.800 | | 267.200 | ........................********......*......................................................****X | 906.500 | | 901.200 | ....................................................................................X | 901.200 | | 888.300 | ...................................................................................**......*X | 953.900 | | 874.000 | .................................................................................X | 874.000 | | 120.100 | ..........****X | 120.100 | +---------+------------------------------------------------------------------------------------------------------------------+----------+ 2023-12-23 06:44:55,148 | test | INFO | pool-7-thread-3 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | ***.............*..........*...........*****X | 33.000 | | 26.400 | ..........................**X | 26.400 | | 17.600 | .................X | 17.600 | | 0.000 | ****************************************************************************************.................*.........****X | 25.500 | | 15.300 | ...............X | 15.300 | | 8.500 | .......*X | 8.500 | | 1.700 | X | 1.700 | | 0.000 | **********************************.....*.....*........*******......*........**....**X | 34.200 | | 29.500 | ..............................X | 29.500 | | 27.900 | ............................X | 27.900 | | 27.400 | ...........................****X | 27.400 | | 16.200 | ................**X | 16.200 | | 7.200 | ......X | 7.200 | | 0.000 | ***************************.****X | 1.500 | | 1.100 | *X | 1.100 | | 0.800 | X | 0.800 | | 0.500 | X | 0.500 | | 0.000 | ***********************************************************************************************************************************************************************************************************...........**..........................*....................****...........**...............*.................**X | 94.500 | | 73.400 | ............................................................................X | 73.400 | | 12.857 | ............********X | 12.857 | | 0.000 | ************************************X | 0.000 | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 06:45:01,278 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 60.8919953403 | 5.99 GiB | 3.78 GiB | 2.46 GiB / 6.99 GiB | 76580 / 154287 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 77.1433813718 | 5.99 GiB | 3.88 GiB | 2.32 GiB / 6.99 GiB | 75716 / 152218 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 88.0680870928 | 5.99 GiB | 3.84 GiB | 2.37 GiB / 6.99 GiB | 78400 / 153800 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 87.9687968797 | 5.99 GiB | 3.87 GiB | 2.33 GiB / 6.99 GiB | 76572 / 151890 | 7.2.4-7065-enterprise | | 172.23.137.253 | kv | 77.2848521223 | 5.99 GiB | 3.92 GiB | 2.28 GiB / 6.99 GiB | 76800 / 155400 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:45:06,821 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4976] Validating collection stats and item counts 2023-12-23 06:46:12,696 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 3.255 | 5.99 GiB | 3.76 GiB | 2.46 GiB / 6.99 GiB | 77200 / 155800 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 3.29395274329 | 5.99 GiB | 3.88 GiB | 2.32 GiB / 6.99 GiB | 76400 / 153600 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 4.04783348344 | 5.99 GiB | 3.82 GiB | 2.40 GiB / 6.99 GiB | 78400 / 153800 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 3.1129118314 | 5.99 GiB | 3.88 GiB | 2.33 GiB / 6.99 GiB | 77200 / 153400 | 7.2.4-7065-enterprise | | 172.23.137.253 | kv | 4.18376538885 | 5.99 GiB | 3.91 GiB | 2.28 GiB / 6.99 GiB | 76800 / 155400 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:46:13,628 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 3000 | 1000.00 MiB | 249.06 MiB | 165.89 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 3000 | 1000.00 MiB | 158.28 MiB | 321.16 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 380000 | 7.32 GiB | 371.25 MiB | 307.57 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ 2023-12-23 06:46:13,628 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup complete for test #2 test_data_load_collections_with_rebalance_out ========= 2023-12-23 06:46:22,548 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1069] Doing collection data load during rebalance_out 2023-12-23 06:46:22,548 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:375] Starting rebalance operation of type : rebalance_out 2023-12-23 06:46:22,688 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 06:46:22,779 | test | INFO | pool-7-thread-19 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | 172.23.138.1 | kv | 7.2.4-7065-enterprise | 4.0270693736 | Cluster node | active / none | | 172.23.137.254 | kv | 7.2.4-7065-enterprise | 4.86777244871 | --- OUT ---> | active / none | | 172.23.137.252 | kv | 7.2.4-7065-enterprise | 5.77384523096 | Cluster node | active / none | | 172.23.137.255 | kv | 7.2.4-7065-enterprise | 5.92263094762 | Cluster node | active / none | | 172.23.137.253 | kv | 7.2.4-7065-enterprise | 4.74548604171 | --- OUT ---> | active / none | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ 2023-12-23 06:46:22,869 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:46:28,798 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 06:46:36,772 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:46:46,842 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 0.1 2023-12-23 06:46:56,999 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 0.14 2023-12-23 06:47:07,121 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 3.67 2023-12-23 06:47:17,216 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 6.25 2023-12-23 06:47:27,329 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 9.38 2023-12-23 06:47:37,437 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 13.28 2023-12-23 06:47:47,549 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 17.55 2023-12-23 06:47:57,615 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 20.45 2023-12-23 06:48:07,688 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 26.31 2023-12-23 06:48:17,763 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 26.41 2023-12-23 06:48:27,874 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 27.26 2023-12-23 06:48:37,959 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 28.72 2023-12-23 06:48:48,065 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 29.03 2023-12-23 06:48:58,184 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 30.4 2023-12-23 06:49:08,266 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 30.61 2023-12-23 06:49:18,345 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 31.06 2023-12-23 06:49:28,400 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 31.25 2023-12-23 06:49:38,463 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 32.21 2023-12-23 06:49:44,562 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 15 to 17 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope2_collection-896_create_ttl=0_create_PERSIST_TO_MAJORITY_15_17_2203 2023-12-23 06:49:48,509 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 32.28 2023-12-23 06:49:58,549 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 33.03 2023-12-23 06:50:08,594 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 33.33 2023-12-23 06:50:18,650 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 33.63 2023-12-23 06:50:28,697 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 33.93 2023-12-23 06:50:36,055 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 12 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-26_collection-1203_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_2535 2023-12-23 06:50:36,056 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 9 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-17_collection-1210_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_2617 2023-12-23 06:50:36,059 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 8 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-24_collection-1199_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_2747 2023-12-23 06:50:38,737 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 34.07 2023-12-23 06:50:48,826 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 34.97 2023-12-23 06:50:58,875 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 36.34 2023-12-23 06:51:08,926 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 37.95 2023-12-23 06:51:18,971 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 38.61 2023-12-23 06:51:29,012 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 40.79 2023-12-23 06:51:39,092 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 40.92 2023-12-23 06:51:49,138 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 42.0 2023-12-23 06:51:59,184 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 46.08 2023-12-23 06:52:09,240 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 47.25 2023-12-23 06:52:10,095 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-26_collection-1202_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_3125 2023-12-23 06:52:10,096 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-25_collection-1201_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_3127 2023-12-23 06:52:11,727 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket1_scope-25_collection-1200_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_3129 2023-12-23 06:52:19,305 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 49.52 2023-12-23 06:52:29,352 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 50.99 2023-12-23 06:52:39,437 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 52.05 2023-12-23 06:52:49,484 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 53.9 2023-12-23 06:52:59,533 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 55.15 2023-12-23 06:53:09,575 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 57.63 2023-12-23 06:53:19,621 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 60.18 2023-12-23 06:53:29,663 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 60.9 2023-12-23 06:53:33,451 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 7 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-22_collection-1211_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4901 2023-12-23 06:53:33,453 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 8 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-22_collection-1195_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4903 2023-12-23 06:53:33,453 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-22_collection-1194_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4905 2023-12-23 06:53:33,453 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-21_collection-1193_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4907 2023-12-23 06:53:33,453 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-21_collection-1192_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4909 2023-12-23 06:53:34,338 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-23_collection-1197_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4911 2023-12-23 06:53:34,338 | test | ERROR | pool-7-thread-11 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 7 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_1641_bucket2_scope-23_collection-1196_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_4913 2023-12-23 06:53:35,578 | test | INFO | pool-7-thread-6 | [table_view:display:72] Ops trend for bucket 'bucket2' +---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | *****************************.***.*.**X | 16.400 | | 5.000 | X | 5.000 | | 0.000 | ********X | 0.903 | | 0.000 | **************************************************************************************************************************************************************X | 1.400 | | 1.200 | ***X | 1.200 | | 0.900 | *X | 0.900 | | 0.300 | *X | 0.300 | | 0.000 | *******************************************...***..................**.*......*X | 139.100 | | 93.700 | ..................********.........*****.***.................*****.....***......**....*X | 297.454 | | 280.654 | ........................................................**........................................*...***X | 484.933 | | 479.933 | .................................................................................................**X | 479.933 | | 405.633 | ..................................................................................X | 405.633 | | 354.300 | ........................................................................**X | 354.300 | +---------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 06:53:35,637 | test | INFO | pool-7-thread-10 | [table_view:display:72] Ops trend for bucket 'default' +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *******.........**.........**X | 288.202 | | 288.202 | .................**X | 288.202 | | 286.002 | .................*..........**......******......*...................*.......**X | 1016.833 | | 615.700 | .......................................**X | 615.700 | | 595.000 | .....................................*.**X | 596.500 | | 191.800 | ...........*............*.....................******..*................................*.................*....***X | 1526.775 | | 1463.475 | ..............................................................................................*X | 1463.475 | | 1403.475 | ..........................................................................................X | 1403.475 | | 1388.175 | .........................................................................................*X | 1388.175 | | 902.675 | ..........................................................X | 902.675 | | 790.875 | ..................................................X | 790.875 | | 595.575 | ......................................********.............*..................******X | 1077.275 | | 1005.775 | ................................................................**X | 1006.975 | | 668.175 | ..........................................**X | 668.175 | | 573.775 | ....................................********...................*****...X | 904.248 | | 891.348 | .........................................................X | 891.348 | | 872.148 | ........................................................*X | 872.148 | | 604.148 | ......................................X | 604.148 | | 545.375 | ..................................*********.......................***................****X | 1140.475 | | 1115.375 | ........................................................................X | 1115.375 | | 912.775 | ..........................................................******X | 912.775 | | 903.975 | ..........................................................***X | 903.975 | | 893.175 | .........................................................X | 893.175 | | 816.875 | ....................................................*X | 816.875 | | 778.375 | .................................................***X | 778.375 | | 671.875 | ...........................................*X | 671.875 | | 659.575 | ..........................................***...*X | 704.175 | | 641.475 | .........................................**********......*X | 744.075 | | 649.540 | .........................................*****.....**X | 722.340 | | 722.340 | ..............................................****X | 722.340 | | 701.940 | ............................................X | 701.940 | | 701.940 | ............................................***X | 701.940 | | 701.940 | ............................................***.........**........***X | 951.704 | | 850.131 | ......................................................X | 850.131 | | 823.931 | ....................................................*****X | 823.931 | | 809.931 | ....................................................***.....******.X | 915.375 | | 893.675 | .........................................................******.X | 904.075 | | 875.475 | ........................................................X | 875.475 | | 875.475 | ........................................................X | 875.475 | | 875.475 | ........................................................**X | 875.475 | | 821.375 | ....................................................X | 821.375 | | 820.775 | ....................................................**..******......***....***X | 995.775 | | 961.175 | .............................................................*X | 961.175 | | 835.375 | .....................................................****X | 835.375 | | 759.575 | ................................................X | 759.575 | | 626.675 | ........................................******.....***.........*X | 844.675 | | 844.675 | ......................................................***..........*............****X | 1185.775 | | 954.075 | .............................................................X | 954.075 | | 775.675 | .................................................**X | 775.675 | | 619.875 | .......................................**X | 619.875 | | 553.775 | ...................................**X | 563.175 | | 525.175 | .................................****X | 525.175 | | 501.875 | ...............................*******************X | 501.875 | | 487.415 | ..............................***X | 487.415 | | 393.875 | ........................******X | 393.875 | | 0.000 | ****X | 0.000 | +----------+--------------------------------------------------------------------------------------------------------------------+----------+ 2023-12-23 06:53:36,454 | test | INFO | pool-7-thread-14 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+-----------------------------------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+-----------------------------------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | **********************************************************...*..********.................................................*......******X | 56.850 | | 49.750 | ...................................................*..**......**X | 57.550 | | 18.050 | ..................*******X | 18.050 | | 15.850 | ...............*****.............................X | 43.186 | | 41.786 | ...........................................X | 41.786 | | 40.486 | .........................................*X | 40.486 | | 36.886 | ......................................X | 36.886 | | 11.500 | ...........*********...***........................................***X | 52.150 | | 50.950 | .....................................................*X | 50.950 | | 48.050 | .................................................*****X | 48.050 | | 47.150 | ................................................X | 47.150 | | 45.950 | ...............................................***X | 45.950 | | 31.300 | ................................*X | 31.300 | | 31.200 | ................................******.***.................................................................**X | 94.350 | | 93.550 | ..................................................................................................********X | 93.550 | | 91.150 | ...............................................................................................*X | 91.150 | | 65.689 | ....................................................................************************....**X | 69.343 | | 2.839 | ..**********..........................................................******X | 57.850 | | 26.150 | ..........................*******.................********..**********......****X | 49.550 | | 44.750 | ..............................................******X | 44.750 | | 26.850 | ...........................*********.......................******X | 48.850 | | 37.550 | ......................................********X | 37.550 | | 31.650 | ................................*****X | 31.650 | | 14.250 | ..............********...............******X | 28.950 | | 23.650 | ........................********X | 23.650 | | 15.450 | ...............**......................................***X | 51.630 | | 13.500 | .............X | 13.500 | | 0.000 | ***********X | 0.000 | +--------+-----------------------------------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 06:53:39,700 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 66.67 2023-12-23 06:53:49,742 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 66.67 2023-12-23 06:53:59,796 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 82.61 2023-12-23 06:54:09,836 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 95.75 2023-12-23 06:54:19,875 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: running, progress: 100.0 2023-12-23 06:54:34,930 | test | INFO | pool-7-thread-19 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 06:54:35,028 | test | INFO | pool-7-thread-19 | [task:check:480] Rebalance completed with progress: 100% in 492.248000145 sec 2023-12-23 06:54:35,339 | test | INFO | MainThread | [collections_rebalance:get_zone_info:1035] nodes in zone inside get_zone_info():{'Group 1': ['172.23.137.252', '172.23.137.255', '172.23.138.1']} 2023-12-23 06:54:39,380 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4976] Validating collection stats and item counts 2023-12-23 06:55:09,453 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 37618 | 600.00 MiB | 177.33 MiB | 256.97 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 36960 | 600.00 MiB | 186.31 MiB | 298.63 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 296304 | 4.39 GiB | 411.90 MiB | 295.49 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2023-12-23 06:55:09,908 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket2, Active Resident ratio(DGM): 100% 2023-12-23 06:55:09,908 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2023-12-23 06:55:21,391 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket1, Active Resident ratio(DGM): 100% 2023-12-23 06:55:21,391 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2023-12-23 06:55:49,760 | infra | ERROR | MainThread | [Rest_Connection:_http_request:318] DELETE http://172.23.138.1:8091/pools/default/buckets/bucket1/scopes/_default/collections/_default body: headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password 2023-12-23 06:55:49,765 | test | ERROR | MainThread | [bucket_ready_functions:drop_collection:1021] Collection 'bucket1:_default:_default' delete failed: ["Unexpected server error, request logged."] ERROR ====================================================================== ERROR: test_data_load_collections_with_rebalance_out (bucket_collections.collections_rebalance.CollectionsRebalance) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/bucket_collections/collections_rebalance.py", line 98, in tearDown super(CollectionsRebalance, self).tearDown() File "pytests/bucket_collections/collections_base.py", line 100, in tearDown self.bucket_util.remove_scope_collections_for_bucket( File "couchbase_utils/bucket_utils/bucket_ready_functions.py", line 5007, in remove_scope_collections_for_bucket self.drop_collection(cluster.master, File "couchbase_utils/bucket_utils/bucket_ready_functions.py", line 1024, in drop_collection raise Exception("delete_collection") Exception: delete_collection ---------------------------------------------------------------------- Ran 1 test in 1821.261s FAILED (errors=1) During the test, Remote Connections: 194, Disconnections: 193 SDK Connections: 30, Disconnections: 0 !!!!!! CRITICAL :: Shell disconnection mismatch !!!!! !!!!!! CRITICAL :: SDK disconnection mismatch !!!!! summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 0 , fail 2 failures so far... bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out testrunner logs, diags and results are available under /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_2 Logs will be stored at /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_3 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=4,nodes_swap=2,override_spec_params=durability;replicas,durability=PERSIST_TO_MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY' Test Input params: {'data_load_stage': 'during', 'cluster_name': 'testexec.14086', 'quota_percent': '80', 'ini': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini', 'get-cbcollect-info': 'True', 'replicas': '2', 'durability': 'PERSIST_TO_MAJORITY', 'conf_file': 'conf/collections/collections_rebalance_crud_on_collections.conf', 'upgrade_version': '7.2.4-7065', 'skip_validations': 'False', 'spec': 'collections_rebalance_crud_on_collections', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_3', 'nodes_init': '4', 'GROUP': 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY', 'nodes_swap': '2', 'sirius_url': 'http://172.23.120.103:4000', 'bucket_spec': 'multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections', 'case_number': 3, 'data_load_spec': 'volume_test_load_with_CRUD_on_collections', 'override_spec_params': 'durability;replicas'} test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2023-12-23 06:55:55,628 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionsRebalance setup started for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:55:55,757 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup started for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:56:22,094 | test | INFO | MainThread | [rest_client:monitorRebalance:1506] Rebalance done. Taken 11.2770001888 seconds to complete 2023-12-23 06:56:22,105 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2023-12-23 06:56:27,236 | test | INFO | MainThread | [basetestcase:initialize_cluster:487] Initializing cluster : C1 2023-12-23 06:56:43,907 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:43,974 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:44,246 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:44,322 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:44,385 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:44,417 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:45,914 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:45,982 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:46,255 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:46,328 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:46,391 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:46,423 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:47,921 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:47,986 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:48,260 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:48,335 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:48,398 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:48,428 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:49,927 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:49,992 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:50,266 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:50,339 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:50,404 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:50,434 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:51,933 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:51,999 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:52,272 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:52,345 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:52,408 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:52,440 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:53,940 | test | ERROR | pool-8-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:54,003 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:54,279 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:54,351 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:54,414 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:54,446 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:56,009 | test | ERROR | pool-8-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:56,285 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:56,358 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:56,420 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:56,450 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:58,292 | test | ERROR | pool-8-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:58,368 | test | ERROR | pool-8-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:58,426 | test | ERROR | pool-8-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:56:58,457 | test | ERROR | pool-8-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 06:57:05,170 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.1:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:05,173 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:05,211 | infra | CRITICAL | pool-8-thread-25 | [task:call:6274] mcdMemoryReserved reported in nodes/self is: 4908 2023-12-23 06:57:05,213 | test | CRITICAL | pool-8-thread-25 | [table_view:display:72] Memory quota allocated: +---------------------+---------+ | Service | RAM MiB | +---------------------+---------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+---------+ 2023-12-23 06:57:05,365 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.255:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:05,368 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:05,555 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.252:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:05,559 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:05,762 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.254:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:05,765 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:06,066 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.253:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:06,069 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:06,232 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.0:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 06:57:06,233 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 06:57:06,234 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:738] RAM quota was defined less than 100 MB: 2023-12-23 06:57:17,823 | test | INFO | MainThread | [basetestcase:initialize_cluster:513] Cluster C1 initialized 2023-12-23 06:57:17,852 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup finished for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:57:17,878 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup started for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:57:39,233 | test | INFO | pool-8-thread-26 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | 172.23.138.1 | kv | 7.2.4-7065-enterprise | 16.0836248542 | Cluster node | active / none | | 172.23.137.255 | None | | | <--- IN --- | | | 172.23.137.252 | None | | | <--- IN --- | | | 172.23.137.254 | None | | | <--- IN --- | | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ 2023-12-23 06:57:39,259 | test | INFO | pool-8-thread-26 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 06:57:54,375 | test | INFO | pool-8-thread-26 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 06:57:54,392 | test | INFO | pool-8-thread-26 | [task:check:480] Rebalance completed with progress: 100% in 15.1609997749 sec 2023-12-23 06:57:54,559 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 14.0434102334 | 5.99 GiB | 4.12 GiB | 2.01 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 0.353368670202 | 5.99 GiB | 4.29 GiB | 1.88 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 0 | 5.99 GiB | 4.20 GiB | 1.94 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 31.2616713352 | 5.99 GiB | 4.22 GiB | 1.93 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:57:54,559 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup complete for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:57:54,559 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup started for test #3 test_data_load_collections_with_swap_rebalance ========= 2023-12-23 06:57:54,773 | test | INFO | MainThread | [collections_base:deploy_buckets_from_spec_file:470] Creating bucket from spec: multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections 2023-12-23 06:57:54,773 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1980] Creating required buckets from template 2023-12-23 06:58:09,846 | infra | ERROR | Thread-5375 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/bucket2/scopes/_default/collections/ body: name=collection-1242 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5375:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for bucket2:_default:collection-1242, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:58:09,911 | infra | ERROR | Thread-5376 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/bucket1/scopes/_default/collections/ body: name=collection-1440 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5376:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for bucket1:_default:collection-1440, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:58:10,046 | infra | ERROR | Thread-5377 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/default/scopes/_default/collections/ body: name=collection-1606 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5377:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for default:_default:collection-1606, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:58:16,681 | infra | ERROR | Thread-5385 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/default/scopes/scope-34/collections/ body: name=collection-1734 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5385:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for default:scope-34:collection-1734, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:58:16,713 | infra | ERROR | Thread-5386 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/bucket2/scopes/scope-30/collections/ body: name=collection-1359 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5386:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for bucket2:scope-30:collection-1359, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:58:16,782 | infra | ERROR | Thread-5387 | [Rest_Connection:_http_request:318] POST http://172.23.138.1:8091/pools/default/buckets/bucket1/scopes/scope-32/collections/ body: name=collection-1534 headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 500 reason: unknown ["Unexpected server error, request logged."] auth: Administrator:password Exception in thread Thread-5387:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "lib/Jython_tasks/task.py", line 3918, in create_collection_from_spec self.set_exception("Create collection failed for " File "lib/Jython_tasks/task.py", line 102, in set_exception raise BaseException(self.exception) BaseException: Create collection failed for bucket1:scope-32:collection-1534, Reason - ["Unexpected server error, request logged."] 2023-12-23 06:59:38,447 | test | ERROR | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1997] Failure in bucket creation task: Bucket_create_task_bucket2 2023-12-23 06:59:38,447 | test | ERROR | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1997] Failure in bucket creation task: Bucket_create_task_bucket1 2023-12-23 06:59:38,447 | test | ERROR | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1997] Failure in bucket creation task: Bucket_create_task_default 2023-12-23 06:59:38,532 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2742] Waiting for all collections to be created 2023-12-23 06:59:38,585 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 56.3441290151 | 5.99 GiB | 3.81 GiB | 2.39 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 37.8463539062 | 5.99 GiB | 4.04 GiB | 2.15 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 41.095 | 5.99 GiB | 3.98 GiB | 2.20 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 79.9296947888 | 5.99 GiB | 4.00 GiB | 2.20 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 06:59:39,477 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 0 | 800.00 MiB | 206.58 MiB | 179.62 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 0 | 800.00 MiB | 181.21 MiB | 253.10 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 0 | 5.86 GiB | 5.96 MiB | 69.66 KiB | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2023-12-23 06:59:39,479 | test | INFO | MainThread | [collections_base:create_clients_for_sdk_pool:491] Creating required SDK clients for client_pool Traceback (most recent call last): File "pytests/bucket_collections/collections_base.py", line 75, in setUp self.collection_setup() File "pytests/bucket_collections/collections_base.py", line 441, in collection_setup CollectionBase.create_clients_for_sdk_pool(self) File "pytests/bucket_collections/collections_base.py", line 492, in create_clients_for_sdk_pool CollectionBase.create_sdk_clients( File "pytests/bucket_collections/collections_base.py", line 126, in create_sdk_clients clients_per_bucket = int(ceil(max_clients / bucket_count)) ZeroDivisionError: integer division or modulo by zero ERROR ====================================================================== ERROR: test_data_load_collections_with_swap_rebalance (bucket_collections.collections_rebalance.CollectionsRebalance) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/bucket_collections/collections_rebalance.py", line 23, in setUp super(CollectionsRebalance, self).setUp() File "pytests/bucket_collections/collections_base.py", line 81, in setUp self.handle_setup_exception(exception) File "pytests/basetestcase.py", line 672, in handle_setup_exception raise exception_obj ZeroDivisionError: integer division or modulo by zero ---------------------------------------------------------------------- Ran 1 test in 229.690s During the test, Remote Connections: 43, Disconnections: 43 SDK Connections: 0, Disconnections: 0 FAILED (errors=1) summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 0 , fail 3 failures so far... bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance testrunner logs, diags and results are available under /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_3 Logs will be stored at /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_4 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=2,nodes_out=1,override_spec_params=durability;replicas,durability=PERSIST_TO_MAJORITY,replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_spec=volume_test_load_with_CRUD_on_collections,data_load_stage=during,quota_percent=80,skip_validations=False,GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY' Test Input params: {'data_load_stage': 'during', 'cluster_name': 'testexec.14086', 'quota_percent': '80', 'ini': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/testexec.14086.ini', 'get-cbcollect-info': 'True', 'replicas': '2', 'durability': 'PERSIST_TO_MAJORITY', 'conf_file': 'conf/collections/collections_rebalance_crud_on_collections.conf', 'upgrade_version': '7.2.4-7065', 'nodes_in': '2', 'skip_validations': 'False', 'spec': 'collections_rebalance_crud_on_collections', 'rerun': 'False', 'num_nodes': 6, 'logs_folder': '/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_4', 'nodes_init': '4', 'GROUP': 'rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY', 'nodes_out': '1', 'sirius_url': 'http://172.23.120.103:4000', 'bucket_spec': 'multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections', 'case_number': 4, 'data_load_spec': 'volume_test_load_with_CRUD_on_collections', 'override_spec_params': 'durability;replicas'} test_data_load_collections_with_rebalance_in_out (bucket_collections.collections_rebalance.CollectionsRebalance) ... 2023-12-23 06:59:45,243 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionsRebalance setup started for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 06:59:45,381 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup started for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:00:16,344 | test | INFO | MainThread | [rest_client:monitorRebalance:1506] Rebalance done. Taken 11.0930001736 seconds to complete 2023-12-23 07:00:16,355 | test | INFO | MainThread | [common_lib:sleep:23] Sleep 5 seconds. Reason: Wait after rebalance complete 2023-12-23 07:00:21,500 | test | INFO | MainThread | [basetestcase:initialize_cluster:487] Initializing cluster : C1 2023-12-23 07:00:38,072 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:38,552 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:38,601 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:38,625 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:38,769 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:39,187 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:40,079 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:40,559 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:40,607 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:40,630 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:40,773 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:41,194 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:42,085 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:42,566 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:42,611 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:42,634 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:42,779 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:43,198 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:44,092 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:44,572 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:44,618 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:44,640 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:44,786 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:45,204 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:46,101 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:46,578 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:46,622 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:46,644 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:46,790 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:47,210 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:48,108 | test | ERROR | pool-9-thread-24 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.0:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:48,584 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:48,628 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:48,650 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:48,798 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:49,219 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:50,588 | test | ERROR | pool-9-thread-19 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.138.1:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:50,632 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:50,654 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:50,803 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:51,224 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:52,638 | test | ERROR | pool-9-thread-23 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.253:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:52,661 | test | ERROR | pool-9-thread-20 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.255:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:52,809 | test | ERROR | pool-9-thread-22 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.254:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:00:53,230 | test | ERROR | pool-9-thread-21 | [rest_client:_http_request:678] Socket error while connecting to http://172.23.137.252:8091/nodes/self error [Errno 111] Connection refused 2023-12-23 07:01:00,733 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.1:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:00,740 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:00,898 | infra | CRITICAL | pool-9-thread-25 | [task:call:6274] mcdMemoryReserved reported in nodes/self is: 4908 2023-12-23 07:01:00,898 | test | CRITICAL | pool-9-thread-25 | [table_view:display:72] Memory quota allocated: +---------------------+---------+ | Service | RAM MiB | +---------------------+---------+ | eventingMemoryQuota | 256 | | cbasMemoryQuota | 1024 | | indexMemoryQuota | 256 | | ftsMemoryQuota | 256 | | memoryQuota | 3846 | +---------------------+---------+ 2023-12-23 07:01:01,098 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.255:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:01,111 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:01,539 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.252:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:01,540 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:01,951 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.254:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:01,953 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:02,247 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.137.253:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:02,250 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:02,499 | test | ERROR | MainThread | [rest_client:_http_request:674] POST http://172.23.138.0:8091/nodes/self/controller/settings body: path=%2Fdata&index_path=%2Fdata headers: {'Accept': '*/*', 'Connection': 'close', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Content-Type': 'application/x-www-form-urlencoded'} error: 400 reason: unknown ["An absolute path is required for path","An absolute path is required for index_path"] auth: Administrator:password 2023-12-23 07:01:02,512 | test | ERROR | MainThread | [rest_client:set_data_path:2205] Unable to set data_path path=%2Fdata&index_path=%2Fdata: ["An absolute path is required for path","An absolute path is required for index_path"] 2023-12-23 07:01:02,513 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:738] RAM quota was defined less than 100 MB: 2023-12-23 07:01:14,576 | test | INFO | MainThread | [basetestcase:initialize_cluster:513] Cluster C1 initialized 2023-12-23 07:01:14,653 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= BaseTestCase setup finished for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:01:14,766 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup started for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:01:35,790 | test | INFO | pool-9-thread-26 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ | 172.23.138.1 | kv | 7.2.4-7065-enterprise | 29.6640982021 | Cluster node | active / none | | 172.23.137.255 | None | | | <--- IN --- | | | 172.23.137.252 | None | | | <--- IN --- | | | 172.23.137.254 | None | | | <--- IN --- | | +----------------+----------+-----------------------+---------------+--------------+-----------------------+ 2023-12-23 07:01:35,868 | test | INFO | pool-9-thread-26 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 07:01:50,986 | test | INFO | pool-9-thread-26 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 07:01:51,006 | test | INFO | pool-9-thread-26 | [task:check:480] Rebalance completed with progress: 100% in 15.2230000496 sec 2023-12-23 07:01:51,250 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 14.1659164416 | 5.99 GiB | 4.12 GiB | 2.05 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 0.355035503552 | 5.99 GiB | 4.27 GiB | 1.89 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 31.7173033858 | 5.99 GiB | 4.20 GiB | 1.96 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 0 | 5.99 GiB | 4.22 GiB | 1.95 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 07:01:51,250 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= ClusterSetup setup complete for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:01:51,250 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup started for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:01:51,473 | test | INFO | MainThread | [collections_base:deploy_buckets_from_spec_file:470] Creating bucket from spec: multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections 2023-12-23 07:01:51,473 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1980] Creating required buckets from template 2023-12-23 07:02:37,368 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2742] Waiting for all collections to be created 2023-12-23 07:02:37,471 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 68.8221554888 | 5.99 GiB | 3.96 GiB | 2.25 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 53.1314647981 | 5.99 GiB | 4.15 GiB | 2.05 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 56.1095505618 | 5.99 GiB | 3.99 GiB | 2.24 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 75.0224797682 | 5.99 GiB | 4.06 GiB | 2.14 GiB / 6.99 GiB | 0 / 0 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 07:02:38,049 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 0 | 800.00 MiB | 41.81 MiB | 74.14 KiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 0 | 800.00 MiB | 199.37 MiB | 123.55 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 0 | 5.86 GiB | 5.96 MiB | 34.0 Byte | 100 | +---------+-----------+-----------------+----------+------------+-----+-------+------------+------------+------------+-----+ 2023-12-23 07:02:38,049 | test | INFO | MainThread | [collections_base:create_clients_for_sdk_pool:491] Creating required SDK clients for client_pool 2023-12-23 07:04:30,032 | test | INFO | MainThread | [collections_base:load_data_from_spec_file:501] Loading data using spec: initial_load 2023-12-23 07:04:30,032 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 07:04:30,039 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 07:14:43,151 | test | INFO | pool-9-thread-6 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | *******.....................*............................................*.................********X | 72.000 | | 52.800 | ...........................................................X | 52.800 | | 0.000 | **********************************.......***......*.........*........***X | 26.256 | | 19.456 | .....................*X | 19.456 | | 11.900 | ............X | 11.900 | | 0.000 | **********************************************************************.*..*****X | 3.000 | | 2.200 | .**X | 2.200 | | 0.000 | **********************************************************************************************************.***.*..****......*.....*.....*....*****..............................................................*..............*******X | 87.500 | | 66.700 | ...........................................................................X | 66.700 | | 45.000 | ..................................................X | 45.000 | | 10.500 | ...........****X | 10.500 | | 7.700 | .......X | 7.700 | | 2.100 | .*X | 2.100 | | 0.000 | ***************************************************************************...*..*.****............*............*.....................*****X | 45.200 | | 40.000 | ............................................**X | 40.000 | | 25.600 | ............................*****X | 25.600 | | 18.800 | ....................X | 18.800 | | 11.900 | ............*X | 11.900 | | 6.800 | ......X | 6.800 | | 0.000 | ********************************************************************************************X | 0.000 | +--------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 07:14:43,749 | test | INFO | pool-9-thread-1 | [table_view:display:72] Ops trend for bucket 'default' +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ | 0.000 | *******......................*.......................................................................*********X | 1048.300 | | 1039.700 | ...........................................................................................*..**X | 1060.400 | | 853.800 | ...........................................................................X | 853.800 | | 663.100 | ..........................................................*X | 663.100 | | 533.200 | ..............................................X | 533.200 | | 436.500 | .....................................*****....*X | 478.600 | | 452.800 | .......................................*********.............*....................*X | 825.400 | | 739.850 | ................................................................X | 739.850 | | 322.521 | ...........................******........***.........*......*..............*****.....X | 786.522 | | 736.600 | ................................................................X | 736.600 | | 722.400 | ...............................................................*...*X | 761.700 | | 667.300 | ..........................................................*X | 667.300 | | 440.200 | ......................................X | 440.200 | | 334.400 | ............................*******...*..............*................******X | 699.800 | | 624.000 | ......................................................*........***X | 716.200 | | 581.000 | ..................................................X | 581.000 | | 574.300 | ..................................................*X | 574.300 | | 456.900 | .......................................*****X | 456.900 | | 315.000 | ...........................X | 315.000 | | 257.500 | .....................*..............*****.............***................*.**X | 744.500 | | 483.800 | ..........................................X | 483.800 | | 344.200 | .............................******X | 344.200 | | 344.000 | .............................**.......*.................*******.....*....*............*****X | 851.200 | | 754.900 | ..................................................................**X | 754.900 | | 673.600 | ...........................................................X | 673.600 | | 644.700 | ........................................................X | 644.700 | | 269.700 | .......................**X | 269.700 | | 118.200 | .........******..........**.................................................***X | 778.800 | | 665.400 | ..........................................................**X | 665.400 | | 640.800 | ........................................................X | 640.800 | | 516.600 | .............................................******....X | 566.700 | | 449.000 | ......................................****X | 449.000 | | 357.300 | ..............................X | 357.300 | | 356.000 | ..............................*....*..........*******..........*........*****X | 718.300 | | 661.500 | .........................................................*X | 661.500 | | 503.800 | ...........................................****X | 503.800 | | 457.400 | .......................................X | 457.400 | | 409.000 | ...................................**...*......****...*.......X | 618.500 | | 385.900 | .................................******.........*.*...........*********........*...............****X | 876.700 | | 449.300 | .......................................*X | 449.300 | | 359.900 | ...............................*****.......**...........*..........****X | 683.700 | | 653.000 | .........................................................**.*.*...........***X | 798.600 | | 680.400 | ...........................................................*.X | 691.300 | | 591.300 | ...................................................X | 591.300 | | 534.300 | ..............................................****X | 534.300 | | 499.300 | ...........................................X | 499.300 | | 448.500 | ......................................********...........*..........*.............................****X | 1001.800 | | 844.300 | ..........................................................................X | 844.300 | | 747.200 | .................................................................X | 747.200 | | 658.300 | .........................................................X | 658.300 | | 618.300 | ......................................................***X | 618.300 | | 432.300 | .....................................X | 432.300 | | 393.900 | ..................................********...*.........*..................*...............*X | 902.300 | | 750.800 | .................................................................***X | 750.800 | | 661.600 | .........................................................**..**X | 676.800 | | 443.700 | ......................................X | 443.700 | | 336.100 | ............................*********......*....................*..........................................*******.*..X | 1122.500 | | 1118.100 | ..................................................................................................X | 1118.100 | | 838.900 | .........................................................................*X | 838.900 | | 146.800 | ............*******.......**......................*.............*....................******.....X | 909.200 | | 883.100 | .............................................................................X | 883.100 | | 878.000 | .............................................................................****X | 878.000 | | 837.300 | .........................................................................X | 837.300 | | 761.400 | ..................................................................X | 761.400 | | 716.900 | ..............................................................X | 716.900 | | 671.200 | ..........................................................***X | 671.200 | | 597.400 | ....................................................X | 597.400 | | 531.700 | ..............................................X | 531.700 | | 324.300 | ...........................******...***...................................******.........X | 842.800 | | 806.900 | ......................................................................**....*.......**X | 925.800 | | 542.900 | ...............................................X | 542.900 | | 310.500 | ..........................********.........*...............................................****X | 932.600 | | 773.800 | ...................................................................*X | 773.800 | | 660.400 | .........................................................*X | 660.400 | | 651.900 | .........................................................*X | 651.900 | | 577.700 | ..................................................X | 577.700 | | 367.500 | ...............................**........*******X | 450.200 | | 373.200 | ................................*...........................*.....*****X | 740.600 | | 501.000 | ...........................................X | 501.000 | | 381.600 | ................................*X | 381.600 | | 377.800 | ................................***X | 377.800 | | 311.100 | ..........................*......*.........****X | 477.800 | | 438.300 | ......................................X | 438.300 | | 325.000 | ...........................*.........*......*******..*..................................***X | 892.600 | | 761.300 | ..................................................................*X | 761.300 | | 679.400 | ...........................................................X | 679.400 | | 609.700 | .....................................................**X | 609.700 | | 554.800 | ................................................*****.........*X | 658.800 | | 638.400 | .......................................................***X | 638.400 | | 531.800 | ..............................................X | 531.800 | | 406.400 | ...................................**X | 406.400 | +----------+-------------------------------------------------------------------------------------------------------------------------+----------+ 2023-12-23 07:14:43,828 | test | INFO | pool-9-thread-5 | [table_view:display:72] Ops trend for bucket 'bucket1' +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | *******.........*...........................*********X | 40.500 | | 21.600 | ..................X | 21.600 | | 0.000 | **********************************************************************************************************************************************************************************************************************************************.........*.........*..........*.......*****..............................................................********X | 108.000 | | 79.200 | ......................................................................X | 79.200 | | 50.400 | ............................................X | 50.400 | | 0.000 | *******************************************************************************************.******..........................***.........................................................................*****X | 111.200 | | 81.600 | ........................................................................X | 81.600 | | 51.800 | .............................................*X | 51.800 | | 29.600 | .........................X | 29.600 | | 0.000 | *********************************************************************************************X | 0.000 | +--------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 07:14:44,140 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 75.193449403 | 5.99 GiB | 3.66 GiB | 2.57 GiB / 6.99 GiB | 96425 / 188680 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 69.3649045521 | 5.99 GiB | 3.83 GiB | 2.38 GiB / 6.99 GiB | 96025 / 195213 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 73.8361824786 | 5.99 GiB | 3.74 GiB | 2.45 GiB / 6.99 GiB | 96351 / 191310 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 86.6470078635 | 5.99 GiB | 3.79 GiB | 2.43 GiB / 6.99 GiB | 95625 / 193639 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 07:14:48,677 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4976] Validating collection stats and item counts 2023-12-23 07:15:31,466 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ | 172.23.138.1 | kv | 6.14026320173 | 5.99 GiB | 3.64 GiB | 2.58 GiB / 6.99 GiB | 96800 / 189400 | 7.2.4-7065-enterprise | | 172.23.137.254 | kv | 5.48282868659 | 5.99 GiB | 3.82 GiB | 2.38 GiB / 6.99 GiB | 96400 / 196000 | 7.2.4-7065-enterprise | | 172.23.137.252 | kv | 5.812633547 | 5.99 GiB | 3.75 GiB | 2.47 GiB / 6.99 GiB | 96800 / 192200 | 7.2.4-7065-enterprise | | 172.23.137.255 | kv | 7.90017326403 | 5.99 GiB | 3.79 GiB | 2.43 GiB / 6.99 GiB | 96000 / 194400 | 7.2.4-7065-enterprise | +----------------+----------+-----------------+-----------+----------+---------------------+-------------------+-----------------------+ 2023-12-23 07:15:32,010 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 3000 | 800.00 MiB | 245.77 MiB | 152.38 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 3000 | 800.00 MiB | 170.82 MiB | 305.26 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 380000 | 5.86 GiB | 370.04 MiB | 316.03 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+------------+------------+------------+-----+ 2023-12-23 07:15:32,012 | test | INFO | MainThread | [basetestcase:log_setup_status:683] ========= CollectionBase setup complete for test #4 test_data_load_collections_with_rebalance_in_out ========= 2023-12-23 07:15:38,269 | test | INFO | MainThread | [collections_rebalance:load_collections_with_rebalance:1069] Doing collection data load during rebalance_in_out 2023-12-23 07:15:38,269 | test | INFO | MainThread | [collections_rebalance:rebalance_operation:375] Starting rebalance operation of type : rebalance_in_out 2023-12-23 07:15:52,798 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5233] Performing scope/collection specific operations 2023-12-23 07:15:52,957 | test | INFO | pool-9-thread-28 | [table_view:display:72] Rebalance Overview +----------------+----------+-----------------------+----------------+--------------+-----------------------+ | Nodes | Services | Version | CPU | Status | Membership / Recovery | +----------------+----------+-----------------------+----------------+--------------+-----------------------+ | 172.23.138.1 | kv | 7.2.4-7065-enterprise | 7.1987871518 | Cluster node | active / none | | 172.23.137.254 | kv | 7.2.4-7065-enterprise | 5.18263243765 | --- OUT ---> | active / none | | 172.23.137.252 | kv | 7.2.4-7065-enterprise | 7.51849630074 | Cluster node | active / none | | 172.23.137.255 | kv | 7.2.4-7065-enterprise | 7.38149961693 | Cluster node | active / none | | 172.23.137.253 | kv | 7.2.4-7065-enterprise | 0.508130081305 | Cluster node | inactiveAdded / none | | 172.23.138.0 | kv | unknown | None | Cluster node | inactiveAdded / none | +----------------+----------+-----------------------+----------------+--------------+-----------------------+ 2023-12-23 07:15:52,990 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 07:16:03,030 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 07:16:08,023 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:5323] Done Performing scope/collection specific operations 2023-12-23 07:16:13,075 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 0.0 2023-12-23 07:16:23,122 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 0.06 2023-12-23 07:16:33,167 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 0.06 2023-12-23 07:16:43,210 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 2.75 2023-12-23 07:16:53,250 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 4.8 2023-12-23 07:17:03,298 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 7.9 2023-12-23 07:17:13,342 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 8.11 2023-12-23 07:17:23,388 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 9.42 2023-12-23 07:17:33,436 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 11.09 2023-12-23 07:17:43,480 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 13.47 2023-12-23 07:17:53,529 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 17.67 2023-12-23 07:18:03,572 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 19.12 2023-12-23 07:18:13,615 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 19.19 2023-12-23 07:18:23,657 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 21.66 2023-12-23 07:18:33,700 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 22.46 2023-12-23 07:18:43,747 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 22.92 2023-12-23 07:18:53,795 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 23.75 2023-12-23 07:19:03,844 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 24.62 2023-12-23 07:19:13,888 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 25.46 2023-12-23 07:19:23,937 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 26.11 2023-12-23 07:19:33,986 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 27.71 2023-12-23 07:19:44,033 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 27.88 2023-12-23 07:19:54,078 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 28.5 2023-12-23 07:20:04,119 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 28.78 2023-12-23 07:20:14,161 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 30.35 2023-12-23 07:20:24,200 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 33.33 2023-12-23 07:20:34,240 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 33.33 2023-12-23 07:20:45,397 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 33.33 2023-12-23 07:20:51,719 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 23 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-46_collection-2393_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_6745 2023-12-23 07:20:51,720 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 3 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-38_collection-2147_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_3_6823 2023-12-23 07:20:51,723 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 12 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1__default_collection-2402_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_6975 2023-12-23 07:20:51,724 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 23 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-46_collection-2392_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_7039 2023-12-23 07:20:51,726 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 22 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-45_collection-2391_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_7159 2023-12-23 07:20:51,730 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 18 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-45_collection-2390_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_7635 2023-12-23 07:20:53,020 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 15 to 17 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-39_collection-2159_create_ttl=0_create_PERSIST_TO_MAJORITY_15_17_7689 2023-12-23 07:20:53,020 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 15 to 17 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1__default__default_create_ttl=0_create_PERSIST_TO_MAJORITY_15_17_7715 2023-12-23 07:20:53,022 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 15 to 17 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1__default_collection-1996_create_ttl=0_create_PERSIST_TO_MAJORITY_15_17_7777 2023-12-23 07:20:55,447 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 34.77 2023-12-23 07:21:05,497 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 37.39 2023-12-23 07:21:15,539 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 38.43 2023-12-23 07:21:25,588 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 41.15 2023-12-23 07:21:35,632 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 43.09 2023-12-23 07:21:45,683 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 46.61 2023-12-23 07:21:55,733 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 53.93 2023-12-23 07:22:05,776 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 55.27 2023-12-23 07:22:15,818 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 56.7 2023-12-23 07:22:25,890 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 59.15 2023-12-23 07:22:35,930 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 61.88 2023-12-23 07:22:45,976 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 62.48 2023-12-23 07:22:56,016 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 65.4 2023-12-23 07:23:06,053 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 66.67 2023-12-23 07:23:16,096 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 68.93 2023-12-23 07:23:24,713 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 7 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket1_scope-47_collection-2394_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_8059 2023-12-23 07:23:24,716 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 23 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket2_scope-44_collection-2388_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_8309 2023-12-23 07:23:24,717 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 26 docs from 0 to 5000 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket2_scope-44_collection-2389_create_ttl=0_create_PERSIST_TO_MAJORITY_0_5000_8319 2023-12-23 07:23:24,724 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 3 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_bucket2__default_collection-1834_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_3_9087 2023-12-23 07:23:24,730 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2215_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9567 2023-12-23 07:23:24,730 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2192_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9639 2023-12-23 07:23:24,730 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2192_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9643 2023-12-23 07:23:24,746 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2227_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9667 2023-12-23 07:23:26,141 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 69.46 2023-12-23 07:23:26,838 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2253_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9707 2023-12-23 07:23:26,839 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2254_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9723 2023-12-23 07:23:26,839 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2261_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9729 2023-12-23 07:23:26,839 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2262_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9731 2023-12-23 07:23:26,839 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2262_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9735 2023-12-23 07:23:31,375 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2194_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9740 2023-12-23 07:23:31,375 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 10 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2330_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9744 2023-12-23 07:23:31,377 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2359_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9745 2023-12-23 07:23:31,377 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2362_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9747 2023-12-23 07:23:35,298 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2305_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9808 2023-12-23 07:23:35,298 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2358_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9809 2023-12-23 07:23:35,298 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2366_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9811 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2358_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9813 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2238_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9818 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2378_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9821 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2238_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9824 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2260_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9825 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2260_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9828 2023-12-23 07:23:35,299 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2238_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9829 2023-12-23 07:23:35,301 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2343_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9843 2023-12-23 07:23:35,301 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2201_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9857 2023-12-23 07:23:35,301 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2223_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9867 2023-12-23 07:23:35,302 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2337_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9893 2023-12-23 07:23:35,302 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2335_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9906 2023-12-23 07:23:35,302 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2336_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9910 2023-12-23 07:23:35,302 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2335_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9911 2023-12-23 07:23:35,302 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2221_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_9942 2023-12-23 07:23:35,303 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2200_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9943 2023-12-23 07:23:35,303 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2203_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_9955 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2320_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9993 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2321_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_9997 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2251_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10009 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2240_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10011 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2251_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10015 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2356_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10017 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2262_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10019 2023-12-23 07:23:35,305 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2356_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10021 2023-12-23 07:23:35,306 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2362_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10025 2023-12-23 07:23:35,306 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2362_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10029 2023-12-23 07:23:36,186 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 73.53 2023-12-23 07:23:46,246 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 80.12 2023-12-23 07:23:56,346 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 82.03 2023-12-23 07:24:06,388 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 84.34 2023-12-23 07:24:16,326 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2379_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10067 2023-12-23 07:24:16,326 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2379_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10073 2023-12-23 07:24:16,328 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2222_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10105 2023-12-23 07:24:16,328 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2215_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10115 2023-12-23 07:24:16,328 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2199_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10141 2023-12-23 07:24:16,328 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 6 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2334_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10151 2023-12-23 07:24:16,328 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2230_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10179 2023-12-23 07:24:16,329 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 380 to 684 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2374_update_ttl=0_update_PERSIST_TO_MAJORITY_380_684_10183 2023-12-23 07:24:16,329 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 4 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2374_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10187 2023-12-23 07:24:16,329 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2374_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10189 2023-12-23 07:24:16,329 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 5 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2244_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10191 2023-12-23 07:24:16,331 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2234_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10193 2023-12-23 07:24:16,331 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 3 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2240_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10195 2023-12-23 07:24:16,331 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2244_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10198 2023-12-23 07:24:16,331 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2375_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10207 2023-12-23 07:24:16,332 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2365_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10259 2023-12-23 07:24:16,332 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2259_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10261 2023-12-23 07:24:16,332 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2371_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10269 2023-12-23 07:24:16,332 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2319_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10289 2023-12-23 07:24:16,332 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2215_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10297 2023-12-23 07:24:16,334 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2334_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10299 2023-12-23 07:24:16,334 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2368_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10301 2023-12-23 07:24:16,334 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2222_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10319 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2221_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10321 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2339_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10339 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2232_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10363 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2378_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10368 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2366_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10372 2023-12-23 07:24:16,335 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection-2264_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10379 2023-12-23 07:24:16,336 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2330_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10385 2023-12-23 07:24:16,336 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2305_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10395 2023-12-23 07:24:16,336 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2335_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10437 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2197_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10443 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2199_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10451 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2204_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10457 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection_1_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10471 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2203_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10473 2023-12-23 07:24:16,338 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2197_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10497 2023-12-23 07:24:16,339 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 0 to 380 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2201_delete_ttl=0_delete_PERSIST_TO_MAJORITY_0_380_10508 2023-12-23 07:24:16,339 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 1 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-41_collection-2378_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10509 2023-12-23 07:24:16,339 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope1_collection_1_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10519 2023-12-23 07:24:16,341 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default__default_collection-2201_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10531 2023-12-23 07:24:16,341 | test | ERROR | pool-9-thread-3 | [task:_MutateDocsFromSpecTask__wait_for_task_completion:4029] Failed to load 2 docs from 1900 to 2204 of thread_name LoadDocs_MutateDocsFromSpecTask_6709_default_scope-40_collection-2338_create_ttl=0_create_PERSIST_TO_MAJORITY_1900_2204_10539 2023-12-23 07:24:16,430 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 88.56 2023-12-23 07:24:16,622 | test | INFO | pool-9-thread-26 | [table_view:display:72] Ops trend for bucket 'bucket2' +--------+---------------------------------------------------------------------------------------------------------------+--------+ | Min | Trend | Max | +--------+---------------------------------------------------------------------------------------------------------------+--------+ | 0.000 | *********************************.********X | 1.233 | | 0.333 | *****..******X | 2.323 | | 0.623 | ***.X | 1.391 | | 1.300 | ****X | 1.300 | | 0.956 | ************X | 1.200 | | 0.900 | ****X | 0.900 | | 0.550 | *****.X | 1.750 | | 1.600 | *******......*****************................******................*********...*****..................*****X | 55.822 | | 52.322 | .......................................................*X | 52.322 | | 27.900 | .............................*******X | 27.900 | | 23.700 | ........................***.............................................******..............................X | 92.700 | | 72.900 | .............................................................................******X | 72.900 | | 46.600 | .................................................X | 46.600 | | 20.800 | .....................*****........................................***..........*******....X | 70.900 | | 65.700 | .....................................................................*************X | 65.700 | | 62.133 | ..................................................................***X | 62.133 | | 48.467 | ...................................................*X | 48.467 | | 45.505 | ................................................*****X | 45.505 | | 22.889 | .......................*X | 22.889 | | 21.222 | .....................*****..............**.....................................***.***X | 69.500 | | 63.500 | ...................................................................*...................***.*X | 82.000 | | 58.700 | ..............................................................**X | 58.700 | | 35.700 | .....................................*X | 35.700 | | 32.700 | ..................................**.........***........*X | 49.000 | | 47.200 | .................................................*.*.****X | 48.900 | | 45.900 | ................................................X | 45.900 | | 37.400 | .......................................***X | 37.400 | | 35.500 | .....................................****.*..................*......*****.....*X | 63.100 | | 58.500 | ..............................................................X | 58.500 | | 52.100 | .......................................................*****....**....*.......***X | 66.700 | | 62.100 | .................................................................X | 62.100 | | 59.400 | ...............................................................**X | 59.400 | | 53.800 | .........................................................***.......**.........X | 68.900 | | 68.400 | ........................................................................*.**X | 68.600 | | 56.500 | ...........................................................X | 56.500 | | 44.000 | ..............................................X | 44.000 | | 34.400 | ....................................X | 34.400 | | 13.500 | .............****X | 13.500 | | 8.100 | .......X | 8.100 | | 5.500 | ....*X | 5.500 | | 1.200 | *****.**..*.****.*.*****X | 7.400 | | 5.500 | ....*X | 5.500 | | 2.800 | ..*****X | 2.800 | | 2.600 | .***.******........................**...........................*................................*****X | 80.100 | | 62.100 | .................................................................**X | 62.100 | | 61.500 | .................................................................**X | 61.500 | | 51.900 | ......................................................**.*.........***....X | 64.000 | | 35.100 | ....................................****X | 35.100 | +--------+---------------------------------------------------------------------------------------------------------------+--------+ 2023-12-23 07:24:16,681 | test | INFO | pool-9-thread-10 | [table_view:display:72] Ops trend for bucket 'default' +---------+----------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+----------------------------------------------------------------------------------------------------------+---------+ | 0.000 | *...*........****.......************.......***X | 173.500 | | 76.800 | ..........**********............................*..........******X | 341.881 | | 341.881 | ................................................X | 341.881 | | 314.381 | ............................................**X | 314.381 | | 314.381 | ............................................*X | 314.381 | | 218.381 | ..............................***............***X | 304.160 | | 247.260 | ..................................***.....****X | 282.300 | | 175.300 | ........................****.................******............X | 379.600 | | 358.200 | ..................................................**X | 358.200 | | 240.800 | .................................*****............*****........*........X | 431.700 | | 431.700 | .............................................................**X | 431.700 | | 431.700 | .............................................................***.....****************X | 470.100 | | 371.825 | ....................................................*****X | 371.825 | | 338.525 | ...............................................********X | 338.525 | | 336.058 | ...............................................****X | 336.058 | | 280.789 | .......................................******.....**..********.***........*****X | 392.500 | | 371.200 | ....................................................********...*..****X | 401.700 | | 358.600 | ..................................................**X | 358.600 | | 309.300 | ...........................................*******....*...........*************X | 410.100 | | 384.429 | ......................................................**X | 384.429 | | 319.444 | .............................................**X | 319.444 | | 315.006 | ............................................*****X | 315.006 | | 289.067 | ........................................*.........****X | 352.422 | | 318.822 | .............................................**...********..****X | 352.900 | | 257.500 | ....................................***......*X | 304.400 | | 194.700 | ...........................*****.................*****..........****X | 384.500 | | 379.600 | .....................................................***X | 379.600 | | 349.900 | .................................................******..........X | 419.000 | | 419.000 | ...........................................................*X | 419.000 | | 419.000 | ...........................................................***X | 419.000 | | 417.100 | ...........................................................*.......******X | 463.600 | | 417.000 | ...........................................................X | 417.000 | | 336.200 | ...............................................***X | 336.200 | | 336.200 | ...............................................*X | 336.200 | | 336.200 | ...............................................**..................................*****X | 569.300 | | 447.600 | ...............................................................X | 447.600 | | 371.600 | ....................................................*****X | 371.600 | | 365.100 | ...................................................******.....***..................*****X | 521.700 | | 448.000 | ...............................................................*..............................X | 652.300 | | 652.300 | .............................................................................................****......X | 691.900 | | 488.600 | .....................................................................******X | 488.600 | | 457.200 | .................................................................**............X | 542.600 | | 542.600 | .............................................................................*X | 542.600 | | 542.600 | .............................................................................*...***..............*****X | 663.000 | | 554.500 | ...............................................................................*X | 554.500 | | 542.800 | .............................................................................*...*X | 565.600 | | 392.200 | .......................................................*X | 392.200 | | 377.300 | .....................................................*X | 377.300 | | 277.000 | .......................................***...*X | 300.000 | | 292.200 | .........................................***......***X | 338.900 | | 308.200 | ...........................................X | 308.200 | | 187.900 | ..........................****X | 187.900 | +---------+----------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 07:24:17,901 | test | INFO | pool-9-thread-16 | [table_view:display:72] Ops trend for bucket 'bucket1' +---------+----------------------------------------------------------------------------------------------------------------+---------+ | Min | Trend | Max | +---------+----------------------------------------------------------------------------------------------------------------+---------+ | 0.000 | ******....***********X | 5.500 | | 3.500 | ..****...******..****...............*...........**...******.......*..***X | 53.784 | | 44.084 | .....................................***............X | 57.463 | | 55.063 | ...............................................**X | 55.063 | | 50.763 | ...........................................***..............................................**...**X | 106.807 | | 56.544 | ................................................****......................*.*****...**..X | 88.500 | | 72.600 | ..............................................................*****.........................*...****.........X | 114.700 | | 73.000 | ..............................................................***..........*.....***............**X | 103.400 | | 90.800 | ..............................................................................X | 90.800 | | 80.400 | .....................................................................*******......*****X | 87.800 | | 75.606 | ................................................................**.........*.....**X | 91.606 | | 85.906 | .........................................................................**X | 85.906 | | 78.306 | ...................................................................X | 78.306 | | 73.006 | ..............................................................****X | 73.006 | | 70.863 | ............................................................*.........***X | 80.863 | | 66.711 | .........................................................***X | 66.711 | | 62.411 | .....................................................**..*X | 64.778 | | 48.067 | ........................................**X | 48.067 | | 45.167 | ......................................X | 45.167 | | 42.467 | ....................................***X | 42.467 | | 35.100 | .............................***...........................................*........*.............***X | 108.500 | | 104.000 | .........................................................................................**X | 104.000 | | 93.500 | ................................................................................X | 93.500 | | 92.900 | ...............................................................................***X | 92.900 | | 79.800 | ....................................................................X | 79.800 | | 64.200 | ......................................................X | 64.200 | | 58.800 | ..................................................*X | 58.800 | | 52.200 | ............................................*..**X | 54.600 | | 54.500 | ..............................................X | 54.500 | | 52.200 | ............................................*****X | 52.200 | | 48.900 | .........................................X | 48.900 | | 45.100 | ......................................*.....*******........*******.*...X | 65.000 | | 62.700 | .....................................................X | 62.700 | | 57.922 | .................................................*X | 57.922 | | 55.880 | ...............................................X | 55.880 | | 51.622 | ............................................**X | 51.622 | | 48.822 | .........................................X | 48.822 | | 48.722 | .........................................***...*X | 52.500 | | 41.800 | ...................................X | 41.800 | | 28.100 | .......................*X | 28.100 | | 15.700 | ............****X | 15.700 | | 15.100 | ............*....****.......***.......*X | 36.400 | | 27.600 | .......................*******........*................**...................**X | 77.700 | | 47.900 | ........................................*X | 47.900 | | 29.200 | ........................****X | 29.200 | | 24.600 | ....................********..**.................*X | 46.900 | | 46.900 | .......................................**X | 46.900 | | 46.900 | .......................................*...*....*****X | 54.700 | | 47.700 | ........................................*******.......X | 55.400 | | 45.900 | .......................................**X | 45.900 | | 36.300 | ..............................***.**......**........**X | 53.400 | | 46.300 | .......................................*.*X | 48.100 | | 47.100 | ........................................****X | 47.100 | | 37.700 | ...............................*...*X | 40.200 | | 32.600 | ...........................***X | 32.600 | | 21.100 | .................X | 21.100 | | 14.200 | ...........*X | 14.200 | | 6.900 | .....*****...*...*****X | 14.000 | | 10.200 | .......*X | 10.200 | | 8.200 | ......********X | 9.100 | | 8.900 | ......*****X | 8.900 | | 8.500 | ......*X | 8.500 | | 7.700 | .....**X | 7.700 | | 5.200 | ...***X | 5.200 | | 5.100 | ...**X | 5.100 | | 5.100 | ...*X | 5.100 | | 4.500 | ..***.****X | 5.600 | | 4.600 | ...*****X | 4.600 | +---------+----------------------------------------------------------------------------------------------------------------+---------+ 2023-12-23 07:24:26,474 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 95.26 2023-12-23 07:24:36,513 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: running, progress: 100.0 2023-12-23 07:24:51,565 | test | INFO | pool-9-thread-28 | [task:check:421] Rebalance - status: none, progress: 100 2023-12-23 07:24:54,553 | test | INFO | pool-9-thread-28 | [task:check:480] Rebalance completed with progress: 100% in 541.595999956 sec 2023-12-23 07:24:55,500 | test | INFO | MainThread | [collections_rebalance:get_zone_info:1035] nodes in zone inside get_zone_info():{'Group 1': ['172.23.137.252', '172.23.138.0', '172.23.137.253', '172.23.137.255', '172.23.138.1']} 2023-12-23 07:24:59,032 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4976] Validating collection stats and item counts 2023-12-23 07:25:44,694 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ | Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR | +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ | bucket1 | couchbase | couchstore | 2 | none | 0 | 37562 | 1000.00 MiB | 180.72 MiB | 304.75 MiB | 100 | | bucket2 | couchbase | couchstore | 2 | none | 0 | 32016 | 1000.00 MiB | 167.75 MiB | 316.26 MiB | 100 | | default | couchbase | couchstore | 2 | none | 0 | 304952 | 7.32 GiB | 365.80 MiB | 319.53 MiB | 100 | +---------+-----------+-----------------+----------+------------+-----+--------+-------------+------------+------------+-----+ 2023-12-23 07:25:45,163 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket2, Active Resident ratio(DGM): 100% 2023-12-23 07:25:45,163 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket2, Replica Resident ratio(DGM): 100% 2023-12-23 07:26:01,321 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: bucket1, Active Resident ratio(DGM): 100% 2023-12-23 07:26:01,322 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: bucket1, Replica Resident ratio(DGM): 100% 2023-12-23 07:27:34,888 | test | INFO | MainThread | [collections_base:tearDown:92] Bucket: default, Active Resident ratio(DGM): 100% 2023-12-23 07:27:34,888 | test | INFO | MainThread | [collections_base:tearDown:95] Bucket: default, Replica Resident ratio(DGM): 100% ok ---------------------------------------------------------------------- Ran 1 test in 1695.706s OK During the test, Remote Connections: 217, Disconnections: 217 SDK Connections: 30, Disconnections: 30 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 3 failures so far... bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance testrunner logs, diags and results are available under /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_05-33-15/test_4 Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in,nodes_init=3,nodes_in=2,update_replica=True,updated_num_replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_stage=during,data_load_spec=volume_test_load_with_CRUD_on_collections,skip_validations=False,override_spec_params=replicas,replicas=0,skip_validations=False,GROUP=replica_update_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out,nodes_init=5,nodes_out=2,update_replica=True,updated_num_replicas=3,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_stage=during,data_load_spec=volume_test_load_with_CRUD_on_collections,skip_validations=False,override_spec_params=replicas,replicas=0,skip_validations=False,services_init=kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql-kv:index:n1ql,kv_quota_percent=85,index_quota_percent=15,test_oso_backfill=True,load_collections_exponentially=True,oso_dcp_backfill=disabled,GROUP=replica_update_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance,nodes_init=3,nodes_swap=2,update_replica=True,updated_num_replicas=3,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_stage=during,data_load_spec=volume_test_load_with_CRUD_on_collections,skip_validations=False,override_spec_params=replicas,replicas=1,skip_validations=False,GROUP=replica_update_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=3,nodes_in=2,nodes_out=1,update_replica=True,updated_num_replicas=2,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_stage=during,data_load_spec=volume_test_load_with_CRUD_on_collections,skip_validations=False,override_spec_params=replicas,replicas=1,skip_validations=False,GROUP=replica_update_with_collection_crud' skipped, GROUP not satisfied Test 'bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=4,nodes_in=1,nodes_out=2,update_replica=True,updated_num_replicas=3,bucket_spec=multi_bucket.buckets_all_membase_for_rebalance_tests_more_collections,data_load_stage=during,data_load_spec=volume_test_load_with_CRUD_on_collections,skip_validations=False,override_spec_params=replicas,replicas=0,skip_validations=False,GROUP=replica_update_with_collection_crud' skipped, GROUP not satisfied Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1h 54m 48s 2 actionable tasks: 2 executed workspace is /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 fails is 3 4 Desc1: 7.2.4-7065 - collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 - windows22 (1/4) > Configure project : Using Transaction_client :: 1.2.1 Using Java_client :: 3.4.10 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/ssh.py 7.2.4-7065 --executor_jenkins_job --run_params=GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar scripts/eagles_all_around.py 7.2.4-7065 --executor_jenkins_job --run_params=GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main scripts/install.py 7.2.4-7065 --executor_jenkins_job --run_params=GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources testrunner.py 7.2.4-7065 --executor_jenkins_job --run_params=GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 Running: /opt/jython/bin/jython -J-cp /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/classes/java/main:/data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-slf4j-impl/2.11.1/4b41b53a3a2d299ce381a69d165381ca19f62912/log4j-slf4j-impl-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/commons-cli/commons-cli/1.4/c51c00206bb913cd8612b24abd9fa98ae89719b1/commons-cli-1.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-blob/12.20.3/38d33006f9c64f4c3703f80297c09b21cb0a7c6a/azure-storage-blob-12.20.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.2.1/170f0e036a91f8823da2f9c46f5fa4a6c8e012b4/couchbase-transactions-1.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.4.10/458521190085ad0c25eeb6fc6357082be199512e/java-client-3.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-internal-avro/12.5.3/84797e7319564a9f9ae7f4acbb12a3dc4c26d606/azure-storage-internal-avro-12.5.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-storage-common/12.19.3/3e30b1be613815b10ea8d2cfa39f560aaeef5f0d/azure-storage-common-12.19.3.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core-http-netty/1.13.0/57474ba0daa16690465c32f1376fb4b274e00778/azure-core-http-netty-1.13.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.azure/azure-core/1.36.0/a1bd31cb23b2c6bc18c3fb2e9635c766ecdbe76/azure-core-1.36.0.jar:/root/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-api/1.7.36/6c62681a2f655b49963a5983b8b0950a6120ae14/slf4j-api-1.7.36.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-core/2.11.1/592a48674c926b01a9a747c7831bcd82a9e6d6e4/log4j-core-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.apache.logging.log4j/log4j-api/2.11.1/268f0fe4df3eefe052b57c87ec48517d64fb2a10/log4j-api-2.11.1.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.datatype/jackson-datatype-jsr310/2.13.4/e6d820112871f33cd94a1dcc54eef58874753b5/jackson-datatype-jsr310-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-databind/2.13.4.2/325c06bdfeb628cfb80ebaaf1a26cc1eb558a585/jackson-databind-2.13.4.2.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-annotations/2.13.4/858c6cc78e1f08a885b1613e1d817c829df70a6e/jackson-annotations-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.core/jackson-core/2.13.4/cf934c681294b97ef6d80082faeefbe1edadf56/jackson-core-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.jackson.dataformat/jackson-dataformat-xml/2.13.4/b739978806ffc80967ba0efe43b1296c29c4cfe8/jackson-dataformat-xml-2.13.4.jar:/root/.gradle/caches/modules-2/files-2.1/com.fasterxml.woodstox/woodstox-core/6.4.0/c47579857bbf12c85499f431d4ecf27d77976b7c/woodstox-core-6.4.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.4.10/cc581365e1069ba6fd11f7a7f86dbe8199dee39b/core-io-2.4.10.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-http/1.0.27/83a4a8ba02ecbdb681dcc083479ff251f620d2a7/reactor-netty-http-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor.netty/reactor-netty-core/1.0.27/afccb76721a9f2a982fb2b5f043aa2f70ecb00aa/reactor-netty-core-1.0.27.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.5.8/f5e1714dce42ec53052f3d73889fd693d774cbe1/reactor-core-3.5.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler-proxy/4.1.87.Final/8079f16d6209e10f5d3a09522e7aa9ffb217e17e/netty-handler-proxy-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http2/4.1.87.Final/72b756ff290d782c9ebb36db7d42ee272270c0b4/netty-codec-http2-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-http/4.1.87.Final/3230e95d6832ee4306fe1ca774c7bcecf1da4b28/netty-codec-http-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-native-macos/4.1.86.Final/cbec1f5c35a1466a8d998f3419c5c493ef5063ee/netty-resolver-dns-native-macos-4.1.86.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns-classes-macos/4.1.86.Final/5d72f1896cb9dab1fb7c41470cb30a9e63a65643/netty-resolver-dns-classes-macos-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver-dns/4.1.86.Final/a1e2ef79e4944b5d38092328c36c68e677a4b5f3/netty-resolver-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-handler/4.1.87.Final/2bd97491c22ebea4670c00f1bd5dbf65a8a1cfe7/netty-handler-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-socks/4.1.87.Final/109027470b72d56914d76154e947f9bd5844bb9b/netty-codec-socks-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec-dns/4.1.86.Final/c8de479f36a8457541fcbb0016c851bde3e67693/netty-codec-dns-4.1.86.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-codec/4.1.87.Final/d7ab7363f736114e6324ccf802d094529b30b8d8/netty-codec-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-epoll/4.1.87.Final/3374b1ee72cfff2858821de824ca02d08aedee7c/netty-transport-native-epoll-4.1.87.Final-linux-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-kqueue/4.1.87.Final/28db44b32b4c68f14858e9d691646a7262b57863/netty-transport-native-kqueue-4.1.87.Final-osx-x86_64.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-epoll/4.1.87.Final/86e61c5743940d80e10609746784ffa0e4642065/netty-transport-classes-epoll-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-classes-kqueue/4.1.87.Final/5476926df0ad650d3287d61b0bd17f145ff13791/netty-transport-classes-kqueue-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport-native-unix-common/4.1.87.Final/4bf8308dc7d6ba2570681eaeddb16f8d1196b438/netty-transport-native-unix-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-transport/4.1.87.Final/30c78c8ced3417f35e2a55f7533dc2bb43fef2aa/netty-transport-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-buffer/4.1.87.Final/8942174141fb0586e7fffefc8ae48e1458293696/netty-buffer-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-boringssl-static/2.0.56.Final/6aa4a3f9e415daa973ef3d7efeb8807b15631faf/netty-tcnative-boringssl-static-2.0.56.Final.jar:/root/.gradle/caches/modules-2/files-2.1/org.codehaus.woodstox/stax2-api/4.2.1/a3f7325c52240418c2ba257b103c3c550e140c83/stax2-api-4.2.1.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.4/3864a1320d97d7b045f729a326e1e077661f31b7/reactive-streams-1.0.4.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-resolver/4.1.87.Final/eaa964e16a67914c8d9b814d29a4b969635d72a0/netty-resolver-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-common/4.1.87.Final/3e7e80dd6e604144781fcb859b79cfe8d3730079/netty-common-4.1.87.Final.jar:/root/.gradle/caches/modules-2/files-2.1/io.netty/netty-tcnative-classes/2.0.56.Final/df828615a3a4b4b44d7f41aa3d22b744fe7170d/netty-tcnative-classes-2.0.56.Final.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py 7.2.4-7065 --executor_jenkins_job --run_params=GROUP=rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY,rerun=False,get-cbcollect-info=True,upgrade_version=7.2.4-7065,sirius_url=http://172.23.120.103:4000 > Task :compileJava UP-TO-DATE > Task :rerun_job reading from windows22_collections_rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1_7.2.4-7065 upserted windows22_collections_rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1_7.2.4-7065 Merging xmls Could not download the artifacts Trying to download from AWS Could not download any previous logs INFO:merge_reports:Merging of report files from ['logs/**/*.xml'] INFO:merge_reports:-- logs/testrunner-23-Dec-23_05-33-15/report-23-Dec-23_05-33-15-bucket_collections.collections_rebalance.CollectionsRebalance.xml -- INFO:merge_reports: Number of TestSuites=1 INFO:merge_reports: TestSuite#1) bucket_collections.collections_rebalance.CollectionsRebalance, Number of Tests=4 summary so far suite bucket_collections.collections_rebalance.CollectionsRebalance , pass 1 , fail 3 failures so far... bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_out bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_swap_rebalance bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in INFO:merge_reports:Summary file is at /data/workspace/windows22-p0-collections-vset00-00-rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1/logs/testrunner-23-Dec-23_07-28-11/merged_summary/mergedreport-23-Dec-23_07-28-11-bucket_collections.collections_rebalance.CollectionsRebalance.xml merged xmls No more failed tests. Stopping reruns Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.2.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 16s 2 actionable tasks: 1 executed, 1 up-to-date [description-setter] Description set: 7.2.4-7065 - collections rebalance_with_collection_crud_durability_PERSIST_TO_MAJORITY_7.0_P1 - windows22 (1/4) [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'propfile' [EnvInject] - Variables injected successfully. Archiving artifacts Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE [BFA] Scanning build for known causes... [BFA] No failure causes found [BFA] Done. 0s Notifying upstream projects of job completion Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures) Request made to compress build log Sending email to: sumedh.basarkod@couchbase.com balakumaran.gopal@couchbase.com Triggering a new build of savejoblogs Triggering a new build of test-executor-cleanup Triggering a new build of test-executor-cleanup-aws Triggering a new build of test-executor-cleanup-dynvm Finished: UNSTABLE