From c37fc24c7bc8f940384c4a2c3009771c86ae6a79 Mon Sep 17 00:00:00 2001 From: Gil Forsyth Date: Wed, 5 Feb 2025 13:01:34 -0500 Subject: [PATCH] Use `rapids-pip-retry` in CI jobs that might need retries (#824) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Uses a retry wrapper for `pip` commands to try to alleviate CI failures due to hash mismatches that result from network hiccups xref rapidsai/build-planning#148 This will retry failures that show up in CI like: ``` Collecting nvidia-cublas-cu12 (from libraft-cu12==25.2.*,>=0.0.0a0) Downloading https://pypi.nvidia.com/nvidia-cublas-cu12/nvidia_cublas_cu12-12.8.3.14-py3-none-manylinux_2_27_aarch64.whl (604.9 MB) ━━━━━━━━━━━━━━━━━━━━━ 350.2/604.9 MB 229.2 MB/s eta 0:00:02 ERROR: THESE PACKAGES DO NOT MATCH THE HASHES FROM THE REQUIREMENTS FILE. If you have updated the package versions, please update the hashes. Otherwise, examine the package contents carefully; someone may have tampered with them. nvidia-cublas-cu12 from https://pypi.nvidia.com/nvidia-cublas-cu12/nvidia_cublas_cu12-12.8.3.14-py3-none-manylinux_2_27_aarch64.whl#sha256=93a4e0e386cc7f6e56c822531396de8170ed17068a1e18f987574895044cd8c3 (from libraft-cu12==25.2.*,>=0.0.0a0): Expected sha256 93a4e0e386cc7f6e56c822531396de8170ed17068a1e18f987574895044cd8c3 Got 849c88d155cb4b4a3fdfebff9270fb367c58370b4243a2bdbcb1b9e7e940b7be ``` Authors: - Gil Forsyth (https://github.com/gforsyth) Approvers: - Mike Sarahan (https://github.com/msarahan) - Bradley Dice (https://github.com/bdice) URL: https://github.com/rapidsai/cucim/pull/824 --- ci/build_wheel.sh | 4 ++-- ci/test_wheel.sh | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/ci/build_wheel.sh b/ci/build_wheel.sh index 112cf0a4..da560074 100755 --- a/ci/build_wheel.sh +++ b/ci/build_wheel.sh @@ -25,7 +25,7 @@ rapids-dependency-file-generator \ | tee /tmp/requirements-build.txt rapids-logger "Installing build requirements" -python -m pip install \ +rapids-pip-retry install \ -v \ --prefer-binary \ -r /tmp/requirements-build.txt @@ -42,7 +42,7 @@ cd "${package_dir}" sccache --zero-stats rapids-logger "Building '${package_name}' wheel" -python -m pip wheel \ +rapids-pip-retry wheel \ -w dist \ -v \ --no-build-isolation \ diff --git a/ci/test_wheel.sh b/ci/test_wheel.sh index af0f6bcc..4d9c69af 100755 --- a/ci/test_wheel.sh +++ b/ci/test_wheel.sh @@ -7,7 +7,7 @@ RAPIDS_PY_CUDA_SUFFIX="$(rapids-wheel-ctk-name-gen "${RAPIDS_CUDA_VERSION}")" RAPIDS_PY_WHEEL_NAME="cucim_${RAPIDS_PY_CUDA_SUFFIX}" rapids-download-wheels-from-s3 ./dist # echo to expand wildcard before adding `[extra]` requires for pip -python -m pip install "$(echo ./dist/cucim*.whl)[test]" +rapids-pip-retry install "$(echo ./dist/cucim*.whl)[test]" CUDA_MAJOR_VERSION=${RAPIDS_CUDA_VERSION:0:2}