Silence cudf ptxcompiler numba-codegen probe in RAPIDS runenv - #103
Merged
Conversation
Set PTXCOMPILER_CHECK_NUMBA_CODEGEN_PATCH_NEEDED=0 so cudf skips the import-time subprocess that fails to load libcudart.so and prints a misleading OSError traceback plus 'Not patching Numba' on every run. cuML/CuPy are unaffected (the probe already defaulted to not patching).
|
Caution The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased. |
PaulNewling
approved these changes
Jul 24, 2026
julenmendieta
approved these changes
Jul 24, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Adds
PTXCOMPILER_CHECK_NUMBA_CODEGEN_PATCH_NEEDED=0to thepython-3.12.10-rapidsrunenvenvVars.Why
Every GPU block on this runenv logs a misleading error on startup:
On import, cudf spawns a subprocess to probe the CUDA runtime version.
numba_cuda 0.4.0(pinned by cudf/cuml 25.04) only discovers CUDA libs via conda /CUDA_HOME//usr/local/cuda— all conda-gated — so in this pip-based portable-python runenv it falls back toctypes.CDLL("libcudart.so")(unversioned), which the pip wheel doesn't ship (onlylibcudart.so.12). The probe fails, and the traceback surfaces in block error reports where it masks the real failure.The env var makes cudf skip the probe entirely (
check_disabled_in_env()returnsTruefor0).Safety
No loss of GPU functionality. Verified on a real GPU pod (block image, RTX 4000) that with the probe silenced, cuML PCA + UMAP on GPU still run. The probe only gates a numba codegen patch that was already being skipped, and no block uses in-process numba-CUDA (cuML/cuDF/cuPy use their own bundled native libs).
Note: fully restoring in-process numba-CUDA lib discovery would require baking a
libcudart.sosymlink into the downstream image build (where the wheels install) or a RAPIDS-version bump — out of scope and of no functional benefit to current GPU blocks.Greptile Summary
This PR suppresses a misleading import-time CUDA compatibility probe in the Python 3.12.10 RAPIDS run environment.
PTXCOMPILER_CHECK_NUMBA_CODEGEN_PATCH_NEEDED: An environment variable controlling whether cuDF checks if Numba codegen needs patching; the PR sets it to0, disabling the probe.envVars: Runtime environment variables attached to a run-environment artifact; the PR adds the PTX compiler setting to the RAPIDS artifact.ptxcompiler probe: A cuDF import-time compatibility check that queries CUDA driver and runtime versions; the PR prevents it from running.RAPIDS runenv: The packaged Python environment containing GPU-oriented RAPIDS dependencies; its package receives a patch changeset for this configuration update.Confidence Score: 5/5
The PR appears safe to merge with no actionable defects identified.
The change uses the existing run-environment variable format to disable a probe that already falls back to not applying the Numba patch when CUDA runtime discovery fails.
Important Files Changed
Reviews (1): Last reviewed commit: "Silence cudf ptxcompiler numba-codegen p..." | Re-trigger Greptile