Repository navigation
Conversation
The MPI_Alltoall of the reduced system (per solve and in the init) used managed buffers; on 4 nodes (2048x768x576, grid 1x16) this made the next pinned host allocation of the OpenACC runtime fail (cuMemHostAlloc out of memory). The buffers are now plain device arrays, passed to CUDA-aware MPI through host-side aliases of their device address. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sets config%rank_order = CUDECOMP_RANK_ORDER_COL_MAJOR when the distributed TDMA is used, so the pr ranks of the X<->Y transposes are consecutive (same node for pr <= GPUs per node). Replaces the deprecated CUDECOMP_USE_COL_MAJOR_RANK_ORDER environment variable. Also indents the poisson_dist preprocessor blocks in the Poisson solver. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TDMA optimization and option for PCR-TDMA