Search code examples
cudanvidiagpgpumulti-gpugpudirect

Can I use in CUDA atomic-operations on remote GPU-RAM over GPUDirect 2.0 P2P?

For example i can use CUDA atomic operations atomicAdd(ptr, val), atomicCAS(ptr, old, new), ... on its global memory (GPU-RAM). With CUDA 6.5.

But can I use these atomic-operations for the remote global memory over GPUDirect 2.0 P2P?

Solution

  • No. The GPU atomics are only atomic across the GPU performing the operation. They do not work on host memory or nonlocal device memory.

    I'm sure it is a roadmap item for NVIDIA to address these limitations on future platforms, esp. with NVLink.