Mellanox Technologies FDR InfiniBand system has support for NVIDIA GPUDirect remote direct memory access (RDMA) technology. The NVIDIA GPUDirect technology provides application performance and efficiency for GPU-accelerator based high-performance computing (HPC) clusters. NVIDIA GPUDirect RDMA technology dramatically accelerates communications between GPUs by providing a direct peer-to-peer communication data path between scalable HPC adapters and NVIDIA GPUs. This capability provides a significant decrease in GPU-GPU communication latency and completely offloads the CPU and system memory subsystem from all GPU-GPU communications across the network.