About the Role

High-Performance Networking Engineer on xAI’s Supercomputing team, you will design and optimize low-latency, high-bandwidth networking solutions using NVIDIA’s RDMA-capable technologies to support some of the world’s largest GPU supercomputing clusters. These clusters drive AI training and inference workloads, demanding cutting-edge performance and scalability.

Focus

• Develop and tune RDMA-based communication systems leveraging NVIDIA GPUs and Mellanox NICs (InfiniBand, RoCE) for ultra-fast data transfer between nodes.
• Implement and optimize GPUDirect RDMA to enable direct memory access between GPUs and network interfaces, minimizing CPU overhead.
• Integrate RDMA solutions with Kubernetes-based workloads, ensuring seamless operation across distributed compute and storage systems.
• Collaborate with AI researchers and infrastructure teams to accelerate data pipelines and collective communications using NCCL and MPI.
• Troubleshoot and resolve performance bottlenecks in high-throughput, low-latency networking environments.

Ideal Experience

• Hands-on experience with NVIDIA RDMA technologies (e.g., GPUDirect RDMA, RoCE, InfiniBand) in HPC or AI supercomputing environments.
• Proficiency in programming with Rust, C, or C++ for low-level networking and system optimization.
• Familiarity with NVIDIA’s networking stack, including Mellanox drivers, libraries (e.g., libibverbs), and tools (e.g., NVPeerMemory).
• Experience optimizing distributed systems with MPI, NCCL, or similar frameworks for GPU-accelerated workloads.
• Knowledge of Kubernetes networking and integrating RDMA into containerized environments.
• Bonus: Background in AI/ML training workflows and their networking demands (e.g., large-scale parameter synchronization).

Tech Stack

• NVIDIA GPUs and Mellanox networking (InfiniBand, RoCE)
• RDMA protocols (e.g., GPUDirect RDMA, RoCEv2)
• Kubernetes
• Rust and C/C++
• MPI (Message Passing Interface) and NCCL (NVIDIA Collective Communications Library)

Annual Salary Range

$180,000 - $440,000 USD

Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.