HPC Network Engineer

Posted:
5/29/2024, 9:31:00 AM

Location(s):
New York, United States ⋅ New York, New York, United States ⋅ New Jersey, United States

Experience Level(s):
Junior ⋅ Mid Level ⋅ Senior

Field(s):
IT & Security

Workplace Type:
Hybrid

CoreWeave is a specialized cloud provider, delivering a massive scale of GPU compute resources on top of the industry’s fastest and most flexible infrastructure. CoreWeave builds cloud solutions for compute intensive use cases — VFX and rendering, machine learning and AI, batch processing, and Pixel Streaming — that are up to 35 times faster and 80% less expensive than the large, generalized public clouds. Learn more at www.coreweave.com.

About the Role:

CoreWeave is seeking a highly skilled and motivated HPC Network Engineer to join our fast growing team. In this role, you will play a crucial part in the development, support, and optimization of our HPC networking performance. As a member of the HPC Networking Team, some of the responsibilities you will have in this opportunity include:

  • Monitoring: Consistently monitoring the performance and overall health of InfiniBand fabrics, which includes network switches, host adapters, and nodes. This responsibility entails utilizing existing monitoring tools and potentially developing new ones to ensure comprehensive visibility and timely detection of any issues or abnormalities.
  • Troubleshooting: Skillfully investigating and resolving various issues that may arise within InfiniBand fabrics. This involves diagnosing network connectivity problems, identifying and resolving performance bottlenecks, and effectively addressing any errors or failures within the fabric components.
  • Support: Provide assistance and collaboration to other teams involved in the management and operation of HPC clusters utilizing InfiniBand technology. This includes offering expertise, guidance, and troubleshooting support to ensure the smooth functioning and optimal performance of the clusters.
  • Deploy and Bringup: Help with installation of large fabrics, organizing and work with teams to bring up fabrics from day 0 to operational fabrics together with onsite personnel and customers.
  • Operations/Configuration: Work with configuration tooling, operations teams to carry out maintenance and upgrades of switches and the control plane of the fabrics.

Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk. 

  • Proficient in InfiniBand configuration and management.
  • Solid understanding of network architectures, topologies, best practices, and techniques for high performance and availability.
  • Familiarity with optical networking hardware.
  • Experience in Linux system administration.
  • Proficiency in at least one scripting language.
  • Team player with effective collaboration skills.
  • Ability to manage multiple tasks and projects concurrently.

Preferred Skills:

  • Hands-on experience with Nvidia UFM.
  • Familiarity working with SLURM job scheduler.
  • Experience or familiarity with Grafana for monitoring and visualization.
  • Insight into HPC systems architecture and operational workflows.
  • Familiarity with various MPI implementations.
  • Experience with automation and configuration management tools such as ansible.
  • Acquaintance with open-source technologies pertinent to HPC administration, including resource management, storage systems, monitoring infrastructure, software deployment, and continuous integration.

 

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $160,000-$210,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Hybrid Workplace

Successful candidates will be expected to attend onboarding training at our NJ Headquarters within their first several weeks of employment, with subsequent quarterly travel requirements of 1 week duration.

If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.

Why CoreWeave?

At CoreWeave, we work hard, have fun, and move fast!  We’re in an exciting stage of hyper-growth that you will not want to miss out on. We’re not afraid of a little chaos, and we’re constantly learning. Our team cares deeply about how we build our product and how we work together, which is represented through our core values: 

  • Be Curious at your Core
  • Act like an Owner
  • Empower Employees
  • Deliver Best In-Class Client Experience 
  • Achieve More Together

We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for take off, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us! 

Benefits

We offer a competitive salary and benefits, including:

  • Medical, dental and vision insurance - 100% paid for the employee
  • Company paid Life Insurance 
  • Voluntary supplemental life insurance 
  • Short and long-term disability insurance 
  • Flexible Spending Account
  • Tuition Reimbursement 
  • Mental Wellness Benefits through Spring Health 
  • Family-Forming support provided by Carrot
  • Paid Parental Leave 
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our offices
  • Weekly massages in NJ office
  • A casual work environment
  • Work culture focused on innovative disruption

California Consumer Privacy Act - California applicants only

CoreWeave is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age.