HPC Network Engineer, InfiniBand

CoreWeave is a specialized cloud provider, delivering a massive scale of GPU compute resources on top of the industry’s fastest and most flexible infrastructure. CoreWeave builds cloud solutions for compute intensive use cases — VFX and rendering, machine learning and AI, batch processing, and Pixel Streaming — that are up to 35 times faster and 80% less expensive than the large, generalized public clouds. Learn more at www.coreweave.com.

About the Role:

CoreWeave is seeking a highly skilled and motivated HPC Network Engineer to join our fast growing team. In this role, you will play a crucial part in the development, support, and optimization of our HPC networking performance. As a member of the HPC Networking Team, some of the responsibilities you will have in this opportunity include:

• Monitoring: Consistently monitoring the performance and overall health of InfiniBand fabrics, which includes network switches, host adapters, and nodes. This responsibility entails utilizing existing monitoring tools and potentially developing new ones to ensure comprehensive visibility and timely detection of any issues or abnormalities.
• Troubleshooting: Skillfully investigating and resolving various issues that may arise within InfiniBand fabrics. This involves diagnosing network connectivity problems, identifying and resolving performance bottlenecks, and effectively addressing any errors or failures within the fabric components.
• Support: Provide assistance and collaboration to other teams involved in the management and operation of HPC clusters utilizing InfiniBand technology. This includes offering expertise, guidance, and troubleshooting support to ensure the smooth functioning and optimal performance of the clusters.
• Deploy and Bringup: Help with installation of large fabrics, organizing and work with teams to bring up fabrics from day 0 to operational fabrics together with onsite personnel and customers.
• Operations/Configuration: Work with configuration tooling, operations teams to carry out maintenance and upgrades of switches and the control plane of the fabrics.

Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk. 

• Proficient in InfiniBand configuration and management.
• Solid understanding of network architectures, topologies, best practices, and techniques for high performance and availability.
• Familiarity with optical networking hardware.
• Experience in Linux system administration.
• Proficiency in at least one scripting language.
• Team player with effective collaboration skills.
• Ability to manage multiple tasks and projects concurrently.

Preferred Skills:

• Hands-on experience with Nvidia UFM.
• Familiarity working with SLURM job scheduler.
• Experience or familiarity with Grafana for monitoring and visualization.
• Insight into HPC systems architecture and operational workflows.
• Familiarity with various MPI implementations.
• Experience with automation and configuration management tools such as ansible.
• Acquaintance with open-source technologies pertinent to HPC administration, including resource management, storage systems, monitoring infrastructure, software deployment, and continuous integration.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $160,000-$210,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.