Systems Engineer, Performance
CoreWeave is a specialized cloud provider focused on GPU accelerated use cases including VFX, AI/ML, Batch Processing and Real Time Experiences. We support countless AI/ML services in the text to image, NLP and broader AI/ML space, reducing client’s infrastructure management requirements with our Kubernetes based serverless GPU cloud offerings.
Job Description
About the Role:
CoreWeave is seeking a highly skilled and motivated Systems Performance Engineer to join our Kernel HAVOCK Team, reporting into the Manager of Systems Engineering. In this role, you will play a crucial part in designing, developing, and optimizing our bare-metal systems from POST through joining a Kubernetes cluster. The team’s primary responsibilities include maintaining a custom Linux kernel, various OS images (Ubuntu-based), the virtualization stack (kubevirt/qemu/vfio), and the container/pod runtime stack (containerd/nydus/kubelet). You will collaborate closely with cross-functional teams, up stack engineering teams, and stakeholders to ensure our low-level software stack is performant in the context of hardware updates; and providing data, metrics, dashboards, and analysis to substantiate performance assertions.
Kernel Hardware - Acceleration - Virtualization - Operating Systems - Containerization - Kubelet
Our Team’s Stack:
- Python, Go, bash/sh, C
- Prometheus, Victoria Metrics, Grafana
- Linux Kernel (custom build), Ubuntu
- Intel/AMD/ARM CPUs, Nvidia GPUs, DPUs, Infiniband and Ethernet NICs
- Docker, kubernetes (k8s), KubeVirt, containerd, kubelet
Responsibilities:
- Develop and maintain tools for establishing systems performance baselines
- Develop and maintain performance regression analysis testing automation
- Development of telemetry for performance analysis across distributed clusters of servers
- Triage and fix performance issues in Linux
- Collect data, produce metrics and visualizations that communicate performance information compared to benchmarks; this data should lead to appropriate business decisions and toward greater automation that improves customer experience in relation to performance
- Collaborate with cross-functional teams to define Linux and OS requirements, specifications, and system architecture in relation to systems performance
Requirements:
- 5+ years of professional experience in Systems Performance Engineering
- Extensive, deep experience in Linux internals
- Fluency with a programming language geared toward automation (Python preferred, but others possible)
- Experience writing robust, testable code
- Experience diagnosing and fixing systems performance issues
- Experiencing with implementing automation testing
- Ability to effectively prioritize and communicate proposed features and fixes in a remote-employee environment
- Strong passion for automation, with a commitment to automating processes comprehensively
- Excellent documentation skills and attention to detail
- Strong analytical and problem-solving abilities
Nice-to-haves:
- Familiarity with QA/QE best practices
- Familiarity with Golang
- Opinions about software version control and team collaboration
- Experience working in Cloud environments
- Experience as a software engineer writing large-scale applications
- Experience in open-source community software development
- Experience with machine learning is a huge bonus
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $165,000-$185,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
Hybrid Workplace
Successful candidates will be expected to attend onboarding training at our NJ Headquarters within their first several weeks of employment, with subsequent quarterly travel requirements of 1 week duration.
If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.
About the Role:
CoreWeave is seeking a highly skilled and motivated Systems Performance Engineer to join our Kernel HAVOCK Team, reporting into the Manager of Systems Engineering. In this role, you will play a crucial part in designing, developing, and optimizing our bare-metal systems from POST through joining a Kubernetes cluster. The team’s primary responsibilities include maintaining a custom Linux kernel, various OS images (Ubuntu-based), the virtualization stack (kubevirt/qemu/vfio), and the container/pod runtime stack (containerd/nydus/kubelet). You will collaborate closely with cross-functional teams, up stack engineering teams, and stakeholders to ensure our low-level software stack is performant in the context of hardware updates; and providing data, metrics, dashboards, and analysis to substantiate performance assertions.
Kernel Hardware - Acceleration - Virtualization - Operating Systems - Containerization - Kubelet
Our Team’s Stack:
- Python, Go, bash/sh, C
- Prometheus, Victoria Metrics, Grafana
- Linux Kernel (custom build), Ubuntu
- Intel/AMD/ARM CPUs, Nvidia GPUs, DPUs, Infiniband and Ethernet NICs
- Docker, kubernetes (k8s), KubeVirt, containerd, kubelet
Responsibilities:
- Develop and maintain tools for establishing systems performance baselines
- Develop and maintain performance regression analysis testing automation
- Development of telemetry for performance analysis across distributed clusters of servers
- Triage and fix performance issues in Linux
- Collect data, produce metrics and visualizations that communicate performance information compared to benchmarks; this data should lead to appropriate business decisions and toward greater automation that improves customer experience in relation to performance
- Collaborate with cross-functional teams to define Linux and OS requirements, specifications, and system architecture in relation to systems performance
Requirements:
- 5+ years of professional experience in Systems Performance Engineering
- Extensive, deep experience in Linux internals
- Fluency with a programming language geared toward automation (Python preferred, but others possible)
- Experience writing robust, testable code
- Experience diagnosing and fixing systems performance issues
- Experiencing with implementing automation testing
- Ability to effectively prioritize and communicate proposed features and fixes in a remote-employee environment
- Strong passion for automation, with a commitment to automating processes comprehensively
- Excellent documentation skills and attention to detail
- Strong analytical and problem-solving abilities
Nice-to-haves:
- Familiarity with QA/QE best practices
- Familiarity with Golang
- Opinions about software version control and team collaboration
- Experience working in Cloud environments
- Experience as a software engineer writing large-scale applications
- Experience in open-source community software development
- Experience with machine learning is a huge bonus
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $165,000-$185,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
Hybrid Workplace
Successful candidates will be expected to attend onboarding training at our NJ Headquarters within their first several weeks of employment, with subsequent quarterly travel requirements of 1 week duration.
If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.
