Senior Engineer, Data Platforms
CoreWeave is a specialized cloud provider focused on GPU accelerated use cases including VFX, AI/ML, Batch Processing and Real Time Experiences. We support countless AI/ML services in the text to image, NLP and broader AI/ML space, reducing client’s infrastructure management requirements with our Kubernetes based serverless GPU cloud offerings.
Job Description
About the role:
The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for CoreWeave. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.
We are seeking a senior engineer with specialization in data platforms and stream processing who can help us fulfill the goal of our multi-regional datastore strategy and establish communication models for our data flow. This individual will work with a team of 6-8 mixed skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment. As a member of the Data Platforms Team you will have the opportunity to:
- Identify and develop applications for the organization's data. This involves understanding business needs and creating solutions that leverage data effectively.
- Design and implement the platform to deliver data to teams with a focus on providing managed solutions.
- Participate in operations and scaling of relational data platforms.
- Develop a stream processing architecture and solve for scalability and reliability.
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
- Establish guidelines, guard rails for data access and storage for stakeholder teams.
- Ensure compliance with standards for data protection regulation.
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.
Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk.
- You have six or more years of experience in a software or infrastructure engineering industry.
- You enjoy helping your colleagues achieve more with less effort.
- You have experience operating services in production and at scale and are versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
- You understand data consistency and concurrency models, can clearly define data models and establish guidelines around data management.
- You’re excited about new research in data structures.
- You’re familiar with distributed NewSQL datastores such as CockroachDB, TiDB, YDB, Yugabyte and/or stream processing tools such as NATS or Kafka.
- You have experience with designing and operating these systems at scale.
- You’re familiar with Kubernetes and have interest or experience with using it for event-driven and/or stateful orchestration.
- You’re excited to have the opportunity to contribute to a Kubernetes operator in order to manage data systems.
- You know your way around a Linux distro, shell scripting, and the Linux storage and networking stacks.
- You can transform problems in elastic solutions, decompose them into achievable tasks, and socialize both to your teammates.
- You have a proficiency in go, python, java, and/or C and you’re interested in contributing to open source.
- You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $175,000 - $210,000 annually. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
About the role:
The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for CoreWeave. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.
We are seeking a senior engineer with specialization in data platforms and stream processing who can help us fulfill the goal of our multi-regional datastore strategy and establish communication models for our data flow. This individual will work with a team of 6-8 mixed skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment. As a member of the Data Platforms Team you will have the opportunity to:
- Identify and develop applications for the organization's data. This involves understanding business needs and creating solutions that leverage data effectively.
- Design and implement the platform to deliver data to teams with a focus on providing managed solutions.
- Participate in operations and scaling of relational data platforms.
- Develop a stream processing architecture and solve for scalability and reliability.
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
- Establish guidelines, guard rails for data access and storage for stakeholder teams.
- Ensure compliance with standards for data protection regulation.
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.
Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk.
- You have six or more years of experience in a software or infrastructure engineering industry.
- You enjoy helping your colleagues achieve more with less effort.
- You have experience operating services in production and at scale and are versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
- You understand data consistency and concurrency models, can clearly define data models and establish guidelines around data management.
- You’re excited about new research in data structures.
- You’re familiar with distributed NewSQL datastores such as CockroachDB, TiDB, YDB, Yugabyte and/or stream processing tools such as NATS or Kafka.
- You have experience with designing and operating these systems at scale.
- You’re familiar with Kubernetes and have interest or experience with using it for event-driven and/or stateful orchestration.
- You’re excited to have the opportunity to contribute to a Kubernetes operator in order to manage data systems.
- You know your way around a Linux distro, shell scripting, and the Linux storage and networking stacks.
- You can transform problems in elastic solutions, decompose them into achievable tasks, and socialize both to your teammates.
- You have a proficiency in go, python, java, and/or C and you’re interested in contributing to open source.
- You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $175,000 - $210,000 annually. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
