Engineering Manager

Who you are

• 7+ years of software engineering experience, including 2+ years directly managing engineers, ideally at a high-growth startup
• A record of building high-performing distributed teams and helping them scale quickly while maintaining a good culture
• Experience with building and managing teams across geographic locations, preferably in US and India
• Ability to keep a high hiring bar, motivate the team, coach and mentor engineers, and handle performance management issues
• Deep technical knowledge of distributed systems and data-intensive systems, such as data processing engines, query engines, or database internals
• Enough hands-on depth in Python and performance-sensitive systems code to review designs and work through performance and stability problems alongside the team
• A great track record of execution, with a sense of urgency and excellent prioritization skills
• Effective written and verbal communication with engineers, customers, and an open source community
• Experience leading or maintaining a widely used open source project, including working with external contributors and project governance
• Hands-on experience with Ray, Spark, Flink, Beam or similar engines
• Experience with Apache Arrow, columnar formats, or table formats such as Iceberg and Delta Lake
• Experience with GPU workloads, LLM or multimodal batch inference, or data loading for large-scale model training
• Experience operating data or ML infrastructure in production What the job involves
• Anyscale is looking for an engineering leader to manage the open source Ray Data team. Ray Data is the Python-native data processing engine for AI workloads on Ray. It handles multimodal and structured data and powers batch inference, data loading for distributed training, and large-scale preprocessing. The team owns the open source library end to end, including:
• The streaming execution engine, including scheduling, backpressure, and resource management across CPUs and GPUs
• Batch inference for LLMs and multimodal models, including integrations with inference engines such as vLLM
• Data loading for production training workloads with Ray Train and popular ML frameworks
• Connectors for data sources and formats such as Parquet, Iceberg, Delta Lake, Lance, and cloud object storage
• Performance, stability, and fault tolerance at large scale
• This is a first-line engineering management role where you'll lead a team of engineers, stay involved in technical design and code, and own the team's roadmap within the open source project. Ray Data has a large and active community, so you'll also work closely with external contributors to review designs, guide technical direction, and support the project's continued growth and success. The team plays an important role in the broader Ray ecosystem and contributes directly to Anyscale's success
• Set the technical direction and roadmap for open source Ray Data, balancing community needs, customer needs, and Anyscale's product goals
• Drive execution of the team's key projects, from design review through release
• Hire, coach, and grow a world-class team of distributed systems and data infrastructure engineers
• Run the team day to day: planning, prioritization, project tracking, on-call, and release quality
• Stay technically hands-on through design and code review, performance investigations, and escalations on critical production issues
• Represent Ray Data in the open source community: work with external contributors and maintainers, review Ray Enhancement Proposals, keep GitHub issue and PR triage healthy, and grow the contributor base
• Partner with the Ray Core, Ray Train, Ray Serve, and Anyscale platform teams on cross-library features and end-to-end performance
• Work with product management, field engineering, and customers, including AI-native companies running Ray Data at large scale, to understand their workloads and turn them into roadmap priorities
• Build and maintain a team culture of collaboration, ownership, and high engineering standards
• Communicate the team's work to a broader audience through talks, tutorials, blog posts, and at Ray Summit
• Help us build and shape a world-class company Benefits
• Health, Vision, and Dental Care: We offer a wide range of health, dental, and vision coverage options for you and your family—including many plans that are 99% covered by Anyscale
• Fertility Benefits & Paid Parental Leave: Anyscalers can access fertility benefits through Kindbody. Team members can take advantage of 12 weeks of paid leave following the arrival of a new little one.
• Flexible Time Off: We believe all team members should be able to rest up and recharge when needed, which is why we’ve embraced a flexible time off policy at Anyscale.
• Learning & Wellness Stipend: We believe in investing in our 1 asset: our people. We offer a monthly learning and wellness stipend so employees can better themselves at work or pursue personal interests.
• In-Office Meals: Lunch is served everyday in our San Francisco and Palo Alto Offices. Dinner, too, if you’re ever working late. And did we mention boba runs?
• Commute Reimbursement: Whether you’re hopping on public transit or driving yourself to work, Anyscale covers a portion of your commuting costs each month.
• Paid Volunteer Time Off: Give back to the causes and communities you love with paid time off specifically for volunteer work.
• Mental Health Benefits: All Anyscalers can take advantage of included mental health benefits through our Headspace offering.