
Job Information
Amazon Software Development Engineer, Business Data Technologies (BDT) Ray Distributed Compute Team in Seattle, Washington
Description
Amazon is seeing a Software Development Engineer to work on the internal usage of and open source contribution to the Ray AI/ML distributed compute framework, and the DeltaCAT open source data catalog library on the Business Data Technologies (BDT) Ray Distributed Compute team.
The Ray team owns the DeltaCAT library, which leverages open source projects in Apache Iceberg and Daft to enable developers to define and manage fast, scalable, ACID-compliant multi-modal data lakes, and has been used to successfully manage exabyte-scale enterprise data lakes.
The Ray team has a strategic initiative support to prototype and demonstrate a managed compute service offering for the Ray distributed compute framework, and has partnered with teams across Amazon, UC Berkeley, and AnyScale to drive required improvements to the Ray open source project to achieve this outcome. The outcome of this initiative will include enhanced AWS service integrations with Ray, bug fixes, and other improvements required to run Ray at scale in production Amazon services. The Ray team will publish wheels and images to both internal and external customers running Ray with Amazon. Our software is foundational and is in use by teams at Amazon. Your role will be to add new features, optimize performance, and ensure Ray and DeltaCAT meets the future needs of our customers. If you are interested in this unique opportunity and making a difference, come join our team. We’ve been waiting for you!
You can learn more at:
https://github.com/ray-project/ray
https://github.com/ray-project/deltacat
https://github.com/apache/arrow
https://github.com/Eventual-Inc/Daft
https://aws.amazon.com/blogs/opensource/amazons-exabyte-scale-migration-from-apache-spark-to-ray-on-amazon-ec2/
Key job responsibilities
A Software Development Engineer (SDE) is expected to design and implement software components while successfully solving difficult problems in open source. An SDE on the Ray team should have the ability to deep dive into novel problems associated with open source software and its dependencies to design, implement, and deliver code that satisfies the requirements of the open source community, while balancing the business needs of Amazon.
A SDE is responsible for continuous improvement in operational excellence. A SDE on the Ray team should have a strong focus on quality and operational excellence while balancing the needs of the business and understanding the trade-offs required to prioritize delivery. A focus on quality is critical since minor logic errors or regressions can put the trust of open source users and internal users at risk. This focus should extend to both code reviews and design reviews for other SDEs on the team, and during deep dives on operational issues. Finally, a SDE has to show strong bias for action in delivering on time and work with Sr. SDEs and Software Development Managers (SDMs) to communicate the technical and quality trade-offs.
A SDE takes on projects that improves the current status quo, making them better and easier to maintain. The SDE challenges status quo and identifies improvement and deprecation opportunities for undifferentiated services. A SDE recognizes that the software life cycle must be enforced for the team to deliver results by deleting underutilized resources, addressing availability and security risks, simplifying complicated processes with automation and refactoring critical code paths.
A day in the life
As an Agile/Scrum team a SDE on the Ray team will typically:
Regularly Groom and Rank Order the Backlog
Estimate and Plan 2-Week Sprints
Participate in Bi-Weekly Retrospectives
While on-call a SDE on the Ray team will:
Mitigate and Resolve Customer Issues
Proactively Address Address Technical Debt
Document and Hand-Off Action Items and Follow-Ups to Peers
About the team
The Ray team are owners and maintainers of open source software, and work with industry partners to contribute to other open source projects. The team also owns internal software that leverages or integrates open source software, designing and building solutions to challenging and difficult business and technical problems for Amazon internal and external customers.
Basic Qualifications
3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits . This position will remain posted until filled. Applicants should apply via our internal or external career site.
Amazon
-
- Amazon Jobs