Data Engineer, WW Promotions Data and Insights
Amazon
Description
Are you passionate about developing the next generation of data infrastructure capable of handling complex, mission-critical data pipelines and analytics workloads? Do you want to build next generation data engineering solutions that leverage the latest AWS technologies to process a broad range of business and customer data?
Join our WW Promotions Data and Insights team, where you'll have the opportunity to continuously improve the systems that enable Amazon's promotional strategies across every major shopping event worldwide.
Key job responsibilities
1. Design, build, and operate highly scalable, fault-tolerant data processing systems using modern AWS services like Redshift, S3, Glue, EMR, Kinesis, and Lambda, and orchestration systems using Airflow
2. Leverage your expertise in Python, Scala, or other modern programming languages to develop custom data processing frameworks and automation tools
3. Collaborate closely with data scientists, analysts, and product managers to understand business requirements and translate them into technical solutions
4. Continuously optimize data pipeline performance, reliability, and cost-efficiency using best practices in CI/CD and infrastructure-as-code
5. Mentor junior engineers and share your knowledge of data engineering best practices
6. Stay up-to-date with the latest big data technologies and architectural patterns, and drive the adoption of innovative solutions
A day in the life
You will:
1. Identify key areas of concerns/limitations with current architecture and build next generation frameworks and systems that enable data teams to deliver on future needs
2. Build automated data quality monitoring, audit and reconciliation mechanisms
3. Develop and maintain core infrastructure and services for multiple data engineering teams
4. Improve efficiency of operations in terms of cost, effort and reliability
About the team
Promotions reinforce a positive perception of Amazon’s price leadership with shoppers by complementing our everyday great prices with time-bound discounts on a broad selection of high-quality products. For Selling Partners (SPs), promotions create incremental demand for their products and increase their share of voice, clear inventory, and drive traffic to new selection. WW Promotions owns the sourcing and execution of promotions at Amazon and we are their data & analytics team. We serve as the central stewards of promotions data, delivering trusted and governed datasets that power product development, machine learning models, and business analytics across the organization.