Description

The CloudTune team within Amazon's Intelligent Cloud Control organization is seeking an expert Data Engineer to build and operate the data foundation that powers our end-to-end automation vision. Our goal is to invent new software and data systems that remove human decision-making from SDO’s scaling and cost controllership processes across Amazon's entire retail and digital businesses.

As a Data Engineer in CloudTune, you will be working with an extremely large, complex, and dynamic data environment that integrates capacity, traffic forecasting, and financial data. You will be responsible for designing, implementing, and operating stable, scalable, and low-cost solutions to flow massive datasets from production systems into our analytical and machine learning platforms. This work directly enables the ML models and control systems that provision Amazon’s services optimally for availability, customer experience, and cost—creating an enormous impact on company-wide efficiency. You should be passionate about leveraging huge data sets to drive sophisticated, algorithmic automation.

Key job responsibilities
Design, implement, and support a scalable platform providing high-integrity, ad-hoc access to petabyte-scale capacity and financial datasets.

Build robust, automated, and fault-tolerant data integration (ETL/ELT) pipelines using SQL, Python, and AWS services (e.g., Redshift, Glue, S3, EMR).

Interface with Data Scientists and Software Engineers to define and build the data structures necessary to train and deploy advanced machine learning models for forecasting and optimization.

Implement data structures and modeling best practices to simplify, enhance the accessibility, and improve the usability of complex, heterogeneous datasets.

Continually improve ongoing data processes, automating or simplifying self-service support for engineers and scientists.

About the team
CloudTune is part of Amazon's Intelligent Cloud Control organization, dedicated to inventing software systems that remove human decision-making from SDO’s scaling and infrastructure spend planning. Our core mission is to drive end-to-end automation to provision Amazon's services—optimizing simultaneously for a great customer experience, high availability, and reduced cost. The solutions we build eliminate vast quantities of undifferentiated and tedious work, creating an enormous impact for tens of thousands of Amazon developers across the company. We are a high-leverage team focused on innovative, large-scale systems that define the future of Amazon's growth and efficiency.