1+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with at least one modern language such as Java, Python, C++, or C# including object-oriented design
We are seeking an ambitious Data Engineer to join our Metrics and Data Platform team. The Metrics and Data Platform team plays a critical role in enabling Amazon Music's business decisions and data-driven software development by collecting and providing behavioral and operational metrics to our internal teams. We maintain a scalable and robust data platform to support Amazon Music's rapid growth, and collaborate closely with data producers and data consumers to accelerate innovation using data.
As a Data Engineer, you will drive engineering and operational projects for the Metrics and Data Platform team. You will work with Product to understand top customer pain points and with our data engineering team to understand desired operational improvements. You will implement and own operational improvements and solutions as well as enhancements to key business datasets. You will model and build extensible and intuitive datasets for over 50 unique internal customers. Your datasets will directly inform leadership questions on customer engagement, determine external payments to music labels, and help drive product improvements to search, personalization, and more.
You are a talented, enthusiastic, and detail-oriented data engineer who wants to work on projects that require innovative thinking and deep technical problem solving. You have strong SQL skills and are familiar with common data modeling concepts. You value data-driven decision making and understand that the foundation of good decisions is good data. You write clear, professional documents accessible to both technical staff and stakeholders. You enjoy engaging in passionate discussions with smart people and letting the best ideas rise to the top. You see your mistakes as learning opportunities and continually look for ways to improve yourself, your team, and your products. You are a quick and willing learner of new technologies.
Key job responsibilities
- Writing high quality code/SQL and reviewing code/SQL across the team
- Ensuring timely delivery of assigned projects by proactively identifying risks and removing blockers
- Ability to dive deep, diagnose, and root cause bugs, bottlenecks, or inefficiencies
- Collaborating with product managers and software engineers/managers
- Clearly communicating project updates, verbally and in writing, to both technical and non-technical stakeholders and peers
About the team
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with data visualization software (e.g., AWS QuickSight or Tableau) or open-source project