Senior Data EngineerAre you a Data Engineer with a passion for working with cutting-edge technologies? If you thrive on collaboration, innovation, and using data to solve complex problems, this role is for you!Your Mission:Enhancing and developing PySpark scripts running on AWS EMR on EKS, as well as updating and optimizing existing Lambda API scripts using Python.Collaborate closely with the team to analyze data and generate insights that drive business outcomes.Contribute to the ongoing support and development of two live data models: Customer Frustration Score (algorithm-driven via PySpark) and Predictive Intent (ML-based with data from DynamoDB and Opensearch, delivered via Lambda).Potentially get involved in Tableau development for data quality dashboards and gain exposure to Machine Learning (ML) and Large Language Models (LLM).Work in an agile team of four, regularly communicating via JIRA and reporting up to a client manager to ensure smooth collaboration and delivery.Be hands-on in continuing the iterative development of the Predictive Intent and Customer Frustration Score models to enhance their performance and capabilities.What You'll Need to Succeed:Expertise in AWS services like EMR, Lambda, DynamoDB, Athena, OpenSearch, and Elasticache.Proficiency in Python and PySpark for data processing and API optimization.Familiarity with tools like SageMaker for ML-related tasks and Tableau for data visualization (a plus, but not required).Strong understanding of agile development, with experience using JIRA for team communication and task management.Experience with Lambda function optimization and data-driven solutions using DynamoDB and OpenSearch.Additional Details:Location: Anywhere in Mexico (remote work from home)Eligibility: Only fluent English speakers and legal residents/locals can be considered (directly hired as a fulltime employee).Contract Type: Direct hire, indefinite contractBenefits:Aguinaldo & Vacations: By LawGrocery Vouchers (Vales de Despensa)Life InsuranceMajor Medical Insurance: Individual coverageReady to take your data engineering skills to the next level? Let's make it happen!#J-18808-Ljbffr