.
**BAT is evolving at pace - truly like no other organisation.
****To achieve the ambition, we have set for ourselves, we are looking for colleagues who are ready to live our ethos every day.
Come be a part of this journey!
****BAT MEXICO** **IS LOOKING FOR A** **DATA ENGINEER (DATABRICKS / PYSPARK)****SENIORITY LEVEL**:Junior Level**FUNCTION**: Digital Business Solution**LOCATION**:Monterrey**ROLE POSITIONING AND OBJECTIVES**This role belongs to the DBS function.The role is accountable for support the US team in data integration, data architecture and process optimization tasks*****Reports to**:Data Engineer Lead**Reporting Level**:Managerial**Geographic Scope**:US**WHAT YOU WILL BE ACCOUNTABLE FOR**- Implement data ingestion pipelines from multiple data sources using Databricks and PySpark, ensuring the quality and consistency of data.- Develop Big Data and non-Big Data cloud-based enterprise solutions in PySpark, SQL and related frameworks/libraries.- Understand Data Architecture concepts.- Processing performance analysis and optimization.- Bringing standard methodologies in the following areas: Design & Analysis, Automation, Testing, Monitoring, Documentation.- Coordinates issue resolution with multi-functional teams and vendors.- Assists the project manager by assisting sharing work plans, effort estimates and delivery timelines for work you're doing.
**CAN THIS BE YOUR FUTURE ROLE?
**- Are you willing to develop your career in a fast-paced global company?
**ESSENTIAL EXPERIENCE, SKILLS AND KNOWLEDGE**- Bachelor's Degree or equivalent experience in Computer Science/Engineering.- +2 years working experience.- Experience with partners and requirements gathering/implementation.- Experience with Python and Pandas.- Experience developing extract, transform, load (ETL) pipelines using PySpark and Cloud Storage (AWS S3 preferred).- Experience with Databricks.- Experience with Cloud technologies - Azure, AWS, GCP, Teradata, Snowflake (preferably AWS).- Experience Control-Versioning coding such as Git.- Sophisticated English - Verbal and written**BENEFICIAL**- **Shown background with Databricks or equivalent experience in: Workflows.
** **Widgets,** **MachineLearning (MLFlow), **SQL Warehousing / Delta tables, **Unity Catalog, **Worker/Driver Logs analysis).
**:- ** Experience with AWS Redshift, Teradata, Snowflake and orchestration toolsets (e.G.
Airflow, Tidal).
**:- ** Professionalize the full pipeline including distributed Machine Learning models and ETL workflows (e.G., training/test pipeline).
****WE ARE BAT**At BAT we are committed to our Purpose of creating A Better Tomorrow.
This is what drives our people and our passion for innovation.
**See what is possible for you at BAT