**RH**:Raul García
**Position**:GCP Data Engineer
**Location**:Aguascalientes, Mexico
**Industry - Sector**:MALS
**What you'll do?**
- Build, maintain, and optimize end-to-end ETL pipelines using Google Cloud Dataflow, Apache Beam, Cloud Composer, and Cloud Functions.
- Automate data ingestion, transformation, and integration processes from multiple sources (structured and unstructured data) into cloud-based data platforms.
- Design and implement scalable cloud-based data architectures using services like Google BigQuery, Google Cloud Storage (GCS), Cloud Pub/Sub, and Cloud Dataproc.
- Architect data solutions that are reliable, performant, and cost-effective for large-scale data processing and storage needs.
- Build and manage data lakes using Google Cloud Storage and ensure data is properly ingested, stored, and processed in an organized and secure manner.
- Implement Google BigQuery data warehouses, optimize data models for performance, and ensure they are scalable to handle large datasets.
- Leverage Google Cloud Dataflow or Apache Beam to transform data into formats suitable for reporting and machine learning models.
- Integrate diverse data sources such as relational databases, NoSQL databases, APIs, and flat files into the data pipeline architecture.
- Automate the deployment of data pipelines, processes, and infrastructure using Google Cloud Deployment Manager, Terraform, or Cloud Composer.
- Design and manage CI/CD pipelines for efficient deployment of data engineering solutions.
- Implement best practices for data governance, ensuring data privacy and compliance with security standards (e.g., encryption, data masking, and access control).
- Manage permissions and security with Google IAM, and ensure that sensitive data is securely handled and stored.
- Continuously monitor the performance of data pipelines and storage solutions, identifying opportunities for optimization and cost reduction.
- Troubleshoot and resolve data integration and pipeline issues to ensure smooth and efficient data processing.
- Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to understand data requirements and deliver high-quality data solutions.
- Provide support for data-related questions, troubleshooting, and assist with data visualization and reporting tasks.
- Document data engineering processes, including pipeline architectures, configurations, and best practices.
- Prepare and deliver regular updates on data engineering projects and their progress.
**What you'll bring**:
- Expertise in Google Cloud BigQuery, Google Cloud Storage (GCS), Cloud Dataflow, Cloud Pub/Sub, Google Cloud Dataproc, Cloud Composer, Cloud Functions, and Cloud Bigtable.
- Experience in building ETL pipelines using Cloud Dataflow, Apache Beam, Google Cloud
- Ability to integrate structured and unstructured data sources into cloud-based systems.
- Strong experience working with Google BigQuery for building and managing data warehouses and running optimized analytical queries.
- Expertise in data ingestion, transformation, and integration using GCP tools, including Google Cloud Pub/Sub, Cloud Dataflow, and BigQuery.
- Proficiency in Python, SQL, and JavaScript for data engineering tasks, scripting, and automation.
- Experience with Apache Spark and PySpark is a plus for handling large-scale data processing.
- Experience with Google Cloud Deployment Manager, Terraform, or Cloud Composer to automate infrastructure and data pipelines.
- Strong understanding of Google IAM, data encryption, and secure data access practices.
- Proficiency in Git for version control and collaborative development.
**Soft skills**:
Work Underpressure, Quality at work, Results Oriented
**What can YOU expect in a career with Capgemini?**
- Working in a team environment, Consultants will focus on the analysis, design and development of technology-based solutions for Capgemini's clients.
- You will work alongside technical, functional and industry specialists to assist with the development, implementation and integration of innovative system solutions including methods, techniques and tools.
- You will contribute to client satisfaction by providing timely and responsive value-added services and work products.
- Capgemini offers a competitive compensation and benefits package.
- Headquartered in Paris, France, Capgemini has a presence of more than 340 thousand professionals in Mexico distributed among 3 sites located in Mexico City, Monterrey and Aguascalientes. A deeply multicultural organization.
- Capgemini has developed its own way of working, the Collaborative Business ExperienceTM, and draws on Rightshore, its worldwide delivery model.
**You will love this job because**
- Capgemini focuses on giving each new hire a YOU-nique experience through our recruitment process and on-boarding program, as well as by helping you to build your own career and professional skills foundation.
- Capgemini provides a collaborative environm