Fullstack Aws Data Engineer

Detalles de la oferta

.**RH**:Raul García**Position**:Fullstack Azure Data Engineer**Location**:Aguascalientes, Mexico**Industry - Sector**:MALS**What you'll do?**- Build, optimize, and maintain scalable data pipelines to process large datasets from various sources using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.- Implement ETL (Extract, Transform, Load) processes to integrate and transform data for analytical and operational purposes.- Design and implement cloud-based data architectures using Azure SQL Database, Azure Data Lake Storage, Azure Blob Storage, and Azure Synapse Analytics.- Build and manage data lakes, data warehouses, and data marts to enable seamless data flow and storage.- Develop and maintain backend systems that handle data processing, storage, and retrieval with technologies such as Python, Spark, SQL, and Azure Data Factory.- Ensure data consistency, quality, and reliability across multiple systems and services.- Create user-friendly data interfaces and reports for business users, ensuring that data insights are accessible and actionable.- Work with both relational and non-relational databases on Azure, including Azure SQL Database, Cosmos DB, and Azure Data Warehouse.- Optimize and tune databases for performance, including query optimization, indexing, and partitioning.- Automate data workflows and deployment pipelines using Azure DevOps, Terraform, or similar infrastructure-as-code tools.- Implement CI/CD (Continuous Integration/Continuous Deployment) processes for data systems and analytics solutions.- Implement best practices for data security, including encryption, role-based access control (RBAC), and data masking.- Ensure compliance with data governance policies and standards, ensuring the data is clean, accurate, and available.- Work closely with data scientists, analysts, and business stakeholders to understand data needs and provide solutions.- Provide technical leadership and mentorship to junior team members, helping them grow their skills in cloud data engineering.- Monitor and optimize the performance of data systems, ensuring high availability and scalability.- Troubleshoot and resolve issues related to data integration, transformation, and reporting.**What you'll bring**:- In-depth experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Azure Blob Storage, Azure Data Lake, and Azure Data Warehouse.- Proficiency in Python or Scala for data engineering and automation tasks.- Strong SQL skills for data querying, data transformation, and performance tuning.- Experience building ETL pipelines using Azure Data Factory, Azure Databricks, or SQL Server Integration Services (SSIS).- Knowledge of batch and streaming data processing techniques using tools like Apache Spark, Azure Stream Analytics, or Apache Kafka.- Strong understanding of data warehousing and data lake architectures, and experience implementing these solutions on Azure Synapse or Azure Data Lake


Salario Nominal: A convenir

Fuente: Jobtome_Ppc

Requisitos

Hr Training And Development Specialist (Temporary)

TasksThe HR Location Specialist deploys, implements and manages HR policies, procedures, standards and initiatives in an efficient and standardized way for t...


Continental Ag - Aguascalientes

Publicado 14 days ago

Integration & Projects Specialist

Dreaming big is in our DNA. Brewing the world's most loved beers and creating meaningful experiences is what inspires us. We are owners, empowered to lead re...


Grupo Modelo - Aguascalientes

Publicado 14 days ago

Colaborador. Quesero Artesanal (Cubre Incapacidad)

*Asegurar proceso institucional de tiempos y movimientos de Pasta Hilada *Realizar órdenes de compra y recibo de mercancía, *Asegurar proceso Institucional...


Tiendas Chedraui S.A De C. V. - Aguascalientes

Publicado 14 days ago

Full Stack Data Engineers With Pbi+Adf Experience

**RH**:Héctor Hernández **Position**:Salesforce Functional Analyst **Location**:any state of Mexico **Industry - Sector**:SAP **What you'll do?** Key re...


Capgemini - Aguascalientes

Publicado 14 days ago

Built at: 2024-12-23T10:35:04.000Z