Azure Data Lake Specialist

Detalles de la oferta

.Req ID: 123554 Remote Position: Hybrid Region: Americas Country: Mexico State/Province: Nuevo Leon City: Monterrey General Overview Functional Area: Information Technology (ITM) Career Stream: IT Solutions (SOLN) Role: Specialist (SPE) Job Title: Specialist, IT Solutions Job Code: SPE-ITM-SOLN Job Level: Band8 Direct/Indirect Indicator: Indirect Summary The successful candidate is an experienced Data Lake developer with expertise in SQL and Python for Jupyter Notebooks, and has the ability to transform large volumes of data following the principles of ETL. The ideal candidate is a motivated self-starter with excellent programming/debugging skills, strong communication skills with the ability to collaborate with stakeholders to refine business requirements and translate into a detailed technical specification. This role requires strong programming skills, particularly in Python, and loads data from different sources including Azure Storage Accounts, Flat Files, API, SQL DB, etc. Detailed Description Performs tasks such as, but not limited to, the following: Advanced Microsoft SQL, Azure Synapse or Azure Data Factory skills, including proficiency with: Stored procedure and trigger development, schema management, and execution plan optimization. Capable of constructing resilient data integration processes with an emphasis on data quality management and failure-response planning. Expertise in ETL principles. Experience extracting data from heterogeneous sources, including databases, CRM systems, flat file, web services, storage accounts, etc. Experience transforming the extracted data involving cleaning, aggregating, mapping, and converting it to ensure it meets the business requirements and is in a suitable format for analysis. Experience loading the transformed data into a target database, data warehouse, or data lake, making it accessible for querying and analysis. Experience integrating Azure Data Factory patterns, processes, components, security, linked services, datasets, activities and pipelines, and integration runtimes. Maintain documentation of software architecture, processes, and code. Strong communication skills. Able to work with stakeholders and customers to come up with requirements, sizing. Knowledge/Skills/Competencies Python: Write clean, scalable, and maintainable code following best practices. Knowledge of scripting, Forms and web services is an added advantage. Pandas, NumPy: Data manipulation and analysis. SQL: Ability to extract, transform, and load (ETL) data from relational databases. Other: Familiarity with Azure Datalake (Synapse Workspace). Experience with TFS, GIT, Azure DevOps or any other source control system. Excellent communication skills for explaining technical complexities. Ability to work in a collaborative, cross-functional environment. Skill in managing data projects independently. Abstract Thinking: Advanced problem-solving abilities


Salario Nominal: A convenir

Fuente: Jobtome_Ppc

Requisitos

Euc Digital Employee Experience (Dex) Engineer

EUC Digital Employee Experience (DEX) EngineerDate: Oct 30, 2024 Company: Corning Corning is vital to progress – in the industries we help shape and in the ...


Corning Inc. - Nuevo León

Publicado 8 days ago

Jr. Network Security Engineer

Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our s...


Corning Inc. - Nuevo León

Publicado 8 days ago

System Engineer - Csp (Storage)

We are Lenovo. We do what we say. We own what we do. We WOW our customers. Lenovo is a US$57 billion revenue global technology powerhouse, ranked #248 in the...


Lenovo - Nuevo León

Publicado 8 days ago

Euc Apple/Mac Platform Engineer

Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our s...


Corning Inc. - Nuevo León

Publicado 8 days ago

Built at: 2024-11-13T11:24:29.684Z