Cbsm - Cosmosdb Sql Engineer

Work Experience

At least 5 years of experience of data solutions using Azure cloud platform.
Solid programming skills in Python and proficiency using libraries Panda, NumPy, SciPy, Matplotlib, Scrappy, Beautiful soup, etc.
Solid understand of spark architecture and experience with performance tuning Big Data workloads in spark.
Building complex data transformations on both structured and semi-structured data (XML/JSON) using PySpark & SQL, refactoring tradition ML model to run on spark framework.
Familiarity with Azure Databricks environment and deploying spark code databricks cluster.
Good understanding of No SQL and its use case, Modelling No SQL schemas & containers, building integration to read/write to Azure Cosmos SQL API.
Experience building complex orchestrations using tools like ADF, airflow, etc.
Good understanding of Massive Parallel Processing (MPP) systems with strong SQL skills.
Proficient with source control using GIT.
Good understanding of Agile, DevOps and CI-CD automated deployment (e.g., Azure DevOps, Jenkins).
Familiarity with Cognitive Search/Elastic search and its use cases & building integrations to load data to Search Services.
Azure data certification of DP-200/201/203 or Databricks developer certifications will be an advantage.