Azure Databricks Software Engineer

.**DESCRIPTION**:Join EPAM as a **Senior Data Engineer specializing in Azure Databricks.**In this role, you'll focus on building a metadata-driven framework for the transformation layer in Azure Databricks and migrating existing jobs to it.If you have hands-on coding experience with Databricks Jobs using Python and PySpark, experience in Azure cloud data platform, and excellent problem-solving skills, we'd love to hear from you.EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.RESPONSIBILITIES- Re-engineer existing Databricks jobs to improve efficiency and performance- Build a configuration/metadata-driven framework for data transformation and orchestration- Implement and orchestrate Databricks Jobs- Develop and implement a Data Ingestion Framework, identifying patterns for initial and incremental data loads- Document all data engineering processes and frameworks for knowledge sharing and future reference- Reverse-engineer and troubleshoot existing jobs- Handle Ad-Hoc L3/L4 Client Support Requests, including issue troubleshooting and bug fixing