.Company DescriptionBosch was founded in Stuttgart in 1886 by Robert Bosch (1861-1942) and for more than 130 years has been distinguished by a unique corporate culture based on solid values that drive us to improve every day. Our products, present in a wide variety of fields, that contribute to improve the quality of life of millions of people.**Job Description**:To work on development, monitoring and maintenance of Data pipelines across Business Unit clusters.**Primary responsibilities**:- Monitor and Maintain data pipeline for various AE plants.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.- Work with stakeholders including the Data officers and stewards to assist with data-related technical issues and support their data infrastructure needs.- Monitoring Pipelines for data availability- Reacting on file count and cluster health splunk alerts- Raising CI Tickets for Impala or any cloudera service issues- Troubleshooting issues raised in Incident first contact channel- Incident management in Azure ( keeping track of all incidents )- Taking part in pre-maintenance activity and post-maintenance activity- Routing of incidents and tracking them.- Work on incidents highlighted by the data officers.- Incident diagnosis, routing, evaluation & resolution.- Analyze the root cause of incidents.- Create incident closure report.**Qualifications**:- BE Degree in computer science or equivalent- ** Advanced english level**:- Min 3 years of Experience in Data management within the area of software development rollout and maintenance- Min 2 Years of specific** experience with data pipeline development, monitoring and maintenance****Key Competencies**:- Experience in developing data pipelines using **spark & scala.**:- Experience in debugging pipeline issues.- Experience in writing python and shell scripts.- In-Depth Knowledge of SQL and Other Database Solutions- Having a strong understanding of** Apache Hadoop-based analytics****Technical skills**:- Hands on experience on** **Spark sql and Spark streaming.- Hands on experience on Scala language.- In depth knowledge of SQL and NoSQL (HBase).- Good in writing **Shell and python script.**:- Good understanding of Hadoop ecosystem.- Hands on experience on **InteliJ, Github /Bitbucket, HUE.**:- Understanding of **ETL process.****Personal Skills**:- Good Communication Skills- Ability to use extensively the latest IT communication tools ( Skype /MS TEAMS etc.).Additional InformationBosch is constantly expanding its international presence, since for us cultural diversity represents one of our greatest strengths. We are continuously promoting the growth of our more than 13,000 associates, who develop their full potential in one of the highest quality companies in technology
