**Important automotive consultancy company is looking for a BIG DATA SENIOR Engineer to join our team!**
Able to do:
Design, code, test, correct and document programs and scripts using agreed standards and tools to achieve a well-engineered result
- Derive an overall strategy of data management, within an established information architecture that supports the development and secure operation of existing and new information and digital services
- Plan effective data storage, security, sharing and publishing within the organization
- Gathers and processes raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks
- Ensures data quality and implements tools and frameworks for automating the identification of data quality issues
- Collaborate with internal and external data providers on data validation providing feedback and making customized changes to data feeds and data mappings
- Mentor and lead data engineers providing technical guidance and oversight
- Provides ongoing support, monitoring, and maintenance of deployed products
Minimum Requirements we seek:
- 15 or more years of experience with a Bachelor's Degree or 12 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, or MD), PhD with 9+ years of experience in Computer Science or related technical field
- 10+ years of experience building highly available and fault tolerant distributed systems
Expertise in at least two of the following general purpose programming languages:
Java/Go/Scala/Python/JavaScript
Experience designing data architecture for multiple database models such as Relational
DBMS, Document, Columnar and Key Value Data Stores
- Experience working with Stream processing Systems such as Storm, Spark-Streaming and Kafka Streams.
- Experience writing code in multiple programming language paradigms such as Object-Oriented and Functional Programming Languages
- 3+ years of BigData development experience on one or more cloud Platforms (AWS GCP )
Analyze Live Streaming Data / Data processing in real time
**Working location and schedule**:
Monday to Friday for at least 40 hours per week
Naucalpan, Estado de México
The job is hybrid, part home office and part in office
Tipo de puesto: Tiempo completo
Salario: $45,000.00 - $46,000.00 al mes
Horario:
- Turno de 8 horas
Lugar de trabajo: Empleo presencial