Svitla Systems Inc. is looking for a Senior Data Engineer for a full-time position (40 hours per week) in Mexico.
The client is a retail technology company reinventing the way people shop.
They help the partners redefine how shoppers discover products and make purchasing decisions in a digitally-driven world.
The client connects North America's best retailers and CPG manufacturers to millions of high-intent shoppers weekly, sharing savings and deals content to help make life more affordable.
The app is used by millions of shoppers every week to make better purchase decisions to save on their weekly shopping.
They have over 500 team members worldwide and are partnered with the largest retailers worldwide, including Walmart, Target, Kroger, Macy's, and Dollar General.
The strategic media partnerships include Google, Facebook, Twitter, MSN, CBS, and over 450 newspaper publishers.
**Requirements**:
- 5+ years of experience working with Big Data technologies (e.g., Spark, Flink, Apache Beam, Hadoop, Kafka Streams, and others).
- 5+ years of experience designing batch and/or real-time data pipeline systems.
- 5+ years of experience coding in Scala (if less experience or no Scala experience, having experience building data systems using Java is also acceptable).
- Minimum 2 years of experience with at least one of the following: Apache Kafka, Kinesis, Kafka Streams, Flink, Akka Streams.
- At least 2 years of experience with Apache Spark.
- Good understanding of AWS infrastructure (basic understanding of data & analytics AWS services is a plus).
- Experience mentoring junior members on the team.
Nice to have:
- Knowledge of Databricks.
- Knowledge of Apache Airflow.
- Experience with Python.
**Responsibilities**:
- Provide technical architecture guidelines and support for batch and real-time data processing systems.
- Design and Implement batch and real-time data processing systems.
- Partner with other engineering teams to build services to provide datasets in a scalable way.
**Salary**: $70,000.00 - $75,000.00 per month
**Experience**:
- Scala: 5 years (required)
- Big Data: 5 years (preferred)
- Kafka: 2 years (preferred)
- Apache Spark: 2 years (preferred)