.Who We ArePALO IT is a global innovation consultancy and Agile software development company dedicated to helping organizations embrace tech as a force for good. We work with clients to rapidly launch products and services, create new business models, leadership and culture for the future. We are a community of innovators, designers and technologists across 10 offices and five continents (France, Spain, Hong Kong, Singapore, Thailand, Australia, Mexico, USA, Brazil and Colombia).We're committed to helping businesses transform our world for the better. We're proud to be a World Economic Forum (WEF) New Champion, and a B Corp-certified company in México, Singapore and Hong Kong, currently working towards certification across all other locations.Our Impact in PALO ITUsing our B Corp certification and WEF status as our north star, we're eager to adapt to change, learn from our experiences and move to meet our planet's urgent needs. With 2025 as our horizon, we are taking action to meet the following objectives:Become a climate net-zero companyAttain 50% of revenue from projects with a positive impactTrain 100% of our workforce on impactAchieve B Corp certification among all 11 of our offices across the globeAttain 90% happy employees at PALO ITWhat does your job look like?As a Data Engineer, your main goal is to support and enhance a data-driven culture throughout the organization. You will collaborate with the Decision Science team to build solutions that enable teams to explore large datasets, experiment with and validate hypotheses, develop and optimize machine learning models, and use these models for real-time parametric decision-making. Additionally, you will contribute to the maintenance and development of the data flow on our Big Data platform. You will be responsible for designing, implementing, and optimizing data solutions using a variety of advanced tools and technologies.Your main responsibilities will be to:Maintain and develop the data flow on the Big Data platform.Design and build robust and scalable data pipelines.Integrate and manage large volumes of data from various sources.Develop and optimize data processing jobs using Hadoop, Spark, and other related tools.Configure and maintain workflow orchestration tools like Apache Airflow.Ensure data quality, integrity, and security.Collaborate with multidisciplinary teams to identify data requirements and provide appropriate technical solutions.Document processes, architectures, and data flows.What you need to succeed in this role:Degree in Computer Science, Computer Engineering, or a related field.Demonstrable experience using Hadoop, Sqoop, Spark, Airflow, Avro, Python, ELK, Oracle Database, PostgreSQL, and Hive.Strong knowledge of relational and non-relational databases.Experience in implementing and maintaining data pipelines in Big Data environments.Programming skills in Python.Knowledge of log monitoring and analysis tools like ELK