.Bluelight Consulting is a leading software consultancy seeking a skilled Data Engineer to join our fast-growing team.
Our mission is to design and develop technology that improves the lives of its users while providing an exceptionally high level of service to our clients.We are looking for Data Engineer who want to be part of a fast-paced, dynamic environment, where everyone's opinions and efforts are valued.
We hire outstanding individuals and give them the opportunity to thrive in a collaborative atmosphere that values learning, growth, and hard work.
**What We Are Looking For**:- Experience with AWS services including but not limited to S3, Athena, EC2, EMR, and Glue.- Ability to solve any ongoing issues with operating the cluster.- Experience with the integration of data from multiple data sources.- Experience with various database technologies such as SQLServer, Redshift, Postgres, and RDS.- Experience with one or more of the following data integration platforms: Pentaho Kettle, SnapLogic, Talend OpenStudio, Jitterbit, Informatica PowerCenter, or similar.- Knowledge of best practices and IT operations in an always-up, always-available service.- Experience with or knowledge of Agile Software Development methodologies.- Excellent problem-solving and troubleshooting skills.- Excellent oral and written communication skills with a keen sense of customer service.- Experience with collecting/managing/reporting on large data stores.- Awareness of Data governance and data quality principles.- Well versed in Business Analytics including basic metric building and troubleshooting.Familiar with Web Services: XML, REST, SOAP.- Experience with Git or similar version control software.- Experience with integrations with and/or use of BI tools such as GoodData (Prefered), Tableau, PowerBI, or similar.- Broad experience with multiple RDBMS: MS SQLServer, Oracle, MySQL, PostgreSQL, Redshift.- Familiarity with SaaS/cloud data systems (e.G.
Salesforce).- Data warehouse design: star-schemas, change data capture, denormalization.- SQL/DDL queries/Tuning techniques such as indexing, sorting, and distribution.- BS or MS degree in Computer Science or a related technical field.- 3+ years of Data Pipeline development such as SnapLogic or Datastage, Informatica, or related experience.- 3+ years of SQL experience (No-SQL experience is a plus).- Experience designing, building, and maintaining data pipelines.
**What You'll Be Doing**:- Develops and maintains scalable data pipelines in SnapLogic and builds out new ETL and API integrations to support continuing increases in data volume and complexity.Monitoring execution and performance of daily pipelines, triage and escalate any issues.- Collaborates with analytics and business teams to improve data models and data pipelines that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization