**About Web Shop Manager & PartsLogic**Web Shop Manager is a company dedicated to providing innovative solutions in the automotive parts industry. With a focus on E-Commerce, Search & Discovery, Fitment and vehicle data to create powerful e-commerce experiences with efficiency, accuracy, and customer satisfaction. We aim to enhance the overall experience for both buyers and sellers.At Web Shop Manager & PartsLogic, we rely on a dynamic team of engineers to solve the many challenges of our rapidly evolving industry and technical stack. We're seeking a data engineer who is ready to work with new technologies and architectures in a forward-thinking organization that's always pushing boundaries. This person will be responsible for developing and maintaining high-performing SaaS solutions and will have complete, end-to-end ownership of projects.As a data engineer in the data platform team, you will have the opportunity to build, optimize and grow a large data platform which directly supports the PartsLogic Search and Discovery engine, as well as, other products within PartsLogic. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as millions of users.**Responsibilities**- Participate in all aspects of agile software development, including design, implementation, and deployment- Design, build and maintain data transformations efficiently and reliably for different purposes (e.g. indexing, reporting, growth analysis, multi-dimensional analysis)- Design, implement and maintain reliable, scalable, robust and extensible big data systems that support core products and business- Design, develop and support data pipelines and workflows that integrate various sources of structured and unstructured data across our customers' landscape.- Assess and implement any customizations and custom data wrangling needed to transform customer datasets in a way that is best suited for processing by our ML models.- Monitor data processing and machine learning workflows to ensure customer data is successfully processed by our ML models, debugging and resolving any issues faced along the way.- Generate necessary data artifacts and analytics needed to assess the quality of results generated by different parts of the AI workflow to ensure they meet desired quality standards.- Collaborate closely with the engineering team to assess model performance and improve results as needed.- Collaborate closely with Product Engineering as needed to resolve any issues faced during customer deployment and onboarding.- Collaborate closely with Customer Success Managers and Account managers to maintain close customer relationships and ensure customer satisfaction.- Develop tooling and playbooks to streamline and automate key technical delivery activities to be repeatable and scalable.- Develop and maintain RAG & Vector embeddings for AI and semantic search.- Establish solid design and best engineering practice for engineers as well as non-technical people- Develop and maintain scalable and high-performing software solutions using the specified tech stack- Architect and provide guidance on building data pipelines and lakes- Collaborate with cross-functional teams to design and implement new features- Ensure code quality through functional testing- Troubleshoot and debug issues to ensure smooth functionality- Collaborate across time zones via Slack, GitHub comments, documents, and frequent videoconferences- Stay up to date with industry trends and best practices**Required skills and qualifications**- Experience in the automotive industry and automotive parts standards such as ACES and PIES- Experience in performing data analysis, data ingestion and ETL(Extraction, Transformation & Loading)- Experience with the Big Data technologies (Airflow, Hadoop, M/R, Hive, Spark, Metastore, Presto, Flume, Kafka, ClickHouse, Flink etc)- Experience with Elasticsearch & Opensearch.- Experience with Vector Databases (Qdrant, Opensearch, Milvus).- Experience with AWS Bedrock & Q.- Excellent problem-solving and communication skills- Experience working in a small team startup environment- Experience working on or implementing e-commerce platforms or solutions- Experience with AWS and cloud computing services- Ability to write and maintain clear and concise technical documentation- Experience in search technologies such as full text lexical search and/or semantic vector based search- Strong understanding of Git and experience with CI/CD pipelines- Experience building SaaS dashboards with graphs to display analytics and performance KPIs- Experience working with RESTful and GraphQL APIs- Knowledge of Python, R, Rust- Excellent ability to write efficient SQL queries- Excellent debugging and optimization skills**Preferred skills and qualifications**- Bachelor's degree in Computer Scienc
