Data Engineer

**Project** Description**:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics**Responsibilities**:Help build and maintain greenfield data platform running on Snowflake and AWSCreate and maintain data pipelines - setting up ingest, data transformation etc.Onboarding new data providersData migration projects**Skills**:Must have- Creating and managing complex data pipelines and ETL processes- Working with various ingest endpoints - REST API, SFTP, S3 etc.- Complex data transformations in both SQL and Python Pandas- CI/CD- Working with customers/end users - helping developers, data scientists, analysts and portfolio managers- AWS S3 and RDSNice to have- Previous experience with greenfield data platform build- Airflow- Dbt- AWS Step Functions, Glue, Lambda, SNS, EKS- Snowflake- Traditional RDBMS - Postgres preferred- Market Data Projects/ Capital markets exp**Languages**:English: B2 Upper Intermediate**Seniority**:Regular**Relocation package**:If needed, we can help you with relocation process.Vacancy SpecializationDWH DevelopmentRef NumberVR-96427