Project Description:
Develop a scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.
Responsibilities:
1. Web scraping using scripts / APIs / Tools.
2. Help build and maintain a greenfield data platform running on Snowflake and AWS.
3. Understand the existing pipelines and enhance them for new requirements.
4. Onboard new data providers.
5. Manage data migration projects.
Mandatory Skills:
* Python
* Linux
* Containerization (Docker, Kubernetes)
* Good communication skills
* Strong DevOps skills (K8s, Docker, Jenkins)
Nice-to-Have Skills:
* Market Data Projects / Capital markets experience
* Snowflake experience is a big plus
* Airflow
Languages:
English: B2 Upper Intermediate
#J-18808-Ljbffr