Data Engineer

Long term Contract position with a major financial firm.

Hybrid, 3 days/week in Newark, NJ.

Business Requirements:

• Centralize market data feeds from various third-party market data vendors into the central "Market Data Hub."
• Source data feeds from a 3rd party EDM system (e.g. Gresham, Golden Source, RIMES, Bloomberg).
• Ensure that data quality rules and checks are applied to each dataset. (This would be configurable within the EDM System)
• Land consolidated data from EDM system withinMS Fabric (example data flow: 3rd party market data vendor EDM System MS Fabric)
• Migrate existing market data feed ingestion and ETF processes to the MS Fabric or EDM System.
• Sunset existing market data feed ingestion.

5-10 years of experience.

Responsibilities:

• Prior experience working with Market Data feeds and asset management industry or financial services experience.
• Prior experience designing and implementing a medallion architecture for enterprise data.
• Prior experience in Fabric and EDM (e.g. enterprise data management system, like Gresham, Golden Source, RIMES, Bloomberg) preferred.
• Design, build and maintain data quality rules and data extracts from EDM vendor.
• Design, build and maintain scalable data pipelines from EDM vendor into MS Fabric to support 3rd party market data feeds.
• Note some data feeds may need to bypass the EDM vendor and be ingested directly into MS Fabric.
• Design, build and maintain data validation and quality rules for data ingested into MS fabric.
• Prior experience with Microsoft Purview or other data governance tool is a plus

• Prepares data for analytical or operational uses
• Builds data pipelines to pull information from different source systems; integrating, consolidating and cleansing data; and structuring it for use in applications
• Creates interfaces and mechanisms for the flow and access of information.

payrate 65 - 75per hour depending on experience