Data Engineer

Job Summary :

The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure to support data-driven decision-making across the firm. Your role will involve collaborating with data scientists and analysts to ensure seamless access to high-quality data, while optimizing data storage and processing for maximum efficiency. This role reports to the Data Science Manager as part of the Data Science team.

Job Summary :

The Data Engineer will be responsible for designing, building, and maintaining data pipelines and infrastructure to support data-driven decision-making across the firm.

Your role will involve collaborating with data scientists and analysts to ensure seamless access to high-quality data, while optimizing data storage and processing for maximum efficiency. This role reports to the Data Science Manager as part of the Data Science team.

Responsibilities:

• Develop algorithms to transform data into useful, actionable information.
• Identify and acquire new data sources and assemble complex datasets that align with business needs.
• Create and maintain data infrastructure for optimal extraction, transformation, and loading data from various data sources using Microsoft Fabric technologies and Medallion Architecture best practices.
• Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Implement processes and systems to monitor data quality, troubleshoot and resolve data related issues, and improve data reliability and quality.
• Collaborate within the Data Science team to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision making across the organization.
• Work with stakeholders including Executive Leadership, Application Development, Marketing, and Finance to evaluate business objectives, support data infrastructure needs, and assist with data-related technical issues.
• Ensure compliance with data governance and security policies.
• Maintain documentation for database and data pipeline infrastructure.
• On-call support rotation once per month.

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, or equivalent experience.
• Relevant certifications are a plus

• 3-5 years in data engineering or related experience.
• Experience with Microsoft Fabric, Power BI, Data Model design, Data warehouse concepts, and Strong T-SQL skills.
• Microsoft Fabric Data Engineer certifications a plus.
• Experience with Python/PySpark programming
• Knowledge of additional programming languages (e.g. R, Power Shell) is a plus
• Experience with No SQL data structure and APIs is a plus.
• Technical experience with Data Mining and Machine Learning techniques is a plus.

• Ability to manage multiple tasks and projects simultaneously.
• Ability to analyze large amounts of data.
• Advanced skills in Microsoft Office Suite (Outlook, Excel, Word).
• Solid understanding of database management systems.

• Collaboration:
  
  Emphasis is placed on working together seamlessly and leveraging the collective strengths of individuals within the organization. Employees promote communication, teamwork, and the sharing of ideas to achieve common goals and objectives.
• Responsiveness:
  Responsiveness measures our ability to react quickly and effectively to changes, demands, or challenges. A responsive Employee fulfills all obligations effectively and timely to our current and future clients, while maintaining effectiveness and staying aware of evolving business needs or circumstances.
• Culturally Positive:
  The "Courage to Ask Why" reflects our culture that encourages curiosity, understanding, critical thinking, and challenging the status quo. Employees professionally question existing processes, seek new viewpoints, and explore customer-focused solutions. Employees embrace and promote the values and beliefs of the organization and demonstrate respect for their colleagues, our clients, and the broader community.…