Senior Data Engineer

What is the opportunity?

In this role as a Senior Data Engineer, you will be responsible for development deliverables for the Finance Data Platform. The Platform, leverages Airflow and Databricks and serves as the central repository of finance related datasets, with capabilities including the ingestion of positional/trade, sub-ledger, general-ledger trial balances, and reference data; as well as data enrichment, adjustment, reconciliation, analytics and reporting functions.

In this role as a Senior Data Engineer, you will be responsible for development deliverables for the Finance Data Platform. The Platform, leverages Airflow and Databricks and serves as the central repository of finance related datasets, with capabilities including the ingestion of positional/trade, sub-ledger, general-ledger trial balances, and reference data; as well as data enrichment, adjustment, reconciliation, analytics and reporting functions.

• Work with the Product Owner, Product Manager, and Development Lead to understand and determine best mix of development and technical solutions to meet business requirements and project objectives.
• Work on detailed design and development phases of project initiatives; identifying, tracking and resolving technical issues.
• Ensure design/development solutions are aligned to the data/architecture strategy.
• Ensure adequate technical/reference documentation and training is in place.
• Provide assistance to the application support team in troubleshooting and resolving production issues.
• Coordinate with the Quality Engineering team on all aspects of testing and verification, ensuring quality assurance testing is performed for all changes.
• Impart knowledge, benefit of experience, and mentoring to other members of the team.

• Total Experience 5+ years’ , with at least 3 years experience with Spark (Scala/Python) , Big Data ,Databricks, Airflow ,DBT
• Solid experience (as evidenced by resume) with Apache Hadoop/Hive ETL/data-pipelines or other big-data platform technology/tools Cloudera
• Solid experience (as evidenced by resume) with SQL, Oracle/PL-SQL or any ANSI-compliant RDBMS platform preferred.
• Experience on Windows/Unix/Linux OS.
• Undergraduate degree/diploma in computer science/engineering or related technology discipline.
• Solid communication and time management skills.

• Demonstrable experience with Dev Ops tools/technologies, including continuous integration/delivery tools and technologies such as Git Hub, Jenkins, Synk, JIRA, Confluence, Airflow
• Demonstrable experience with containerization tools and technologies such as Docker, Kubernetes, Redhat Open Shift Container Platform (OCP).
• Experience with Capital Markets or other financial technology services’ middle/back office environments.
• Experience with/exposure to cloud technology platforms such as PCF (on-prem), AWS. Azure (off-prem).
• Experience with/exposure to Business Intelligence (BI)/Analytics/Reporting tools, such as Tableau, Datameer, Power BI, Presto, Snowflake, Apache Superset, etc.
• Experience with/exposure with Test driven development (TDD) and automated unit testing.

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
• Leaders who support your development through coaching and managing opportunities
• Ability to make a difference and lasting impact
• Work in a dynamic, collaborative, progressive, and high-performing team
• A world-class training program in financial services
• Flexible work/life balance options
• Opportunities to do challenging work
• Opportunities to take on progressively greater accountabilities
• Opportunities to building close relationships with clients
• Access to a variety of job opportunities across business and geographies

Big Data Management, Cloud Computing, Database…