Data Engineer - Databricks

Overview

Data Engineer - Databricks Opportunity. Join Our Client's Team as a Data Engineer. Are you ready to be part of a dynamic team driving cutting-edge compliance solutions? Our client is seeking a motivated and skilled Data Engineer specializing in Azure and Databricks to become an integral member of their Compliance Technology team in Charlotte, United States. In this role, you will design and implement top-tier data pipelines and cloud-native platforms powering real-time compliance analytics and regulatory reporting across global markets.

This is an exciting opportunity to make a significant impact while collaborating on mission-critical initiatives involving complex financial datasets.

• ETL Workflows: Design and implement secure and scalable ETL workflows using Azure Data Factory and Databricks.
• Data Integration: Integrate and normalize data from various structured and unstructured sources, maintaining strict data quality governance.
• Automation Development: Automate data ingestion and transformation processes for real-time analytics and reporting.
• Azure Proficiency: Hands-on experience with Azure Data Factory, Databricks notebooks, and ADLS.
• Data Storage Optimization: Utilize Databricks and Delta Lake for efficient storage formats and fast data retrieval.
• Data Governance: Enforce comprehensive data governance standards, metadata management, and audit processes.
• Collaboration: Work with governance and compliance analysts to define requirements and manage access controls.
• Agile Participation: Contribute to Agile workflows, sprint planning, and production deployments.

• 3+ years in data engineering within financial services, ideally in compliance or regulatory frameworks.
• Advanced proficiency in SQL, Python, and familiarity with Git/Git Lab and CI/CD tools like Azure Dev Ops.
• Preferred qualifications include certifications in Azure Data Engineering, Databricks, or Financial Compliance Technology.

If you're passionate about driving innovation in compliance technology, we'd love to hear from you. Apply now to join our client's forward-thinking team!

EOE Statement: Specialist Staffing Group is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

In addition to base pay, direct-hire employees may be eligible for client offered benefits such as medical, dental, and vision coverage, and paid leave where required by applicable law. Eligibility may vary based on factors such as location and hire date and is subject to change.

To find out more about Huxley, please visit