Data Engineer Seniors III; Databricks

Overview

FIS Management Services, LLC seeks a Senior Data Engineer (Databricks) in Jacksonville, FL.

The role involves designing, developing, and enhancing applications and data solutions in collaboration with product managers, clients, and engineering teams. Key responsibilities include analyzing requirements, defining technical specifications, participating in design reviews, implementing software enhancements, coding, debugging, testing, and preparing documentation for installation and maintenance.

Additionally, the engineer will train internal teams and external clients on system functionality, support project planning, scheduling, and reporting, and develop Python-based validation scripts to ensure data quality, schema conformity, and completeness prior to ingestion.

Within the Databricks environment, tasks include utilizing PySpark to read, cleanse, transform, and integrate large-scale datasets, implementing a Unity Catalog for secure, governed access to ADLS, developing Spark notebooks for data structure optimization and parameter-driven execution, and designing a reusable Delta Live Tables framework to standardize ingestion and transformation across bronze, silver, and gold layers.

Finally, the engineer will create a centralized error logging framework to capture standardized exceptions, enhance observability, support compliance, and strengthen overall data platform resilience.

• Design, develop, and enhance applications and data solutions in collaboration with product managers, clients, and engineering teams.
• Analyze requirements and define technical specifications.
• Participate in design reviews and implement software enhancements.
• Code, debug, test, and prepare installation and maintenance documentation.
• Train internal teams and external clients on system functionality.
• Support project planning, scheduling, and reporting.
• Develop Python validation scripts to ensure data quality, schema conformity, and completeness prior to ingestion.
• Utilize PySpark within Databricks to read, cleanse, transform, and integrate large-scale datasets with Unity Catalog for secure, governed access to ADLS.
• Develop Spark notebooks to optimize data structures and support parameter-driven execution.
• Design a reusable Delta Live Tables framework to standardize ingestion and transformation across bronze, silver, and gold layers.
• Create a centralized error logging framework to capture standardized exceptions and enhance observability and compliance.

• Bachelor’s degree or foreign equivalent in Applied Computer Science, Computer Engineering, or a related field with at least four (4) years of experience working with Azure and AWS cloud‑based data engineering platforms, python data processing frameworks, MPP engines, and ELT/ETL transformation frameworks (including DBT and PySpark). Requires experience in ETL/ELT development, data modeling, optimized data formats (Parquet, Delta), version control and collaborative development practices (Git, code reviews), and CI/CD pipelines with automated testing methodologies (TDD, unit testing).
• Alternatively, a master’s degree in the above fields with at least two (2) years of relevant experience.
• Telecommuting and/or working from home may be permissible pursuant to company policies.

FIS is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, marital status, genetic information, national origin, disability, veteran status, and other protected characteristics. EEO poster and supplement documents are available upon request.