Software Engineer, Data Engineer

Overview

One of the country’s largest data-driven technology organizations is searching for a Software Engineer to join a highly visible enterprise platform team. This is an initial 1-year contract position, located in Alpharetta, Georgia or Boca Raton, FL.

As the Software Engineer you will support and develop our Databricks-based data platform during the development phase. This role focuses on building, improving, and validating reliability patterns early, rather than production firefighting. The ideal candidate is hands-on with Databricks, PySpark, Python, and has working knowledge of Azure cloud services.

Contract: 1-year

Hybrid

• Develop and support Databricks notebooks, jobs, and workflows
• Write and optimize PySpark and Python code for data processing
• Assist in designing scalable and reliable data pipelines
• Apply Spark best practices (partitioning, caching, joins, file sizing)
• Work with Delta Lake tables and data models
• Perform data validation and quality checks during development
• Support cluster configuration and sizing for development workloads
• Identify performance bottlenecks early and recommend improvements
• Collaborate with Data Engineers to prepare solutions for future production rollout
• Document development standards, patterns, and best practices

• 3+ years of hands-on experience:
• Databricks & Spark
• Hands-on experience with Databricks
• Strong knowledge of PySpark and Spark fundamentals
• Experience working with Delta Lake
• Understanding of Spark execution concepts (jobs, stages, tasks)
• Programming
• Ability to write clean, modular, and reusable code
• Experience working in Microsoft Azure
• Familiarity with:
• Basic understanding of cloud resource usage and cost awareness
• Development Practices
• Experience using Git and version control
• Familiarity with Databricks Repos or similar workflows
• Ability to perform basic testing and validation of data pipelines

• Experience with Spark SQL
• Exposure to CI/CD pipelines for data platforms
• Knowledge of infrastructure as code (Terraform, ARM)
• Familiarity with Azure Monitor or Log Analytics
• Interest in transitioning development work toward production reliability