Sr Databricks Engineer Python | W2

Sr Databricks Engineer with Python | Contract W2

This range is provided by Next Gen Software Solutions LLC. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

$60.00/hr - $60.00/hr

Direct message the job poster from Next Gen Software Solutions LLC

Duration:
Long Term

Type:
Contract W2

Local candidates will get 1st preference.

We are looking for a Senior Data Engineer with strong experience in Databricks, Pyspark, and modern Data Warehouse systems. The ideal candidate can design, build, and optimize scalable data pipelines and work closely with analytics, product, and engineering teams.

• Design and build ETL/ELT pipelines using Databricks and Pyspark
• Develop and maintain data models and data warehouse structures (dimensional modeling, star/snowflake schemas)
• Optimize data workflows for performance, scalability, and cost
• Work with cloud platforms (Azure/AWS/GCP) for storage, compute, and orchestration
• Ensure data quality, reliability, and security across pipelines
• Collaborate with cross-functional teams (Data Science, BI, Product)
• Write clean, reusable code and follow engineering best practices
• Troubleshoot issues in production data pipelines

• Strong hands-on skills in Databricks, Pyspark, and SQL
• Experience with data warehouse concepts, ETL frameworks, batch/streaming pipelines
• Solid understanding of Delta Lake and Lakehouse architecture
• Experience with at least one cloud platform (Azure preferred)
• Experience with workflow orchestration tools (Airflow, ADF, Prefect, etc.)

• Experience with CI/CD for data pipelines
• Knowledge of data governance tools (Unity Catalog or similar)
• Exposure to ML data preparation pipelines

• Strong communication and documentation skills
• Ability to work independently and mentor others
• Problem-solver with a focus on delivering business value

Next Gen Software Solutions is a trusted provider of IT Staffing and consulting services dedicated to empowering businesses with cutting-edge technology solutions and exceptional talent. We specialize in delivering tailored IT consulting services, innovative software solutions, and connecting businesses with highly skilled IT professionals. Founded and led by a dedicated U.S. Army solider, Next Gen Software Solutions is deeply rooted in the core values of integrity, discipline, commitment, and experience-principles that guide every aspect of our operations.

Next Gen Software Solutions LLC is an Equal Opportunity Employer. We are committed to fostering an inclusive and diverse workplace where all employees and applicants are treated respect and dignity. We do not discriminate based on race, colour, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, genetic information, veteran status, or any other legally protected characteristic under applicable federal, state, or local laws.