Senior Data Analyst

Job Description Key Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks and Spark for ingestion, transformation, and processing of healthcare data from multiple sources.
• Develop and optimize workflows for ETL/ELT processes within Databricks, ensuring high performance and reliability.
• Implement data quality checks, governance, and compliance standards across all datasets.
• Collaborate with analysts and stakeholders to deliver clean, structured data for reporting and advanced analytics.
• Write and optimize SQL and Spark SQL queries for data manipulation and analysis.
• Monitor and troubleshoot data pipeline performance, ensuring timely delivery of datasets.
• Document processes and provide technical guidance on best practices for Databricks and cloud-based data engineering.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to  learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

• 7–8+ years of experience in data analytics, with a strong focus on healthcare claims data.
• Expert-level experience with Databricks, Spark, and distributed data processing.
• Proficiency in SQL and Python for data engineering tasks.
• Hands-on experience with cloud platforms (Azure, AWS, or GCP) and data lake architectures.
• Strong understanding of data governance, security, and compliance in healthcare.
• Excellent communication skills to convey technical concepts and insights clearly.