Databricks Developer at Seaspan Corporation

Join Seaspan Corporation as a Databricks Developer and enhance our data solutions. Utilize your expertise in Apache Spark and Azure Data Factory to build robust data pipelines.
Reporting directly to the Team Lead, this role involves building scalable ETL/ELT pipelines and optimizing data processes. Your contributions will support high-quality data outputs for advanced analytics, crucial for informed business decisions.

Key Responsibilities:

• Design and maintain workflows using Databricks and Delta Lake

• Integrate large datasets into unified analytics-ready outputs

• Conduct data validation and quality checks

• Develop parameterized ADF pipelines and trigger Databricks jobs

• Collaborate closely with data teams to deliver insights
Requirements:

• 5+ years in data engineering or big data development

• Extensive experience with Databricks and Spark (PySpark/SQL)

• Familiarity with Azure Data Factory, ADLS, and SQL

• Proficient in Python for data transformation tasks

• Knowledge of CI/CD pipelines and version control
Drive data-driven insights and analytics with your Databricks expertise at Seaspan Corporation.
#J-18808-Ljbffr