Sr. PySpark Engineer

Location: Owings Mills

Location: Owings Mills, MD
Salary: $ USD Annually - $ USD Annually
Description: Our client is currently seeking a Sr. PySpark Engineer:

The ideal candidate will have strong hands-on experience with PySpark, Apache Spark, and Python, along with deep knowledge of SQL and No

SQL databases such as DB2, Postgre

SQL, and Snowflake. This role requires proven proficiency in data modeling, ETL pipeline development, and workflow orchestration using tools like Airflow.

Qualifications & Requirements:

Must Have Technical/Functional Skills

• 10+ years of experience in big data and distributed computing.
• Very Strong hands-on experience with PySpark, Apache Spark, and Python.
• Strong Hands on experience with SQL and No
  
  SQL databases (DB2, Postgre
  
  SQL, Snowflake, etc.).
• Proficiency in data modeling and ETL workflows.
• Proficiency with workflow schedulers like Airflow
• Hands on experience with AWS cloud-based data platforms.
• Experience in Dev Ops, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.
• Strong problem-solving skills and ability to lead a team

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes.

Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

This job and many more are available through The Judge Group. Please apply with us today!