Scala and Spark Developer

Job Title:
Scala and Spark Developer

Job :

Job Location:

Austin, TX;
Morris Plains, NJ

Job Travel Location(s):

# Positions: 1

Employment Type:

W2

Candidate Constraints:

Duration:

Long Term

# of Layers:0

Work Eligibility:

All Work Authorizations are Permitted – No Visa Transfers

Spark, Scala, Python, Shell scripting, Postgre

SQL, and Hadoop

• Work with business and technical leadership to understand requirements
• Participate in sprint planning sessions and help TPOs
• Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.

• 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, Postgre
  
  SQL, and Hadoop
• In depth knowledge on Hadoop architecture and its components
• Strong working knowledge on Single Store (MEMSQL) database
• Should have good hands‑on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
• Must understand basic AWS services and hands on experience
• Basic to moderate Terraform development experience needed
• Should be able to demonstrate work experience in Hadoop, Spark, hive
• Strong hands‑on experience on Scala and Spark is must
• Must have work experience on Hadoop as data warehouse/Data Lake implementations
• Strong experience on Dev Ops pipeline implementation
• Health care domain knowledge is a plus
• Troubleshooting the Hadoop Yarn jobs is must
• Strong experience in writing complex and effective SQLs, and Stored Procedures
• Strong development experience on Single Store database operations
• Strong profiling skills using Single Store database
• Strong query optimizations skills to improve performance of ETL process
• Implement Hadoop job orchestration using Shell scripting, and Airflow
• Experience in Agile and working knowledge on Dev Ops tools (Get, Maven, Jenkins, Sonar Cube, and Check marks)
• Unix Shell scripting and basic administration of Unix servers
• AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
• Experience in Jira and Confluence
• Must participate in production support model.