Data Engineer

Data Engineer

Role: Data Engineer (6 months W2 only)

Location: NYC NY (3 days onsite per week) - F2F interview

Core Requirement: Horizon Core Banking knowledge is essential; experience with core banking systems required

• Proficient in Python (read and write)
• Strong experience with Databricks for building scalable data pipelines
• Data processing tools: SQL, Python, Spark
• Experience with Azure and cloud integrations with Databricks
• Knowledge of ETL tools and data architecture principles

• Strong understanding of data quality, data cleansing, transformation, and aggregation
• Ensures data integrity, security and compliance with regulations

• Works closely with data scientists, analysts and business stakeholders to deliver data solutions
• Effective communicator and team player

• Design, develop and maintain scalable data pipelines and architectures
• Implement data management best practices for storage, retrieval and performance optimization
• Monitor, troubleshoot and document data processes
• Stay updated on latest data engineering and Databricks advancements
• Perform other related duties as assigned

• Bachelor's degree in CS, IT, Engineering or related field (or equivalent experience)
• 3 years experience as a Data Engineer with proven Databricks expertise
• Strong problem-solving and multitasking abilities

• Apache Hive
• S3
• Hadoop
• Redshift
• Spark
• AWS
• Apache Pig
• No
  
  SQL
• Big Data
• Data Warehouse
• Kafka
• Scala

Full Time

Years

1