Data Engineer -at Pinnacle Group Jersey , NJ

Data Engineer
-601/602 job at Pinnacle Group. Jersey City, NJ.

Position: Data Engineer- AWS

Location: Jersey City, New Jersey

Duration: Contract

Job : 172543

As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key member of an agile team. Your role will involve designing and delivering reliable data collection, storage, access, and analytics solutions that are secure, stable, and scalable. You will develop, test, and maintain essential data pipelines and architectures across diverse technical areas, supporting various business functions to achieve organizational objectives.

• Review and ensure sufficient protection of enterprise data through controls.
• Make custom configuration changes in tools to meet business or customer requests.
• Update logical or physical data models based on new use cases.
• Utilize SQL frequently and understand No
  
  SQL databases and their applications.
• Contribute to a team culture of diversity, opportunity, inclusion, and respect.
• Develop enterprise data models and maintain large-scale data processing pipelines.
• Lead code reviews and provide mentoring to team members.
• Drive data quality and ensure data accessibility for analysts and data scientists.
• Ensure compliance with data governance requirements and alignment with business goals.

• Formal training or certification in data engineering concepts with 2+ years of applied experience.
• Experience across the data lifecycle with advanced SQL skills and understanding of No
  
  SQL databases.
• Proficiency in statistical data analysis and determining appropriate tools and data patterns.
• Extensive experience in AWS and maintaining data pipelines using Python and PySpark.
• Proficient in Python and PySpark for writing and executing complex queries.
• Proven experience in performance tuning to optimize job execution.
• Advanced proficiency in leveraging Gen AI models using APIs/SDKs.
• Expertise in cloud data lakehouse platforms such as AWS Data Lake, Databricks, or Hadoop.
• Proficiency in relational data stores like Postgres, Oracle, or similar, and No
  
  SQL data stores like Cassandra, DynamoDB, or MongoDB.
• Advanced proficiency in Cloud Data Warehouses such as Snowflake or AWS Redshift.
• Experience with scheduling/orchestration tools like Airflow or AWS Step Functions.
• Proficiency in Unix scripting, data structures, and data serialization formats like JSON, AVRO, or Protobuf.
• Knowledge of big-data storage formats such as Parquet or Iceberg.
• Familiarity with data processing methodologies like batch, micro-batching, or streaming.
• Experience with data modeling techniques such as Dimensional, Data Vault, Kimball, or Inmon.
• Understanding of Agile methodology, TDD/BDD, and CI/CD tools.

• Knowledge of data governance and security best practices.
• Experience in conducting data analysis to support business insights.
• Strong expertise in Python and Spark.

Pay Range: $65- $70

The specific compensation for this position will be determined by a number of factors, including the scope, complexity and location of the role as well as the cost of labor in the market; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. Our full-time consultants have access to benefits including medical, dental, vision and 401K contributions as well as any other PTO, sick leave, and other benefits mandated by applicable state or localities where you reside or work.

#LI-SS5