Big Data Engineer

Presently we are unable to sponsor and request applicants to apply who are authorized to work without sponsorship*

Employment TYPE:

Contract W2 - NO C2C

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

We are seeking a Big Data Engineer to join our team. The ideal candidate will have strong experience in Java/J2EE development, Agile delivery, and CI/CD practices and a proven ability to design, build, test, deploy, and maintain secure, resilient applications
.

• Design, develop and maintain scalable and large-scale data processing pipelines and infrastructure on the cloud following engineering standards, governance standards and technology best practices
• Develop and optimize data models for large-scale datasets, ensuring efficient storage, retrieval, and analytics while maintaining data integrity and quality.
• Collaborate with cross-functional teams to translate business requirements into scalable and effective data engineering solutions.
• Demonstrate a passion for innovation and continuous improvement in data engineering, proactively identifying opportunities to enhance data infrastructure, data processing and analytics capabilities.

• Strong analytical problem solving and critical thinking skills
• Proficiency in at least one programming language ( Python, if not Java or Scala)
• Proficiency in at least one distributed data processing framework ( Spark or similar)
• Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop)
• Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar)
• Proficiency with relational and No
  
  SQL databases.
• Proficiency in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar)
• Experience working in teams following Agile methodology
• Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.

• Experience with cloud platforms and related services.
• Exposure to test automation and performance engineering.