Big Data Developer

Get AI-powered advice on this job and more exclusive features.

This range is provided by Synechron. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

$/yr - $/yr

Direct message the job poster from Synechron

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & Dev Ops, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our Fin Labs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.

Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.

We are looking for a highly skilled and experienced Senior Big Data Engineer with over a decade of expertise in building large-scale data solutions utilizing Hadoop and Spark ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing complex data processing architectures to enable advanced analytics, machine learning, and reporting platforms.

Additional Information*

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $100k - $110k/year & benefits (see below).

The Role

Responsibilities:

• Design, develop, and optimize big data pipelines and processing frameworks using Hadoop (HDFS, Map Reduce, YARN) and Apache Spark.
• Build scalable data ingestion processes and data lakes for diverse data sources.
• Develop and maintain ETL workflows that handle processing of structured and unstructured data.
• Collaborate with Data Scientists, Analysts, and Business Teams to translate requirements into technical solutions.
• Tune and troubleshoot Spark and Hadoop jobs for maximum efficiency and performance.
• Implement data security, privacy, and compliance best practices across all platforms.
• Mentor junior team members and foster best practices in big data development.
• Stay current with emerging trends and technologies related to Hadoop and Spark.
• Document architecture, workflows, and standards for maintainability and knowledge sharing.

Requirements:

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Information Technology, or related field.
• 10+ years of industry experience in big data engineering with proven expertise in Hadoop and Spark technologies.
• Extensive experience with Hadoop ecosystem components: HDFS, Map Reduce, YARN, Hive, Pig, HBase, and Oozie.
• Strong proficiency in Apache Spark (Scala, Python, or Java) and Spark SQL.
• Experience with data ingestion tools such as Apache NiFi, Kafka, or Flume.
• Hands-on experience with cloud platforms (AWS, Azure, GCP) and their big data services integrated with Hadoop/Spark.
• Knowledge of data modelling, data warehousing, and database technologies (No
  
  SQL, relational systems).
• Familiarity with containerization and orchestration tools like Docker and Kubernetes.
• Familiar with data governance, security, and compliance standards.
• Excellent problem-solving, system architecture, and communication skills.

Preferred, but not required:

• Experience with Spark Streaming and real-time data processing.
• Knowledge of advanced analytics, machine learning pipelines, and integration with Spark MLlib.
• Experience with automation and orchestration tools such as Apache Airflow.
• Familiarity with version control and CI/CD practices for big data platforms.

We offer:

• A highly competitive compensation and benefits package.
• A multinational organization…