More jobs:
Big Data Developer
Job in
McLean, Fairfax County, Virginia, USA
Listed on 2026-09-09
Listing for:
TechWish
Full Time
position Listed on 2026-09-09
Job specializations:
-
Software Development
Data Engineering, Python, Software Engineer
Job Description & How to Apply Below
- Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
- Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.
- Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality assurance.
- Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.
- Work with data scientists and analysts to support data-driven decision-making across the organization.
- Ability to write and maintain automated unit, integration, and end-to-end tests
- Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.
- Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
- Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.
- Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality assurance.
- Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.
- Work with data scientists and analysts to support data-driven decision-making across the organization.
- Ability to write and maintain automated unit, integration, and end-to-end tests
- Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.
- Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
- Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.
- Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Optimize and enhance existing data pipelines for performance, scalability, and reliability.
- Develop automated testing frameworks and implement continuous testing for data quality assurance.
- Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.
- Work with data scientists and analysts to support data-driven decision-making across the organization.
- Ability to write and maintain automated unit, integration, and end-to-end tests
- Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.
- Bachelor's degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and/or work experience;
Master's degree and past Financial Services industry experience preferred. - Demonstrated technical expertise in Object Oriented and database technologies/concepts which resulted in deployment of enterprise quality solutions.
- Past experience with developing enterprise quality solutions in an iterative or Agile environment.
- Extensive knowledge of industry leading software engineering approaches including Test Automation, Build Automation and Configuration Management frameworks.
- Strong written and verbal technical communication skills.
- Demonstrated ability to develop effective working relationships that improved the quality of work products.
- Should be well organized, thorough, and able to handle competing priorities.
- Ability to maintain focus and develop proficiency in new skills rapidly.
- Ability to work in a fast paced environment.
- Experience with object oriented programming languages such as Java, Scala or Python.
- AI Tool Proficiency:
Hands-on experience with AI development tools (Git Hub Copilot, Q Developer, ChatGPT, Claude, etc.) - Technical Background:
Strong software development background with ability to contribute to technical discussions - Agile Methodology:
Extensive experience with Scrum, Kanban, and continuous improvement practices
- Experience with Big data technologies such as Hadoop, Spark, Hive & Trino
- Evaluate understanding of common issues like:
- Data skew and strategies to mitigate it.
- Working with massive data volumes in Peta Bytes.
- Troublehsooting job failures due to resource limitations, bad data, scalability challenged.
- Look for…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×