ETL Developer Job McLean area,Virginia USA,Software Development

Responsibilities:

Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
Obtain an understanding of existing NiFi flows with minimal support from others
Develop new NiFi flows that adopt best practices of existing NiFi flows
Take feedback on NiFi flows and develop requested changes
Take direction and communicate status via a ticketing system
Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry
Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
Take feedback from analysts on nuances to support application data layers
Programmatically manipulate and transform data from multiple sources
Query and analyze large datasets using SQL
Retrieve and process data from external systems via APIs
Support data quality, integrity, and performance optimization efforts
Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
Develop Python in support of data science related efforts or ETL prototypes

Minimum Qualifications:

Experience:

Bachelor’s degree with 8+ years of relevant experience, OR Master’s degree with 7+ years of experience, OR Doctorate with 6+ years of experience
Degree in Computer Science, Systems Engineering, Geography, or a related technical field
Active TS/SCI clearance with required polygraph
U.S. Citizenship required
Willingness to work onsite full‑time
Willingness to develop NiFi flows using existing best practices
Strong understanding of ETL concepts and best practices
Strong experience with databases for data management
Proficiency in SQL for querying large datasets
Experience with API integration and data retrieval
Demonstrated experience with programmatic data manipulation
Competency to rapidly adopt containerized development proficiency
Competency to rapidly adopt AWS architecture proficiency
Competency to rapidly adopt NiFi registry and Git for code management

Preferred Qualifications:

Creativity to experiment and recommend best practice coding improvements
Drive to adopt and recommend AI into development processes
Ability to design and develop custom NiFi processors using Java
Experience with AWS cloud services for data ingestion and processing
Strong experience with PostgreSQL for data management
Hands‑on experience with Apache Airflow
Hands‑on experience with Apache Ni Fi
Hands‑on experience with NiFi registry and Git
Hands‑on experience with Git and repository actions and pull requests
Hands‑on experience in Python for data manipulation and API interfacing
Experience working with geospatial data and related tool
Understanding of basic data science concepts and tools

Pay Transparency:

The successful candidate’s starting pay will fall within the salary range provided below and is determined based on job‑related factors, including, but not limited to, the experience, qualifications, knowledge, skills, geographic work location, and market conditions. Candidates with the minimum necessary experience, qualifications, knowledge, and skillsets for the position should not expect to receive the upper end of the pay range.

The base pay for this position within California, Colorado, Hawaii, New Jersey, the Washington, DC metropolitan area, and for all other states is: $ - $

Benefits:

Vantor offers a competitive total rewards…