Software Engineer, Data Engineering

Overview

Description:

Position Requires a Top Secret (TS/SCI) Clearance with a Polygraph. Labor Category:
Software Engineer.

Position Title:

ETL Developer. Position Level: Level 3 – Senior. Salary:
Up to $170,000 per year. Core

Hours:

9am to 4pm.

Location:

Bethesda, MD.

• Data Ingest & Enrichment – ETL Developer with strong systems, software, cloud, and Agile experience to support a complex program to provide Agile development and operations and maintenance for critical systems. Based in a Dev Ops framework, participate in and/or direct major deliverables of projects through all aspects of the software development lifecycle including scope and work estimation, architecture and design, coding and unit testing.
• Building complex NiFi data pipeline design:
  Develop and implement enterprise-level ETL NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
• Performance optimization and tuning:
  Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing.
• Troubleshooting and problem resolution:
  Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures.
• Integrating with big data and cloud technologies:
  Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating familiarity in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS).
• Follow best practices and standards:
  Follow established best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies.
• Documentation and knowledge sharing:
  Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations.
• Collaboration and communication:
  Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions.

• Direct experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments.
• Experience in programming languages like Java and/or Python and scripting for automation.
• Experience writing and optimizing complex queries, along with experience in interacting with relational and No
  
  SQL databases (e.g., Postgres, Elasticsearch, DynamoDB).
• Experience with real-time streaming, and API integration (REST) for seamless data connectivity.
• Experience with cloud platforms like AWS, Azure, or OCI and related data services.
• Ability to analyze complex data challenges, identify root causes, and implement effective solutions.
• Ability to collaborate effectively with cross-functional teams and articulate technical concepts clearly.
• HS diploma and at least 8 years of relevant experience; or BS degree and at least 4 years of relevant experience; or Master’s degree and at least 2 years of relevant experience.

• Experience deploying ETL solutions in an AWS environment.
• Experience developing custom NiFi processors with Java and/or Python.
• Direct knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability.

B4

Corp is a small defense contracting company that focuses on providing an optimum environment for mission-focused, highly skilled consultants to support the United States of America’s intelligence community and other defense organizations. B4

Corp provides a low overhead, highly efficient, high salary environment that allows employees to excel at meeting the client’s needs. B4

Corp is looking for information technology professionals that have a high sense of personal responsibility, self-motivation, and mission drive.

B4

Corp’s dedication and care for its employees is reflected in our outstanding compensation and benefits package. B4

Corp’s benefits reflect the…