Data Engineer

Job Requirements

In this Data Engineer (Sr. Consultant, Engineering & Technical Services) role, you will leverage your senior-level full-stack engineering expertise, with a strong focus on backend and data-centric systems, to design, build, and operate end-to-end processing pipelines, validation logic, and core data layers for a large-scale, mission-critical federal filing platform. You will apply deep technical skills in modern cloud architectures, API development, and event-driven systems to support high-volume data ingestion, complex business and validation rules, and secure data storage.

Working within an agile, Dev Sec Ops  environment, you will collaborate closely with technical leadership, security, and cross-functional delivery teams to deliver reliable, compliant software that meets stringent performance, data integrity, and security requirements.

• Design, develop, and maintain backend services and data pipelines using Python as the primary language.
• Build and operate serverless, event-driven architectures using AWS Lambda, Step Functions, Dynamo
  
  DB, and S3.
• Implement and maintain RESTful APIs and interface contracts using OpenAPI specifications.
• Develop data access layers and processing logic using SQL with Postgre
  
  SQL or Oracle relational databases.
• Design and implement validation logic and business rules for structured filing data.
• Create and maintain unit and integration tests using pytest, ensuring high test coverage and alignment with CI/CD quality gates.
• Collaborate with Dev Sec Ops  to integrate services into automated pipelines, ensuring secure, repeatable deployments.

• Minimum of 7 years of relevant experience
• Advanced proficiency in Python for backend development.
• Hands‑on experience with AWS serverless services, including Lambda and Step Functions.
• Experience designing and working with Dynamo
  
  DB and S3 in production environments.
• Strong experience with SQL and relational databases, including Postgre
  
  SQL and Oracle.
• Proven experience developing RESTful APIs and documenting interfaces using OpenAPI.
• Solid understanding of event‑driven architectures and asynchronous processing patterns.
• Experience writing and maintaining unit and integration tests using pytest or similar frameworks.
• Ability to obtain and maintain a Public Trust clearance.
• Bachelor’s degree or higher.
• Experience with data lakehouse architectures.
• Familiarity with XBRL taxonomy parsing and structured financial data.
• Background in financial data processing or regulatory systems.
• Experience with streaming data platforms using AWS Kinesis.
• Experience implementing OIDC‑based authentication and authorization.
• Familiarity with Golden Gate or change data capture (CDC) patterns for data replication and migration.

• Analytical Thinking:
  The ability to observe and interpret information, break down complex problems into parts, identify patterns/relationships and draw logical conclusions to develop effective solutions.
• Synthetic Thinking:
  The ability to combine different ideas, information, or concepts to create a new, complex understanding or solution by integrating disparate elements into a new, meaningful whole.
• Adaptability:
  Comfort with change, flexibility in the face of shifting demands and resilience to setbacks.
• Ownership & Accountability:
  Committed to taking responsibility for outcomes, ensuring that all commitments are met with a focus on enhancing service delivery.
• Consultative Advising:
  Identifies and articulates client challenges, scopes projects and aligns recommendations to business goals and client expectations.
• Communicating with Influence:
  Capable of crafting and delivering clear, persuasive messages that integrate data insights and structured narratives, tailored to the strategic needs of diverse audiences to drive effective decision‑making.
• Managing Priorities & Client Alignment:
  Skillfully negotiates and manages conflicting priorities to strategically align decisions, enhancing service delivery and client satisfaction.

• Ability to sit for extended periods while working on a computer or during meetings.
• Must be able to…