Data Engineer
-
IT/Tech
Job Description & How to Apply Below
The program supports modernization efforts by migrating systems to a secure cloud environment and modernizing software that captures, processes, and retains background investigation information for personnel seeking access to sensitive information.
Responsibilities- Design scalable, secure, and high-performance database architectures to support Mirador modernization
- Define data models and storage strategies as aligned with cloud migration goals
- Optimize performance, availability, and disaster recovery across environments
- Collaborate with IVM team to identify data needs for use stories and update unified data model
- Leverage data lake to capture functionality-specific data
- Ensure compliance with data governance, security, and retention policies
- Document database designs, configurations, and operational procedures
- US Citizenship
- Active Top Secret Clearance, or TS eligibility with the ability to complete adjudication/transfer requirements along with a Security + certification on day one
- 7+ years of experience designing, building, and supporting enterprise data engineering solutions and modern data platforms
- Strong expertise in relational databases (PostgreSQL, Oracle, SQL Server) and experience integrating semi-structured and No
SQL data sources (DynamoDB, JSON, APIs) - Extensive experience designing and implementing Medallion Architecture (Bronze, Silver, Gold) and dimensional data models for analytics and operational reporting
- Hands-on experience with Red Shift
- Hands-on experience developing scalable ETL/ELT pipelines using AWS Gule, Apache Spark/PySpark, SQL, and Python
- Experience implementing Change Data Capture (CDC) using AWS DMS to synchronize operational databases with analytical platforms such as Red Shift
- Strong knowledge of cloud-native AWS data services, including Amazon S3, AWS Glue, Red Shift, Lambda, Event Bridge, SQS/SNS, IAM, Cloud Watch, and Secrets Manager
- Experience designing metadata-driven ingestion frameworks, data lineage, and data quality validation processes
- Proficiency in data modeling, schema evolution, data versioning, and master/reference data management
- Strong understanding of event-driven architectures and application/database synchronization patterns
- Experience optimizing SQL, Spark jobs, partitioning strategies, indexing, and Red Shift performance for large-scale datasets
- Experience working within Agile/Scrum teams and collaborating with application developers, architects, and business stakeholders
- Skills in Microsoft Word and Excel
- Excellent verbal and written communication skills
- AWS Certified Data Engineer - Associate or AWS Certified Solutions Architect
- Experience designing enterprise data lakes and lakehouse architectures
- Experience implementing enterprise metadata repositories and data catalogs
- Familiarity with data governance and integration platforms (Qlik and AWS Glue Data Catalog)
- Experience supporting real-time and near-real-time data integration architectures
For more than 20 years, New Gen Technologies has solved our clients' toughest IT challenges with integrity, security, and outstanding service by delivering both technology and talent. We have helped secure borders, have used artificial intelligence (AI) to fight terror, aided the identification of criminals, and have helped to prevent crime through the introduction of biometrics.
Our team of Highly Cleared Specialists have hard-to-find skills and expertise in a wide spectrum of technologies to provide solutions that transform business processes and solve problems of national significance. #CJ
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction