Data Solution Architect

Data Surge is looking for like-minded individuals who are passionate about being at the forefront of data technology. The Data Solutions Architect will be joining an upcoming program supporting US Dept of Justice and is responsible for architecture of AWS/Databricks structure from an existing Informatica legacy platform.

• Designs the target architecture spanning AWS Gov Cloud, Databricks, S3/Delta storage, data layers, governance, identity, network connectivity, job orchestration, and downstream integrations.
• Owns catalog/schema organization, data-zone standards, metadata conventions, and the supported user role model.
• Establishes the preliminary ATO system boundary, control-responsibility model, and architecture decision log - working knowledge of FedRAMP High / NIST 800-53 control families is directly relevant.
• Evaluates serverless-vs-classic compute tradeoffs, including Gov Cloud-specific behavior like whether serverless compute stops metering when idle.
• Produces network architecture diagrams and the interface/data-flow inventory supporting the security boundary narrative.
• Designs toward the SOW's open-standards / anti-vendor-lock-in requirement and the platform's stated data governance framework.

Applicable experience with the following technologies:

• AWS Gov Cloud (Amazon Government Cloud)
• Python 3+;
  Py Spark
• ANSI SQL (minimum)
• Cloudera Hive; HDFS
• Informatica (mappings & mapplets) — being converted, not retained
• Parquet or similar high-performance columnar format
• Change Data Capture (CDC), since the legacy system stays live during the build
• Azure Dev Ops (government-hosted, server-based instance)