More jobs:
USA_Engineer
Job in
Dorchester, Suffolk County, Massachusetts, 02122, USA
Listed on 2026-06-01
Listing for:
Varite, Inc
Full Time
position Listed on 2026-06-01
Job specializations:
-
IT/Tech
Data Engineer, Big Data
Job Description & How to Apply Below
Pay Rate Range: $53.57 - 55.14/hr.
GBaMS ReqID:
AWS Databricks
Job Description s:
What you will be responsible forAs a Data Engineer| you will Use your understanding of large scale data processing and analytics to wrangle our unique cybersecurity data and create automation| analyses and tools that point to the most significant business| governance| and risk management impacts.
Participate in the design and buildout of petabyte scale systems for high availability| high throughput| data consistency| security| and end user privacy| defining our next generation of data analytics tooling Build data modeling| automation| and ELT workflows to produce Raw| Rationalized| co-Related| and Reporting data flows for graph| time series| structured| and semi-structured cybersecurity data Education Qualifications
Minimum Qualifications B.S.| or M.S. in Computer Science or equivalent work experience 5 years of experience building large scale distributed systems and data analytics processes on cloud native| in-memory| and fit-for-purpose hybrid infrastructure.
Experience with cybersecurity data and globally distributed log event processing systems with data mesh and data federation as the architectural core is highly desirable.
Experience in big data technologies like Presto Trino| Spark Flink| Airflow Prefect| Red Panda Kafka| Iceberg Delta Lake| Snowflake Databricks| Mem Graph Neo4J as well as modern security tooling like Splunk| Panther| Datadog| Elastic| Arcsight etc.
Experience designing and building data warehouse| data lake or lake house using batch| streaming| lambda and data mesh solutions and with improving efficiency| scalability| and stability of system resources.
Experience working with data warehouses or Databases like Snowflake| Redshift| Postgres| Cassandra etc
Experience writing and optimizing complex SQL and ETL development and designing and building data warehouse| data lake or lake house solutions.
Experience building Data APIs and integrations using tools like Graph
QL| Apache Arrow| gRPC| Proto Buf| designing large scale stream processing systems with Flink| Kafka| NiFI| and similar technologies.
Experience with distributed systems and distributed data storage and large-scale data warehousing solutions| like Big Query| Athena| Snowflake| Redshift| Presto| etc.
Experience working with large datasets and best in class data processing technologies for both stream and batch processing| graph and time series data| notebooks and analytic visualization environments.
Strong communication and collaboration skills particularly across teams or with functions like data scientists or business analyst.
Preferred Experience
5 years of experience with Python| Java| or similar languages| with cloud infrastructure (e.g. AWS| GCP| Azure)| and deep experience working with big data processing infrastructures and ELT orchestration
Experience developing distributed batch and real-time feature stores| and developing coordinated batch| streaming and online model execution workflows| building and optimizing large scale data proc
Skills:
Category Name Required Importance Experience Skill Category Test1 _MN Databricks Yes 1 > 7 years
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×