Data Engineer ( Bigdata AWS & Snowflake

Data Engineer (Bigdata with AWS & Snowflake)

Get AI-powered advice on this job and more exclusive features.

Base pay range: $/yr - $/yr

• Involved in the Study of the business logic and coordinate with the client to gather the requirements.
• Experience with Hive, Nifi, Airflow, Snowflake and Kafka
• Experience in Cloud environments, particularly AWS - EC2, S3, Lambda
• Experience in Unit testing, integration testing for Spark scripts
• Scripting with Bash, CSH, Shell, or Python
• Designing and implementing large-scale ingest systems in a Big Data environment
• Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
• Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
• Developing custom solutions/code to ingest and exploit new and existing data sources
• Working with Sponsor development teams to improve application performance
• Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
• Collaborating with team‑mates, other service providers, vendors, and users to develop new and more efficient method
• Experience with CI/CD pipelines, unit tests, integration, and regression testing
• Significant experience with Airflow
• Strong ability to manage competing priorities and communication to multiple stakeholders
• Bachelor’s degree in computer science, Computer Engineering, or a related discipline with experience in software design and development.

• Discretionary Annual Incentive
• Comprehensive Medical Coverage:
  Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support:
  Maternal & Parental Leaves
• Insurance Options:
  Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth:
  Commuter Benefits & Certification & Training Reimbursement
• Time Off:
  Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance:
  Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Entry level

Full-time

Information Technology

IT Services and IT Consulting

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x

Locations:
Annapolis Junction, MD ($150,000 - $170,000, 1 week ago);
Washington, DC ($145,000 - $204,000, 2 weeks ago);
Washington, DC ($ - $, 3 months ago);
Rockville, MD ($ - $, 3 months ago).

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.