Big Data Developer

Job Duties And Responsibilities

• Build processes that support data transformation, data structures, metadata, dependency and workload management.
• Build and implement data ingestion and curation processes developed using Big data tools such as Spark (Scala/Python), Hive, HDFS, Sqoop, HBase, Kerberos, Sentry and Impala.
• Handle ingestion of large volumes of data from various platforms for analytics needs and write high-performance, reliable and maintainable ETL code. Demonstrate strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.
• Write shell scripts along with complex SQL queries, Hadoop commands and use Git.
• Create database schemas and Hive tables (external and managed) with various file formats (Orc, Parquet, Avro, Text, etc.).
• Monitor performance of production jobs and advise on necessary infrastructure changes.
• Work on code versioning using Bitbucket and CI/CD pipeline.

Bachelor’s degree in Computer Science, IT, Engineering or related field with at least 60 months of experience. Travel and relocation to various client locations throughout the United States may be required.

To apply, send resume to  including the JOB  Opportunity Employer.