Information & Technology - Engineer - Software

Job Title:

Data Engineer

Location:

Charlotte, NC

The primary role of the Data Engineer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company’s objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.

• Developer experience specifically focusing on Data Engineering.
• Hands-on experience in Development using Python and Pyspark as an ETL tool.
• Experience in AWS services like Glue, Lambda, MSK (Kafka), S3, Step functions, RDS, EKS etc.
• Experience in Databases like Postgres, SQL Server, Oracle, Sybase etc.
• Experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions, and triggers.
• Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
• Knowledge in developing UNIX scripts, Oracle SQL/PL-SQL.
• Experience with data models, data mining, data analysis and data profiling.
• Experience in working with REST API's.
• Experience in workload automation tools like Control-M, Autosys etc.
• Good knowledge in CI/CD Dev Ops process and tools like Bitbucket, Git Hub, Jenkins.
• Strong experience with Agile/SCRUM methodology.
• Experience with other ETL tools (Data Stage, Informatica, Pentaho, etc.).
• Knowledge in MDM, Data warehouse and Data Analytics.