Snowflake Data Engineer

Overview

Job Description - Snowflake Data Engineer (054530)

• Strong Snowflake Developer with 6+ years of experience in SQL Development and Data Analysis required to develop new complex data pipelines/warehouse
• At least 2 full years of recent Snowflake experience (Snowflake atop AWS)
• In-depth knowledge of Cloud services
• Experience in Databases like Oracle / AWS RDS etc.
• Hands-on experience with Snowflake utilities;
  SnowSQL, Snow Pipe
• Able to administer and monitor Snowflake computing platform
• Handling large and complex sets of XML, JSON, and CSV from various sources and databases
• Solid grasp of database engineering and design
• Experience with any scripting languages, preferably Python – usually as wrapper/housekeeping
• Leveraged frameworks & orchestration like Airflow as required for ETL pipeline
• Identify bottlenecks and bugs in the system and develop scalable solutions
• Responsible for analyzing and building Snowflake SQLs
• Unit Test & Document deliverables

• Snowflake atop AWS (Azure as secondary)
• Strong SQL
• Other SQL based databases, like Oracle, SQL Server, etc.
• AWS Cloud knowledge - Overarching AWS Services Skills across the AWS services set
• Specifically: S3 partitioning, Spark
  
  SQL processing, Kafka, Streaming Patterns, Pipelining, etc.
• Acquiring data from internal and external sources, prepping it with minimal ETL in Spark
  
  SQL, landing it in Amazon S3 and loading it into a Snowflake database.
• AWS Database Expertise:
  Snowflake is preferred, Redshift, Vertica and Netezza are nice to have

• Python
• AWS/Glue
• Experience in creation and modification of user accounts and security groups per request
• Create AWS services like Lambda, AWS Glue, Step function, etc.
• Snow Pro Certification
• Experience with an ETL tool, like Infomatica, Talend, Matillion, etc.

Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment.

Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.

Responsible for programming and software development using various programming languages and related tools and frameworks, reviewing code written by other programmers, requirement gathering, bug fixing, testing, documenting and implementing software systems. Experienced programmers are also responsible for interpreting architecture and design, code reviews, mentoring, guiding and monitoring programmers, ensuring adherence to programming and documentation policies, software development, testing and release.

Write software programs using specific programming languages/platforms such as Java or MS .NET, and related tools, platform and environment. Write, update, and maintain computer programs or software packages to handle specific jobs, such as tracking inventory, storing or retrieving data, or controlling other equipment. Consult with managerial, engineering, and technical personnel to clarify program intent, identify problems, and suggest changes. Perform or direct revision, repair, or expansion of existing programs to increase operating efficiency or adapt to new requirements.

Write, analyze, review, and rewrite programs, using workflow chart and diagram, and applying knowledge of computer capabilities, subject matter, and symbolic logic. Write or contribute to instructions or manuals to guide end users. Correct errors by making appropriate changes and then rechecking the program to ensure that the desired results are produced. Conduct trial runs of programs and software applications to be sure they will produce the desired information and that the instructions are correct.

Compile and write documentation of program development and subsequent revisions, inserting comments in the coded instructions so others can understand the program. Investigate whether networks, workstations, the central processing unit of the system, and/or peripheral equipment are responding to a program's…