Lead Data Engineer

## Lead Data Engineer Apply remote type:
Hybrid locations:
WI Madison:
MA Boston time type:
Full time posted on:
Posted Todayjob requisition :
R38244

This position collects, stores, processes and builds applications within our big data platform. Responsible for integrating these applications with the architecture used across the organization.

Position Compensation Range:$ - $Pay Rate Type:

Salary
* Compensation may vary based on the job level and your geographic work location.
* * Relocation support is offered for eligible candidates.
*** This position has approval to transfer a valid H1 visa.
**** Primary Accountabilities*
* • Leads an engineering team to meet project deadlines and priorities.  
• Supervises assigned data engineering team members & activities.  
• Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.  
• Documents critical workflows and operational support aspects of team’s responsibilities  
• Develops deep understanding of data sources, granularity, availability, and limitations.  
• Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.  
• Creates maintainable, scalable code to load and manipulate data in the data warehouse.  
• Facilitates communication upward and across project teams and business stakeholders.

** Specialized Knowledge & Skills Requirements*
* • Demonstrated experience providing customer-driven solutions, support or service.  
• In-depth knowledge of SQL or No

SQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)  
• Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.

• Able to employ design patterns and generalize code to address common use cases.

• Capable of authoring robust, high quality, reusable code and contributing to the division’s inventory of libraries.  
• Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.  
• Applied knowledge of cloud computing (AWS, GCP, Azure).  
• Knowledge of open source machine learning toolkits, such as sklearn, Spark

ML, or H2O.  
• Solid data understanding and business acumen in the data rich industries like insurance or financial  
• Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).  
• Strong understanding of database internals, such as indexes, binary logging, and transactions.  
• Experience using tools for infrastructure-as-code (e.g. Docker, Cloud Formation, Terraform, etc.)  
• Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).  
• Practical experience authoring and consuming web services.
Licenses:  
• Not Applicable.
Travel Requirements  
• Up to 10%.

Physical Requirements  
• Work that primarily involves sitting/standing.
Working Conditions  
• Not Applicable.### Additional Information
* To ensure a strong start, all employees participate in our New Employee Orientation during their first week.  This experience is held in person at our Madison, WI Headquarters or one of our AmFam core locations to help you connect with our mission, meet key team members and build relationships that support your growth.  At times, sessions may be delivered virtually based on scheduling and availability.
* Offer to selected candidate will be made contingent on the results of applicable background checks
* Offer to selected candidate is contingent on signing a non-disclosure agreement for proprietary information, trade secrets, and inventions
* Sponsorship will not be considered for this position unless specified in the posting
We provide benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, 9 paid holidays and a paid time off program (23 days accrued…