Data Engineer; Python, AWS Glue, Airflow, Lambda

Fort Mill, SC, United States (On-site)

Contract (6 months 16 days)

Published 5 days ago

The Senior API Engineer (Python / AWS) is a critical member of the Data Modernization & Integration organization. This role is responsible for designing, building, securing, and operating high quality, cloud native REST APIs that power LPL’s core business platforms and integrations.

This engineer will focus primarily on Python-based API development on AWS, leveraging services such as API Gateway, Lambda, and related AWS components, with all infrastructure managed through Terraform. The role plays an important part in modernizing legacy integrations and defining engineering standards for reliable, secure, and scalable API services.

The ideal candidate combines deep hands‑on Python API engineering expertise with strong cloud architecture skills, a passion for automation, and the ability to collaborate across platform, data, security, and application teams.

• Design, develop, and maintain Python based REST APIs that support business critical workflows.
• Build APIs using AWS Lambda and Amazon API Gateway, following API first and REST best practices.
• Implement clean, testable, and well documented Python code suitable for enterprise production environments.
• Optimize API performance, reliability, scalability, and error handling.
• Ensure proper API versioning, contract stability, and backward compatibility.
• Implement secure authentication and authorization mechanisms such as OAuth2, JWT, and IAM based access; enforce request validation, throttling, rate limiting, and auditing; partner with security teams to meet enterprise security and compliance standards.
• Provision and manage AWS infrastructure using Terraform, including reusable modules for API Gateway, Lambda, IAM roles and policies, and Cloud Watch logging and monitoring; maintain environment consistency across DEV, QA, UAT, and PROD.
• Design and maintain CI/CD pipelines for build, test, and deployment of Python APIs; support automated testing, packaging, versioning, and release management.
• Implement observability through logging, metrics, alerts, and tracing.
• Participate in troubleshooting, root cause analysis, and production support activities.
• Collaborate closely with application teams, platform engineering, cloud, and security teams; align API design and implementation with enterprise architectural standards.
• Actively contribute to code reviews, design discussions, and technical documentation; promote best practices and a culture of engineering excellence.
• Influence API engineering standards, patterns, and best practices across the organization; contribute to architectural reviews and modernization efforts.

We are looking for strong collaborators who deliver reliable, secure, and high quality API solutions in fast paced, team oriented environments. Ideal candidates pursue technical excellence, act with integrity, and are motivated to build scalable platforms that enable business growth. We value continuous improvement, curiosity, and individuals who take ownership and pride in their work.

• 7+ years of experience in software engineering, API engineering, or cloud application development.
• Bachelor’s degree in Computer Science, Engineering, or related field (Master’s preferred).
• Hands‑on experience with Python for backend and API development, REST API design and implementation, AWS Lambda and Amazon API Gateway, and Terraform for Infrastructure as Code.
• Experience building and operating APIs in large scale, production environments.
• Strong understanding of authentication, authorization, and secure API design.
• Experience with CI/CD, Git based workflows, and automated testing.
• Ability to troubleshoot production issues and support on‑call rotations when required.

• API Design Mindset — builds clean, consistent, and consumer friendly APIs.
• Builder Mindset — emphasizes automation, reuse, and simplicity.
• Systems Thinking — understands how APIs integrate with distributed systems.
• Collaboration — works effectively across engineering, security, and platform teams.
• Ownership & Accountability — takes responsibility for design, delivery,…