Principal Data Engineer -Python​/AI

ARKA INNOVATE is hiring on behalf of our client for a Principal Data Engineer with Python/AI.

Role:

We are seeking a highly skilled Principal Data Engineer with strong experience in Python and AI-driven application development. The ideal candidate will have hands‑on experience building scalable production systems that leverage LLMs and modern backend architectures. This role involves designing intelligent, high-performance services and collaborating closely with cross‑functional teams to deliver impactful solution.

Minimum 15+ years of experience in IT Industry.

Strong backend engineering expertise in Python
, including:

• Object-Oriented Programming (OOP)
• Type hinting and modern typing practices
• Asynchronous programming (async/await)
• Proven experience working on complex, production-grade systems

Hands‑on experience building applications powered by LLMs or advanced AI
, such as:

• Information extraction
• Semantic search
• Classification and matching systems

Solid understanding of agentic architectures and orchestration patterns
, including:

• Tool/API calling agents
• Background processing workflows
• Job runners and schedulers

Strong experience in data modeling and schema design
, including:

• Use of type‑safe models (e.g., Pydantic or similar)
• Designing robust data contracts

Experience building and consuming FastAPI-based services
, including:

• Event-driven integrations (webhooks, message queues)
• Asynchronous processing pipelines

Ability to work with high-scale data systems
, including:

• Performance optimization
• Efficient I/O handling
• Batching and vectorized operations

Strong debugging and problem‑solving skills:

• Log analysis
• Metrics interpretation
• Experiment‑driven troubleshooting in complex systems

Experience with
cloud‑based infrastructure and data stores
, such as:

• Object storage systems
• No
  
  SQL/document databases
• Search/indexing systems
• Exposure to any major cloud provider

Proficiency with modern Python development tools:

• Dependency management
• Virtual environments
• Testing frameworks
• Linters/for matters
• CI/CD integration

Strong understanding of API security
, including:

• Authentication and Authorization (AuthN/AuthZ)
• OAuth2 / OpenID Connect flows

Solid experience with SQL databases
, including:

• SQL Server
• Azure SQL
• Oracle
• PostgreSQL

Excellent communication skills:

Translate business needs into technical solution skills.

Ability to ask the right questions

Challenge ambiguous requirements

At Arka Innovate, we are proud to be an Equal Opportunity Employer
. We are committed to creating an inclusive environment for all employees and do not discriminate on the basis of race, color, religion, gender, sexual orientation, national origin, age, disability, veteran status, or any other legally protected status.