AVP Applications Development Sr Programmer Analyst

We are strategically building an A-team of highly skilled and autonomous individuals. We are seeking a Senior Data Developer to join one of our small, co‑located, high‑performing squads. This role demands a hands‑on contributor who can develop, implement, and optimize robust, scalable, and real‑time data solutions within our Hadoop ecosystem and streaming platforms.

The ideal candidate will possess deep technical expertise in big data technologies, including real‑time data streaming with Kafka, with a proven track record of end‑to‑end project delivery within the banking domain. We also need an AI‑first thinker who is adept at leveraging cutting‑edge AI coding tools to maximize efficiency and innovation. This role requires strong technical contribution in solution development, proficiency in developing data ingestion, advanced analytics, and comprehensive reporting solutions, and active collaboration within agile, focused teams.

The successful candidate will ensure optimal performance, security, and governance of our data infrastructure, with a keen focus on integrating and advancing AI/ML capabilities, while also mentoring and elevating the skills of others. High autonomy and agency are baseline expectations.

• Develop and implement scalable and efficient data solutions within the Hadoop ecosystem, ensuring alignment with enterprise data strategy and best practices for small, co‑located teams.
• Develop, implement, and manage complex Hadoop‑based data pipelines and real‑time streaming solutions, demonstrating high autonomy and end‑to‑end ownership.
• Implement robust real‑time data streaming solutions using technologies such as Apache Kafka, proactively identifying and integrating performance enhancements.
• Collaborate effectively within a small, agile squad, translating diverse data requirements from engineers and scientists into detailed technical specifications and practical implementations.
• Optimize Hadoop clusters and real‑time streaming applications for performance, scalability, and efficient resource utilization, ensuring high throughput and low latency.
• Maintain and monitor the Hadoop and streaming infrastructure to ensure high availability, reliability, and data integrity, proactively identifying and resolving issues with minimal oversight.
• Implement comprehensive data security and governance policies, adhering to strict regulatory and compliance standards prevalent in the banking sector, with a deep understanding of their functional impact.
• Stay abreast of the latest advancements and emerging trends in big data technologies, real‑time analytics, AI/ML, and AI coding tools, recommending and integrating innovative, AI‑first solutions to enhance team capabilities.
• Troubleshoot and resolve complex issues within the Hadoop ecosystem and real‑time streaming platforms efficiently, acting as a mentor for less experienced team members.
• Develop Spark‑based solutions to support near real‑time data ingestion, advanced analytics, and comprehensive reporting, demonstrating hands‑on expertise.
• Contribute to the implementation of AI/ML models within data pipelines, focusing on data preparation, feature engineering, and seamless model deployment in production environments, and mentor others on best practices.
• Participate in MLOps initiatives to streamline the machine learning lifecycle, including continuous integration, continuous delivery, and continuous training, emphasizing efficiency gains through AI‑driven development.
• Take full ownership of end‑to‑end project delivery for data initiatives, from conceptualization through implementation, testing, and deployment, ensuring projects are delivered on time, within scope, and with exceptional quality.

• 7+ years of proven experience in developing, implementing, and optimizing complex Hadoop‑based and real‑time data platforms, with a strong emphasis on senior, hands‑on contributions.
• Solid hands‑on experience in AI/ML and modern AI coding tools.
• Practical exposure to building ML models and coding tools such as Devin and Copilot for development is preferable.
• Strong understanding of Hadoop ecosystem components, including HDFS, YARN,…