Software Engineer, Data

About Us

the company was founded in 2013 by BTG Pactual Group as a commodities trading company. Our business model is “asset light” and highly diversified – giving us the ability to adapt effectively and nimbly to changing market conditions. We have assembled successful multidisciplinary teams, leveraging advanced fundamental analysis with deep quantitative and weather research capabilities. Our activities are underpinned by strong risk management practices and by powerful technology and operational excellence.

We have exceptional teams with diverse global backgrounds and decades of experience, and are driven by a highly collaborative culture, across products and competencies.

In 2024, the company acquired Trailstone, a global energy trading and technology company. The acquisition provides us with new expertise, analytics and proprietary technology which is being used to provide risk management and optimisation services to help maximise the value of our clients’ renewable power. The acquisition also expanded the company’s capabilities into physical natural gas across North America, a critical fuel to support the energy transition.

Our talented and experienced individuals work together according to its four company values:
Performance, Agility, Collaboration, Entrepreneurship
.

As a member of the Data team, you will build the services, infrastructure and data platforms that power our business. Our team is responsible for ingesting, processing, storing and distributing large volumes of data reliably and efficiently, enabling teams across the business to make data-driven decisions and build innovative products. This role sits at the intersection of backend software engineering and data engineering.

You will develop scalable backend services, design and maintain data pipelines and build the underlying data infrastructure that enables reliable, cost-effective, and high-performance data processing.

You'll work closely with other engineering teams, data consumers and infrastructure specialists to build robust solutions that balance technical excellence with delivering business value. While the role involves technical collaboration across the organisation, it is primarily focused on engineering rather than stakeholder management.

This will be a full-time role, owning the following responsibilities:

• Design, develop and maintain scalable backend services and APIs that support data ingestion, processing and distribution.
• Build and maintain reliable data ingestion pipelines for structured and unstructured data from a wide variety of internal and external sources.
• Develop reusable frameworks and tooling that simplify onboarding new data sources and improve developer productivity.
• Design and optimise scalable data platforms including databases, data lakes, metadatacatalogues and storage solutions.
• Continuously improve the reliability, scalability, observability and cost-efficiency of our data infrastructure.
• Integrate data across multiple systems while reducing duplication and ensuring high data quality.
• Develop and maintain orchestration workflows and automated data processing pipelines.
• Build internal libraries and services that enable other engineering teams to access and consume data efficiently.
• Monitor, troubleshoot and optimise production systems and data pipelines.
• Contribute to architecture discussions and technical decisions across the data platform.
• Collaborate closely with software engineers, data engineers, infrastructure engineers and data consumers to deliver high-impact solutions.
• Continuously identify opportunities to simplify systems, improve automation and reduce operational overhead.

This person will be an experienced Data Engineer with hands-on backend development experience. We hope this person will have ambitions to develop their technical knowledge within Commodity Trading, by developing and maintaining in-house systems using the latest technology stack. We are looking for someone who enjoys solving complex technical problems, takes ownership of their work, and can make pragmatic engineering decisions that maximise impact.

As a result, the following experiences and skills are essential for application:

• Strong software engineering fundamentals with experience building production backend systems in the financial services industry.
• Professional experience developing applications and services using Python in the financial services industry.
• Experience designing and maintaining RESTful APIs and backend services.
• Experience building and maintaining data pipelines or large-scale data processing systems.
• Strong SQL skills and experience working with relational databases.
• Experience working with cloud platforms such as AWS.
• Experience working with containerised applications and modern software delivery practices.
• Familiarity with messaging and asynchronous processing patterns.
• Experience with infrastructure automation and CI/CD pipelines.
• Strong understanding of software design principles, testing and…