Back to jobs
New

Senior Data Engineer

London

Super Payments

Super Payments is the only global fintech platform providing 0% processing fees for merchants. Our mission is to use data and AI to make payments free for businesses, so that everyone wins. 

At Super, we are disrupting payments, like Spotify did to music and Robinhood did to trading. We don't make money from transaction fees;  instead, we monetise through value-added services such as lender commissions and FX. Our platform supports multiple payment methods — from traditional cards to direct bank transfers via open banking, as well as Apple Pay, Google Pay, and our own Buy Now Pay Later solution. 

Super has raised $66M from leading investors including Accel, Union Square Ventures and Local Globe (the same investors behind Spotify, Stripe, Monzo) and founded by Samir Desai CBE, co-founder of Funding Circle. 

Already trusted by thousands of businesses and more than 4 million customers, Super is processing at a run rate of £1.5B and growing 4x YOY

Our Values

  • Customer obsessed: We only succeed when our customers do.
  • Move fast: Build, test and improve quickly. Progress matters more than perfection.
  • Own it: Be accountable, solve problems, and make it happen.
  • Be open: Act with honesty and respect. Transparency builds trust.
  • Win together: Collaboration beats ego every time.

Senior Data Engineer

Role Overview

We run an event-driven data platform on AWS and Snowflake. Events flow from our product services through EventBridge, Kinesis Firehose, S3, and are auto-ingested into Snowflake via Snowpipe; batch and third-party data lands through Snowpark-deployed Python procedures. All infrastructure is defined in Terraform/Terragrunt. Python (Poetry, Pydantic, pytest) is our pipeline language; GitHub Actions runs CI/CD. Datadog gives us end-to-end pipeline observability.

Key Responsibilities

Ingestion & Pipeline Engineering

  • Event Pipeline Ownership: Build and evolve the EventBridge → Firehose → S3 → Snowpipe ingestion path, including partitioning and throughput tuning as event volumes grow across streams like fraud, payments and merchant.
  • Batch & Third-Party Integrations: Design and deploy Snowpark-based Python procedures for file-based and third-party data loads, scheduled and monitored as Snowflake Tasks.
  • Schema Evolution: Work with product engineers to manage upstream schema changes and late-arriving data without breaking downstream consumers.

Infrastructure & Reliability

  • Infrastructure as Code: Own and extend Terraform/Terragrunt modules for ingestion infrastructure across multiple environments.
  • Pipeline Observability: Design Datadog monitors and alerting for Firehose, EventBridge, DLQs and Snowpipe; triage and resolve ingestion failures.
  • Security & Compliance: Manage PII handling (hashing, secure deletion), masking, data governance and access in Snowflake. Support audit-ready, reconciled data for Finance and Compliance.

Data Pipelines & Data Quality

  • Dbt: Build privacy-first data pipelines using dbt and Snowflake Dynamic Tables to safely expose sensitive data for downstream analytics and reporting.
  • Data Quality: Build testing and monitoring for ingestion and transformation logic to catch issues before they reach the business or the Analytics Engineering team.
  • Stakeholder Collaboration: Partner with the wider Engineering team and Analytics Engineering team as a downstream consumer, to ensure pipelines deliver accurate, audit-ready data.

Requirements

We'd love it if you have

  • AWS & Event-Driven Architecture: Hands-on experience with streaming/event ingestion (Kinesis, EventBridge or equivalents), S3 partitioning, and queue/DLQ patterns.
  • Infrastructure as Code: Terraform experience required; Terragrunt a plus. Comfortable owning modules across environments, not just consuming them.
  • Snowflake & Warehouse Engineering: Strong SQL for Snowflake, including Snowpipe, Tasks and Snowpark.
  • Dbt: Proven experience in building well tested SQL and python models in dbt.
  • CI/CD & Data Security: Experience with GitHub Actions (or equivalent), and secrets/key management, PII and sensitive data handling in Snowflake.
  • Python Coding: Python skills for pipeline and infrastructure code (typed models, testing, CI-deployed services),  not just scripting or analysis.

Engineering Ownership

Technical Communication: A pragmatic, systems-level mindset with the ability to explain pipeline failures, infrastructure trade-offs, or data-flow issues clearly to both engineers and non-technical stakeholders.

  • Ownership & Initiative: A strong willingness to work independently, take initiative, and take full ownership of the pipelines and infrastructure you build, from design and implementation through to production reliability.
  • Production Mindset: Proactively monitoring, debugging, and improving pipelines and infrastructure in production, not just building them and moving on.

*The stated experience and background is a guide and does not preclude applications from candidates with more or less experience, provided the requisite skills can be demonstrated.

Our Benefits - here’s a few and more to come ….

  • Tax advantage Share Options
  • Flexible working model
  • Work from home set up
  • Learning & Development opportunities
  • Contributory Pension Scheme
  • Free Team lunch (Tues & Thurs) and social evenings
  • Comprehensive PMI & x4 Life Insurance
  • Your birthday off, plus one Revival day

If you are excited about sharing the adventure, joining a growing team with big ambitions and you are really great at what you do, then apply now!

Super Payments is an equal opportunity employer, embracing diversity in all its forms and fostering an inclusive environment. The company will not unlawfully discriminate on grounds of gender, sexual orientation, marital or civil partner status, gender reassignment, race, religion or belief, colour, nationality, ethnic or national origin, disability or age, neurodiversity status, pregnancy or trade union membership. 

Please let us know if you require any reasonable adjustments at any point during the application and/or recruitment process. 

Create a Job Alert

Interested in building your career at Super Payments? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

Resume/CV*

Accepted file types: pdf, doc, docx, txt, rtf

Cover Letter

Accepted file types: pdf, doc, docx, txt, rtf

Select...
Select...

When you apply to a job on this site, the personal data contained in your application will be collected by Super Payments Ltd (“Controller”), which is located at 123 Buckingham Palace Road, London, United Kingdom, SW1W 9SR (and can be contacted by emailing support@superpayments.com). Super Payments Ltd’s data protection officer is Jag Thind, who can be contacted at dataprotection@superpayments.com. Your personal data will be processed for the purposes of managing Super Payments Ltd recruitment related activities, which include setting up and conducting interviews and tests for applicants, evaluating and assessing the results thereto, and as is otherwise needed in the recruitment and hiring processes. Such processing is legally permissible under Art. 6(1)(f) of Regulation (EU) 2016/679 (General Data Protection Regulation) as necessary for the purposes of the legitimate interests pursued by the Controller, which are the solicitation, evaluation, and selection of applicants for employment.

 

Your personal data will be shared with Greenhouse Software, Inc., a cloud services provider located in the United States of America and engaged by Super Payments Ltd to help manage its recruitment and hiring process on Super Payments Ltd’s behalf. Accordingly, if you are located outside of the United States, your personal data will be transferred to the United States once you submit it through this site. Because the European Union Commission has determined that United States data privacy laws do not ensure an adequate level of protection for personal data collected from EU data subjects, the transfer will be subject to appropriate additional safeguards under the standard contractual clauses. You can obtain a copy of the standard contractual clauses by contacting us at dataprotection@superpayments.com

 

Your personal data will be retained by Super Payments Ltd as long as Super Payments Ltd determines it is necessary to evaluate your application for employment. Under the GDPR, you have the right to request access to your personal data, to request that your personal data be rectified or erased, and to request that processing of your personal data be restricted. You also have the right to data portability. In addition, you may lodge a complaint with an EU supervisory authority.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Super Payments’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

Select...
Select...
Race & Ethnicity Definitions

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305
Page 1 of 1
OMB Control Number 1250-0005
Expires 07/31/2029

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

  • Alcohol or other substance use disorder (not currently using drugs illegally)
  • Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
  • Blind or low vision
  • Cancer (past or present)
  • Cardiovascular or heart disease
  • Celiac disease
  • Cerebral palsy
  • Deaf or serious difficulty hearing
  • Diabetes
  • Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
  • Epilepsy or other seizure disorder
  • Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
  • Intellectual or developmental disability
  • Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
  • Missing limbs or partially missing limbs
  • Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
  • Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
  • Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
  • Partial or complete paralysis (any cause)
  • Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
  • Short stature (dwarfism)
  • Traumatic brain injury
Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.