KEY INFORMATION Position: Senior Data Engineer Reporting to: Data Engineering Manager Location: Manchester Overview of the Role: As a Senior Data Engineer, you will be an integral part of a cross-functional feature devel…
About us You've probably heard of Autotrader, but do you know what we're all about? We're the most trusted, most visited automotive marketplace in the UK. A heritage brand and a tech innovator. We bring together vehicle …
Are you a finance professional with a strong background in bank reconciliations and cash posting, looking for an opportunity to develop your career within a growing technology business? ClearCourse is looking for an Acco…
Skills: Bank reconciliations, Cash posting, Intercompany accounting, Billing, Settlements
At UBDS Group, with our portfolio including UBDS Digital and Rayo, we are dedicated to fostering an entrepreneurial spirit by investing in innovators who harness technology to drive meaningful change. To support our cont…
Skills: Microsoft Fabric, Solution architecture, Microsoft Azure, Cloud services, Enterprise architecture
Cyber Response and Recovery - Assistant Manager (Reactive)
Manchester, England, United Kingdom · Hybrid
Mid level
Cyber Response & Recovery Assistant Manager (Reactive DFIR) This role requires current SC or DV clearance, or eligibility and willingness to obtain clearance. About the role The Cyber Response & Recovery Assistant Manage…
Skills: Digital Forensics, Incident Response, Case Management, Network Intrusion Analysis, Threat Intelligence
Cyber Response & Recovery Manager (Remediation) This role requires current SC or DV clearance, or eligibility and willingness to obtain clearance. About the role The Cyber Response & Recovery Manager role will sit within…
Our Team: How We Enrich Everyday Life You’ll be joining Bauer Media Audio (BMA), Europe’s biggest commercial audio broadcaster, connecting audiences across nine markets to the music, stories and experiences they love. Ba…
Line of Service Internal Firm Services Industry/Sector Technology Specialism Technology Strategy Management Level Manager Job Description & Summary At PwC, our people in software and product innovation focus on developin…
A bit about us At Gamma we provide voice, data, and mobile solutions to businesses across the UK, Germany, Spain, and the Benelux region. Our people are at the heart of everything we do. When you join us, you’ll be…
Job Purpose To successfully plan and oversee the delivery of projects to new and existing customers. To be a positive member of the Everything Tech Group team. Key Tasks and Responsibilities Project Management To take ac…
The role & impact As a CX Specialist, you will be a passionate Xero brand ambassador , responsible for providing timely, high-quality support and guidance to customers of all levels, from beginners to experts. This inclu…
Skills: Customer support, Problem-solving, Communication, Active listening, Empathy
As one of the world's largest networks of audit, tax and consulting firms, RSM delivers big ideas and premium service to help middle-market businesses thrive. We are a fast-growing firm with big ambitions -- we have a cl…
Skills: Cloud Data Engineering, Microsoft Fabric, Azure Databricks, Azure Data Services, Lakehouse Architecture
Location - Manchester Salary - Competitive dependent on experience Accenture level - CL9 Specialist / Team Lead Quality Automation Engineer About Accenture Accenture is a leading global professional services company, pro…
As one of the world's largest networks of audit, tax and consulting firms, RSM delivers big ideas and premium service to help middle-market businesses thrive. We are a fast-growing firm with big ambitions -- we have a cl…
Skills: Workday Reporting, Workday Prism, Workday Extend, Power BI, MS Office Connectivity
As one of the world's largest networks of audit, tax and consulting firms, RSM delivers big ideas and premium service to help middle-market businesses thrive. We are a fast-growing firm with big ambitions -- we have a cl…
Contract Type: Fixed Term 24 months Hours: Full Time, 35 hours per week Closing Date: 23:59 on Tuesday 25th August 2027 Salary: £35,251.00 to £44,064.00, dependent on your location, skills, knowledge and experience Locat…
Product Marketing Manager, Trust, Privacy and AI (UK Remote)
Manchester, England, United Kingdom · Remote OK
Senior
Company Description When you join Turnitin, you'll be welcomed into a company that is a recognized innovator in the global education space. For more than 25 years, Turnitin has partnered with educational institutions to …
Skills: Product Marketing, B2B SaaS, Data Privacy, Security, Artificial Intelligence
Manchester, England, United Kingdom · Remote Solely
Mid level
Mindrift is looking for highly skilled Web Scraping specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skill…
Skills: Python, Web Scraping, Data Extraction, Data Processing, BeautifulSoup
About us You've probably heard of Autotrader, but do you know what we're all about? We're the most trusted, most visited automotive marketplace in the UK. A heritage brand and a tech innovator. We bring together vehicle …
Skills: Data analysis, SQL, Python, R, A/B testing
Lead Implementation Manager Department: IT & Change Employment Type: Permanent - Full Time Location: Manchester, UK Description We are looking for a Lead Implementation Manager to own the end-to-end technical delivery of…
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Full-time
bachelor degree
Performance-based bonuses, Career advancement opportunities, Equity opportunities, Payments industry training, Continuous professional training, Personalized individual development plan
Posted 1d ago
~40 hrs/week
Responsibilities
You will design, build, and operate secure, scalable data ingestion and platform capabilities using Databricks and Azure. This role involves collaborating within a cross-functional squad to deliver reliable data pipelines and automated workflows for a payments intelligence platform.
Requirements
The role requires at least 3 years of professional experience in data or systems engineering with strong proficiency in Python, Spark, and Azure Databricks. Candidates must possess a STEM-related degree and expertise in CI/CD, production troubleshooting, and data pipeline architecture.
Full job description
KEY INFORMATION
Position: Senior Data Engineer
Reporting to: Data Engineering Manager
Location: Manchester
Overview of the Role:
As a Senior Data Engineer, you will be an integral part of a cross-functional feature development squad You will play a key role in the evolution of our payments intelligence platform towards a Databricks-native and increasingly agentic operating model. You will design, build and operate secure data ingestion, orchestration and platform capabilities, using Databricks as the first-choice execution platform and Azure services where appropriate. The focus remains on production data engineering rather than AI model development: creating reliable, observable and well-governed foundations that can be operated by both engineers and automated/agentic workflows. You will work across client onboarding, data retrieval, ELT, CI/CD and platform reliability to deliver continuous business value.
JOB ROLEKey accountability of this role:
Delivery, support and continuous improvement of secure, scalable, Azure/Databricks data capabilities and infrastructure on our payments intelligence platform.
Key responsibilities will include:
· Collaborate within a cross-functional squad to define and deliver scalable, secure data and platform capabilities aligned with business outcomes.
· Design Databricks-native solutions as the default, using Spark/SQL, Lakeflow Jobs, Unity Catalog, Volumes and Databricks Asset Bundles, with Azure services used where they add value.
· Build and operate data retrieval and ingestion across APIs, SFTP/FTPS and browser automation, migrating suitable orchestration from external services into Databricks-native workflows.
· Own client data onboarding flows, including configuration, historical backfills, validation, data quality, monitoring and operational handover.
· Build reusable platform capabilities and guardrails that enable agentic workflows to safely automate onboarding, operational diagnosis and routine engineering tasks, with human approval where required.
· Engineer for production reliability through observability, alerting, retries/idempotency, failure recovery, performance and cost optimisation; investigate complex failures and drive root-cause fixes.
· Deliver changes through version control, automated testing, CI/CD and Infrastructure as Code, maintaining secure coding and deployment standards through code review.
· Apply strong security and governance practices across Unity Catalog, Entra/RBAC, secrets, credentials and data access.
· Use advanced Python with strong SQL/Spark skills to develop maintainable, reusable libraries, frameworks and data pipelines.
· Mentor data engineers and drive continuous improvement, evaluating new Databricks and automation capabilities against clear technical and business value.
WHAT WE’RE LOOKING FORYou are a great match if:
· 3+ years professional experience as a Data Engineer, DevOps Engineer or Systems Engineer delivering production data platforms.
· Strong hands-on experience with Azure Databricks, including Spark/SQL, workflow orchestration and production lakehouse data engineering.
· Advanced proficiency in Python for data retrieval, processing, automation, integration and reusable engineering libraries.
· Experience designing and operating ETL/ELT pipelines with data quality controls, schema handling, monitoring and failure recovery.
· Expertise in CI/CD, version-controlled deployment and automated testing for data or platform workloads.
· Experience integrating data through APIs and secure file transfer (SFTP/FTPS), including secure handling of credentials and secrets.
· Strong Microsoft Azure knowledge, including ADLS, Azure DevOps and Entra/RBAC, with experience designing and deploying infrastructure.
· Strong production troubleshooting, problem-solving and operational support skills.
· Degree in Computer Science, Mathematics, Physics or other STEM related subject.
What we offer…
Excellent performance-based earning opportunity, including Objective-driven bonuses.
Ability to advance career and expand professional experiences in a hyper-growth company.
Future opportunity for equity, rewarded to high performers.
Payments industry training and continuous training in respective role.
Personalised individual development plan, aligned to professional goals.
Related keywords
Data EngineerDatabricksAzureSparkSQLPythonETLELTCI/CDInfrastructure as CodeUnity CatalogAPISFTPObservabilityData GovernanceAutomation
As the world's leading payments consultancy, we work with hundreds of Global 500 merchants saving them millions every year. We work with you and your partners to harness the power of data to maximize payments performance – all with the goal of boosting the profitability of every transaction.
Offices: 55 Ivan Allen Jr Blvd NE, Atlanta, Georgia 30308, US · Oxford Place, 61, Oxford Street, Manchester, United Kingdom M1 6EQ, GB · 1111 6th Ave, San Diego, California 92101, US · Breite Str. 27, Düsseldorf, 40213, DE · 477 Pitt St, Sydney, New South Wales, AU
How many Software jobs are open in Manchester, United Kingdom right now?
There are currently 486 open software positions in Manchester, United Kingdom listed on Clera. New openings are added daily as companies post roles.
Which companies are hiring for Software roles in Manchester, United Kingdom?
Companies currently hiring include bet365, BNY, NCC Group, Capgemini, Canopius Group, among others. Browse the listings above to see every active employer.
Are there remote or hybrid Software jobs in Manchester, United Kingdom?
Yes — 384 of the 486 open software positions offer remote or hybrid work (68 remote, 316 hybrid).
How do I apply for Software jobs in Manchester, United Kingdom?
Each listing links directly to the employer's application page. Apply early — fresh listings get the most recruiter attention in the first two weeks.