Lead Data Engineer
full-time•Kuala Lumpur
About this role
<p><span><strong>The Opportunity</strong></span></p><p><span>Own the data engineering quality bar across our group data platforms. You’ll architect scalable data solutions, drive innovation, and ensure robust data governance, working closely with the UK-based Lead Data Engineer and lead a team of Data Engineers in Malaysia.</span></p><p><span style=""><br></span><span>The successful candidate will be expected to partner with key stakeholders to deliver high-quality data solutions aligned with organisational goals.</span></p><p></p><p><span><strong>Core Responsibilities</strong></span></p><ul><li><p><span><strong>Collaboration:</strong> Work closely with UK teams and the UK Lead Data Engineer to ensure alignment on data strategy, architecture, and processes.</span></p></li><li><p><span><strong>Big Data Architecture:</strong> Design and implement scalable, secure big data solutions using Azure Fabric.</span></p></li><li><p><span><strong>Data Modelling & Governance:</strong> Develop and maintain robust data models and enforce data governance standards across all environments.</span></p></li><li><p><span><strong>Pipeline Management:</strong> Build, optimise, and manage ELT/ETL pipelines, leveraging DBT and modern orchestration tools.</span></p></li><li><p><span><strong>System Integration:</strong> Deliver hands-on system-to-system integrations (HR, Finance, CRM, ERP, Operational Systems), ensuring reliability and scalability.</span></p></li><li><p><span><strong>API & Integration Patterns:</strong> Architect and maintain APIs, monitor integrations, and implement effective error handling strategies.</span></p></li><li><p><span><strong>Code Quality & Agile Delivery:</strong> Champion CI/CD, conduct code reviews, and drive Agile methodologies within the data engineering team.</span></p></li><li><p><span><strong>SQL & Python Excellence:</strong> Apply strong SQL and Python skills to solve complex data challenges and automate processes.</span></p></li><li><p><span><strong>AI & Machine Learning:</strong> Collaborate with data scientists to enable and support AI/ML initiatives, ensuring data readiness and scalability.</span></p></li><li><p><span><strong>Medallion & Data Architecture:</strong> Implement medallion architecture and best practices for data storage, processing, and consumption.</span></p></li><li><p><span><strong>Innovation:</strong> Evaluate and recommend new tools and technologies to enhance data capabilities and drive continuous improvement.</span></p></li><li><p><span><strong>Mentoring & Management:</strong> Coach and develop other data engineers, fostering capability, confidence, and technical excellence.</span></p></li></ul><p></p><p><span><strong>Essential Skills & Tech Stack</strong></span></p><ul><li><p><span>5+ years commercial experience in data engineering, with hands-on expertise in Azure Fabric, Databricks, and Snowflake in production environments.</span></p></li><li><p><span>Proven experience leading a multi-disciplined data engineering team.</span></p></li><li><p><span>Deep understanding of big data architecture, data modelling, and data governance.</span></p></li><li><p><span>Strong experience with CI/CD, code reviews, and Agile delivery (Scrum/Kanban).</span></p></li><li><p><span>Advanced skills in SQL and Python.</span></p></li><li><p><span>Hands-on experience with DBT, ELT/ETL pipeline development, and system integrations.</span></p></li><li><p><span>Familiarity with APIs, integration patterns, monitoring, and error handling.</span></p></li><li><p><span>Experience supporting AI/Machine Learning initiatives.</span></p></li><li><p><span>Track record of recommending and implementing innovative data solutions.</span></p></li><li><p><span>Demonstrated ability to mentor and manage other data engineers.</span></p></li></ul>
What you'll do
- The Lead Data Engineer will own the data engineering quality across group data platforms, architect scalable solutions, and ensure robust data governance. They will collaborate with stakeholders and lead a team of Data Engineers to deliver high-quality data solutions.
About K3 Capital Group
K3 Capital Group brings together specialist advisory brands to support business owners, individuals, their professional advisors and investors at every critical stage of the business and investment lifecycle. Our Group combines expertise in business sales and M&A, tax, restructuring, technology, strategic finance, legal advisory and wealth planning to deliver calm, confident guidance when it matters most. Together, we provide an integrated advisory platform that combines specialist expertise with a shared commitment to unlocking, protecting and realising value.
Our services include business sales and brokerage, corporate finance, off-market deal origination, debt advisory, R&D and capital allowances, tax investigations, general tax advisory, restructuring and insolvency, forensic accounting and eDiscovery, ERP and managed IT, strategic forecasting, legal advisory, wealth management and employee benefits. This breadth allows us to unlock, protect and realise value for clients navigating growth, transition, challenge or exit.
Our Group includes: KBS Corporate, KBS Corporate Finance, Knightsbridge Business Sales, Origin IQ, Knight R&D, randd UK, JE Consulting, HMA Tax, inTAX, K3 Tax Advisory, K3 Advantage, K3 Law, KR8 Advisory, Knight Corporate Finance, Pinnacle, Pareto Financial Planning, Luna Investment Management and Quantuma & Quantuma International.
Headquartered in Bolton with international operations, K3 Capital Group has been part of Sun Capital Partners since 2023.
Ready to join K3 Capital Group?
Take the next step in your career journey
Frequently Asked Questions
What does a Lead Data Engineer do at K3 Capital Group?
As a Lead Data Engineer at K3 Capital Group, you will: the Lead Data Engineer will own the data engineering quality across group data platforms, architect scalable solutions, and ensure robust data governance. They will collaborate with stakeholders and lead a team of Data Engineers to deliver high-quality data solutions..
Is the Lead Data Engineer position at K3 Capital Group remote?
The Lead Data Engineer position at K3 Capital Group is based in Kuala Lumpur, Kuala Lumpur, Malaysia. Contact the company through Clera for specific work arrangement details.
How do I apply for the Lead Data Engineer position at K3 Capital Group?
You can apply for the Lead Data Engineer position at K3 Capital Groupdirectly through Clera. Click the "Apply Now" button above to start your application. Clera's AI-powered platform will help match your profile with this opportunity and guide you through the application process.