Bengaluru, Karnataka, India · On-site
Job Summary- We are hiring a Lead Data Engineer to drive the development of a modern data platform for an insurance client. This role combines technical leadership and hands-on engineering, focusing on building scalable …
Skills: Snowflake, DBT, Fivetran, SQL, Python
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Lead the development of a modern data platform for an insurance client by building scalable ingestion frameworks and transformation workflows. The role involves managing end-to-end delivery, mentoring team members, and ensuring data quality and pipeline reliability.
Requires 6-10 years of data engineering experience with strong proficiency in Snowflake, DBT, and Fivetran. Candidates should have expertise in SQL, Python, and workflow orchestration tools like Prefect or Airflow.
Job Summary-
We are hiring a Lead Data Engineer to drive the development of a modern data platform for an insurance client.
This role combines technical leadership and hands-on engineering, focusing on building
scalable data pipelines and enabling analytics using Snowflake, dbt, and Fivetran.
The ideal candidate thrives in greenfield environments, can handle complex source systems, and enforces engineering discipline without over-engineering.
Key Responsibilities
a) Lead end-to-end delivery of data engineering initiatives, ensuring alignment with business goals and timelines
b) Design and implement scalable ingestion frameworks across APIs, files, databases, and SaaS systems (including Fivetran SDK), handling schema drift, incremental loads, and historical backfills
c) Collaborate with stakeholders across business, analytics, and IT teams to define requirements and success metrics
d) Build and maintain dbt workflows (models, tests, macros, snapshots) with a focus on staging and scalable transformation design
e) Integrate data from Guidewire, Mainframe, APIs, and other enterprise systems
f) Implement orchestration workflows using Prefect or equivalent tools
g) Set up CI/CD pipelines using GitHub Actions and manage deployments via dbt Cloud
h) Ensure data quality, reliability, and efficient pipeline performance across ingestion and transformation layers
Mentor team members and drive engineering best practices
i) Implement logging, metrics, monitoring, and alerting frameworks to ensure pipeline reliability
j) Proactively detect and resolve failures, performance bottlenecks, and data quality issues
k) Apply agile principles to iterate quickly, adapt to change, and contribute to continuous improvement
l) Implement data organization, partitioning, and lifecycle policies (archival, retention, cost control) to support efficient ingestion and historical backfills
m) Contribute to the evolution of the data platform, supporting future expansion into curated and analytics-ready data layers
Required Skills
a) Strong hands-on experience in Snowflake, DBT (Core/Cloud), and Fivetran (including SDK/custom connectors preferred)
b) Proficiency in SQL and Python
c) Build and maintain transformation workflows using DBT (models, tests, macros, snapshots)
d) Optimize Snowflake performance (query tuning, clustering, cost optimization)
e) Solid experience in workflow orchestration (Prefect preferred; Airflow acceptable)
f) Hands-on experience with CI/CD pipelines (GitHub Actions or similar)
g) Exposure to AWS Glue, insurance domain or enterprise data systems is a plus
h) Exposure on AI Driven documentation using data dictionaries and source docs to populate dbt
descriptions for objects & columns
i) Familiarity with APIs, semi-structured data (JSON/XML), and data lakes
j) Solid understanding of data warehouse concepts, dimensional modeling, and metadata management.
Preferred Qualifications
a) 6–10 years in Data Engineering
b) Prior experience in a Lead or Senior role preferred
c) Experience with Cloud platforms (Azure, AWS, or GCP).
d) Exposure to monitoring/observability tools (Datadog, CloudWatch, Snowflake Query History, etc.).
e) Background in analytics, BI tools, or data governance.
f) Design and manage raw data landing zones in Amazon S3 to support file-based ingestion and archival strategies
AI-first engineering solutions strategically designed to unlock business value & intelligently propel enterprises ahead
Innover is an award-winning AI-first engineering firm, transforming businesses through Experience Engineering, Digital Engineering, and Process Engineering. Our interconnected competencies seamlessly deliver comprehensive industry solutions—Experience Engineering shapes visionary strategies, Digital Engineering brings them to life, and Process Engineering ensures flawless execution. With deep technical expertise and business acumen, we’ve empowered over 65 Fortune 1000 companies to accelerate growth and transformation. Leading analysts consistently recognize our capabilities across Data and Analytics, Artificial Intelligence, and Intelligent Process Automation, solidifying our position as a trusted partner in driving innovation and success. Headquartered in Alpharetta, Georgia, Innover operates global delivery centers in India, Mexico and an advanced Center of Excellence dedicated to driving innovation and measurable impact. Our industry footprint spans Digital Supply Chains, Manufacturing and Logistics, Telecom, Technology and Media, Consumer and Retail, Energy and Utilities, Banking and Financial Services, Tax Technology, and more. We’ve earned prestigious accolades, including the Supply Chain Brain Award and the Top Supply Chain Project Award for four consecutive years, the Top Software and Tech Award, and recognition for Digital Transformation Excellence. Our vibrant culture of growth and camaraderie has been celebrated with the Best Workplace Award and the Happiest Workplace Award, reinforcing our commitment to fostering excellence both within and beyond our organization.
Offices: 221 Roswell St, 172, Alpharetta, Georgia 30009, US · A-154/A, 1st Floor, A Block, Sector 63, Noida, Uttar Pradesh 201301, IN · Tower-1, 23rd Floor, Bidhannagar, Srijan Corporate Park, PS, Kolkata, West Bengal 700091, IN · 12th Floor, Brigade Metropolis, Summit-B, Awfis, Mahadevapura, Bengaluru, Karnataka 560048, IN
AI-first engineering solutions strategically designed to unlock business value & intelligently propel enterprises ahead
Innover is an award-winning AI-first engineering firm, transforming businesses through Experience Engineering, Digital Engineering, and Process Engineering. Our interconnected competencies seamlessly deliver comprehensive industry solutions—Experience Engineering shapes visionary strategies, Digital Engineering brings them to life, and Process Engineering ensures flawless execution. With deep technical expertise and business acumen, we’ve empowered over 65 Fortune 1000 companies to accelerate growth and transformation. Leading analysts consistently recognize our capabilities across Data and Analytics, Artificial Intelligence, and Intelligent Process Automation, solidifying our position as a trusted partner in driving innovation and success. Headquartered in Alpharetta, Georgia, Innover operates global delivery centers in India, Mexico and an advanced Center of Excellence dedicated to driving innovation and measurable impact. Our industry footprint spans Digital Supply Chains, Manufacturing and Logistics, Telecom, Technology and Media, Consumer and Retail, Energy and Utilities, Banking and Financial Services, Tax Technology, and more. We’ve earned prestigious accolades, including the Supply Chain Brain Award and the Top Supply Chain Project Award for four consecutive years, the Top Software and Tech Award, and recognition for Digital Transformation Excellence. Our vibrant culture of growth and camaraderie has been celebrated with the Best Workplace Award and the Happiest Workplace Award, reinforcing our commitment to fostering excellence both within and beyond our organization.
Offices: 221 Roswell St, 172, Alpharetta, Georgia 30009, US · A-154/A, 1st Floor, A Block, Sector 63, Noida, Uttar Pradesh 201301, IN · Tower-1, 23rd Floor, Bidhannagar, Srijan Corporate Park, PS, Kolkata, West Bengal 700091, IN · 12th Floor, Brigade Metropolis, Summit-B, Awfis, Mahadevapura, Bengaluru, Karnataka 560048, IN
