Data Engineer - AI Labs

Bengaluru · On-site

About this role

Job Requirements

About the Role

The Data Engineer GenAI within the Data & Analytics function will work closely with Data Scientists to support the development of generative AI solutions across text, audio, image, and tabular data domains. This role is responsible for managing large volumes of structured and unstructured data, ensuring its efficient storage, retrieval, and augmentation to power GenAI models and applications. The ideal candidate will be skilled in building robust data pipelines, optimizing data architecture, and ensuring high standards of data reliability and governance.

Key Responsibilities

Primary Responsibilities
  • Build and maintain data engineering pipelines, with a focus on unstructured data.
  • Conduct requirements gathering and scoping sessions with business users and stakeholders to define GenAI-related data needs.
  • Design, build, and optimize data architecture and ETL pipelines for accessibility by Data Scientists and GenAI products.
  • Manage the full data lifecycle: ingestion, transformation, and consumption.
  • Ensure high standards of data reliability, integrity, and governance.
  • Work with APIs to enable seamless data integration and usability.
  • Create technical design documentation for data pipelines and projects.
  • Debug technical issues and manage code versioning using Git.
  • Demonstrate experience with big data infrastructure such as MapReduce, Hive, HDFS, YARN, HBase, MongoDB, DynamoDB, etc.
Secondary Responsibilities
  • Apply machine learning and predictive analytics techniques where relevant.
  • Leverage domain knowledge in banking or financial services to enhance data solutions.
  • Present data insights using effective storytelling and visualization techniques.

What We Are Looking For

Education
  • Bachelor’s or master’s degree in computer science or Data Engineering or Information Systems or a related field.
Experience
  • 2+ years of Proven experience in building and managing data pipelines and architectures.
  • Hands-on experience with big data technologies and cloud platforms (AWS, GCP, or Azure).
  • Exposure to GenAI applications and working with unstructured data formats.
Skills and Attributes
  • Strong programming and debugging skills.
  • Proficiency in data architecture, ETL design, and pipeline optimization.
  • Familiarity with API integration and cloud services.
  • Ability to work collaboratively with cross-functional teams.
  • Excellent documentation and communication skills.
  • Strong problem-solving mindset and attention to detail.
  • Ability to deliver high-quality outputs under tight timelines.


Company at a glance

Never share your password, OTP, UPI Pin, CVV etc with anyone.

Formed in December 2018 through the merger of infrastructure finance giant IDFC Bank and retail finance specialist Capital First, we commenced commercial banking operations in 2016. Our core principles:

Vision: Building a world-class bank in India, driven by ethical, customer-friendly, digital, and socially responsible banking principles.

Universal Bank: Offering a comprehensive range of services like Retail, MSME, Rural, Startups, Cash & Wealth Management, Deposits, Corporate & Government Banking, Working Capital, Trade Finance, and Treasury Solutions.

Ethical Banking: We follow a 'Near and Dear' test, ensuring products are customer-friendly enough for employees to recommend to loved ones. We simplify legal jargon for clarity and offer 'ZERO FEE Banking' on all savings account services like SMS alerts, IMPS, RTGS, NEFT, ATM withdrawals, and more, making it India’s 1st & only bank to do so.

Customer-Friendly Banking: IDFC FIRST Bank credits monthly interest on savings accounts, offers lifetime-free credit cards with non-expiring rewards and transparent fees.

Technology-led Banking: Seamless services across mobile, branches, internet banking, call centres, & relationship managers. Our mobile app, with 250+ features, is rated 4.8 on Google Play & the App Store.
Global rating agency Forrester ranked it India’s best & among the world’s top 20 for two consecutive years.

Social Good Banking: Focusing on financial inclusion, we serve 40M+ customers, with 16M lifestyle improvement loans,15M loans to 4.3M women entrepreneurs, 6.5M vehicle loans, 1M each for sanitation & livelihood, 300K SME, and 100K home loans.

ESG Goals: We hold high ESG scores, demonstrating our commitment to financial inclusion & social responsibility.
Creating a new-age, ethical and world-class institution for India is a privilege for its employees.

Founded2015
Team Size10,001+ employees
WorkspaceOn-site
IndustryBanking
Location
Bengaluru, Karnataka, India

Tired of cold applications?

Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.

Know someone who'd be great for this?