C
Senior / Staff Full-Stack Data Engineer – Databricks (Pune)
full-time•Pune
About this role
<div><strong>Job Title: Senior / Staff Full-Stack Data Engineer – Databricks </strong></div><p style="margin-bottom:0cm;"><strong>About Us</strong></p><p style="margin-bottom:0cm;">At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.</p><div><br></div><p style="margin-top:0cm;margin-right:0cm;margin-bottom:23.35pt; margin-left:-.25pt;line-height:110%;"><b>Job Description: Senior / Staff Full-Stack Data Engineer – Databricks</b></p><h1 style="margin-left:-.25pt;">Role Overview</h1><p style="margin-top:0cm;margin-right:0cm;margin-bottom:23.55pt; margin-left:-.25pt;">We are seeking a Senior / Staff Full-Stack Data Engineer with deep Databricks expertise to design, build, and operate scalable data and machine learning pipelines. This role works closely with data scientists, platform teams, and application engineers to productionize analytics and ML workloads with high reliability, performance, and cost efficiency.</p><h1 style="margin-left:-.25pt;">Key Responsibilities</h1><p style="margin-left:6.1pt;text-indent:-6.1pt;">Design, build, and maintain ETL/ELT pipelines on Databricks using Spark, Delta Lake, andDatabricks Workflows</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Build and operate batch and real-time data pipelines for ingestion, transformation, andorchestration</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Operationalize machine learning inference pipelines authored by data scientists (batch andreal-time)</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Ensure consistency between model training and inference environments</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Implement data quality checks, validation rules, monitoring, alerting, and automated recovery- Collaborate with data scientists to productionize models and optimize inference performance and cost</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Implement CI/CD, DevOps, and MLOps best practices for data pipelines and ML workflows</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Optimize compute, storage, and job configurations for performance and cost efficiency- Implement and manage enterprise data governance using Unity Catalog (schemas, lineage, ownership, documentation)</p><p style="margin-top:0cm;margin-right:0cm;margin-bottom:23.5pt; margin-left:6.1pt;text-indent:-6.1pt;">Work with Databricks infrastructure and platform configurations</p><h1 style="margin-left:-.25pt;">Required Skills & Experience</h1><p style="margin-left:6.1pt;text-indent:-6.1pt;">Strong hands-on experience with Databricks, Apache Spark, and Delta Lake</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Proven experience building and operating production-grade data pipelines</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Experience operationalizing machine learning models and inference pipelines</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Strong understanding of data reliability, observability, and monitoring practices</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Experience with CI/CD, DevOps, and MLOps workflows</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Experience working with cloud platforms (AWS or Azure)</p><p style="margin-top:0cm;margin-right:0cm;margin-bottom:23.55pt; margin-left:6.1pt;text-indent:-6.1pt;">Familiarity with Unity Catalog and enterprise data governance concepts- Experience with spec-driven development and coding agents</p><h1 style="margin-left:-.25pt;">Nice to Have</h1><p style="margin-top:0cm;margin-right:69.5pt;margin-bottom: .15pt;margin-left:6.1pt;text-indent:-6.1pt;">Experience with Databricks infrastructure tuning and cost optimization</p><p style="margin-top:0cm;margin-right:69.5pt;margin-bottom: 23.55pt;margin-left:6.1pt;text-indent:-6.1pt;">Exposure to streaming frameworks and real-time data processing- Experience with Infrastructure-as-Code (Terraform or similar)</p><h1 style="margin-left:-.25pt;">What Success Looks Like</h1><p style="margin-left:6.1pt;text-indent:-6.1pt;">Reliable, scalable, and cost-efficient Databricks data and ML pipelines</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Smooth productionization of ML models with strong collaboration across teams</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">High data quality, observability, and platform stability</p><p style="margin-left:6.1pt;text-indent:-6.1pt;">Well-governed data assets with clear ownership and lineage</p><p style="margin-top:4.0pt;margin-right:0cm;margin-bottom:4.0pt; margin-left:0cm;"><br></p>
What you'll do
- The Senior / Staff Full-Stack Data Engineer will design, build, and maintain ETL/ELT pipelines on Databricks, ensuring high reliability and performance. The role involves collaborating with data scientists to operationalize machine learning models and optimize data pipelines.
About Codvo.ai
At Codvo.ai, we specialize in leveraging artificial intelligence, cloud, and data to solve complex business problems and drive innovation. Our passion for innovation drives us to deliver solutions that not only meet but exceed your unique business needs, fostering smarter, more productive teams. Here’s why our approach has earned widespread acclaim from our clients:
67 Customer NPS: Our Net Promoter Score is a testament to the high level of satisfaction and loyalty among our clients. It underscores our ability to deliver quality and value through our specialized services, making us a preferred partner for businesses looking to leverage AI and data for competitive advantage.
78 Employee NPS: The satisfaction and engagement of our team directly influence the quality of service we provide. Our high employee NPS signifies a motivated, dedicated team that's committed to excellence. This positive work culture ensures that we can deliver exceptional AI-first engineering and enterprise data application services to you.
Our approach goes beyond traditional software development; we're dedicated to partnering with you to harness the power of AI and data. The combination of our high trial and engagement success rates, extensive experience, and positive feedback from both clients and employees positions us as more than just a service provider. We're your trusted ally in navigating the complexities of today's digital landscape, committed to transforming your vision into a reality with cutting-edge AI and data solutions.
Ready to join Codvo.ai?
Take the next step in your career journey
Frequently Asked Questions
What does a Senior / Staff Full-Stack Data Engineer – Databricks (Pune) do at Codvo.ai?
As a Senior / Staff Full-Stack Data Engineer – Databricks (Pune) at Codvo.ai, you will: the Senior / Staff Full-Stack Data Engineer will design, build, and maintain ETL/ELT pipelines on Databricks, ensuring high reliability and performance. The role involves collaborating with data scientists to operationalize machine learning models and optimize data pipelines..
Is the Senior / Staff Full-Stack Data Engineer – Databricks (Pune) position at Codvo.ai remote?
The Senior / Staff Full-Stack Data Engineer – Databricks (Pune) position at Codvo.ai is based in Pune, India. Contact the company through Clera for specific work arrangement details.
How do I apply for the Senior / Staff Full-Stack Data Engineer – Databricks (Pune) position at Codvo.ai?
You can apply for the Senior / Staff Full-Stack Data Engineer – Databricks (Pune) position at Codvo.ai directly through Clera. Click the "Apply Now" button above to start your application. Clera's AI-powered platform will help match your profile with this opportunity and guide you through the application process.