About this role
The Kafka Developer is responsible for designing, developing, and maintaining event-driven data pipelines and streaming solutions within the project ecosystem. The role focuses on enabling scalable, reliable, and loosely coupled microservices using Apache Kafka, tightly integrated with Spring Boot applications, CI/CD pipelines, and cloud platforms.
Day-to-Day Responsibilities
- Design and develop Kafka producers and consumers using Java and Spring Kafka to support event-driven workflows.
- Collaborate with Full Stack and backend teams to define event models, message contracts, and topic strategies.
- Design and manage Kafka topics, partitions, replication factors, and retention policies based on business and performance needs.
- Implement event-driven integration patterns, enabling asynchronous communication between microservices.
- Develop stream processing applications using Kafka Streams, including filtering, transformations, aggregations, and joins.
- Implement schema management using Avro, JSON, or Protobuf, ensuring backward and forward compatibility.
- Apply Kafka security best practices, including SSL/TLS, SASL authentication, ACLs, and secure data transmission.
- Design robust error-handling mechanisms, including retries, dead-letter topics, and idempotent message processing.
- Optimize Kafka performance by tuning producer/consumer configurations, partition strategies, and batching.
- Integrate Kafka-based services with Spring Boot microservices deployed on AWS, VMware TAS, or container platforms.
- Contribute to CI/CD pipelines for automated build, test, and deployment of Kafka applications.
- Monitor Kafka clusters and applications using Prometheus, Grafana, ELK, or native Kafka metrics.
- Perform production support and BAU activities, including troubleshooting message lag, consumer failures, and cluster issues.
- Conduct root cause analysis for incidents and implement preventive improvements.
- Participate in Agile ceremonies, including sprint planning, daily stand-ups, reviews, and retrospectives.
- Maintain technical documentation, including topic catalogs, event schemas, and integration guidelines.
- Continuously improve system reliability, scalability, and maintainability by adopting industry best practices.
- Stay updated on Kafka ecosystem enhancements and streaming technologies and proactively suggest improvements.
Other facts
About Encora
Encora is a global digital engineering company built for a new era of AI-powered businesses. Forged in Silicon Valley, we grew up serving digital natives who demanded speed, scale, and flawless experiences. Today, we bring that same DNA to enterprises worldwide, enabling speed and hyper-adaptability, moving them further along their quest to become more composable and agile.
With two decades at the convergence of Cloud, Data, and AI, we help organizations move beyond rigid, legacy models to become composable enterprises, through adaptive systems designed to sense change and reconfigure in real time.
More than 9,500 engineers, designers, and domain experts across the Americas, Europe, India, and Southeast Asia give Encora the ability to combine nearshore agility with global scale. Backed by Advent International and Warburg Pincus, we deliver innovation acceleration and modernization across industries, powered by Encora AIVA™, our orchestration platform for AI-native engineering.
We believe the future won’t be built by humans or machines alone, but by human creativity amplified by limitless machine intelligence. At Encora, that’s how we help our clients build fast and adapt faster.
What you'll do
- The Kafka Developer is responsible for designing, developing, and maintaining event-driven data pipelines and streaming solutions. This includes collaborating with teams to define event models and implementing integration patterns for microservices.
Ready to join Encora?
Take the next step in your career journey