Staff Engineer (Cloudera CDP & Hadoop Administration)
About this role
Company Description
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at a scale — across all devices and digital mediums, and our people exist everywhere in the world (18500+ experts across 40 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job Description
Requirements
- Experience : 5.5+ years
- Hands-on Tier-2 production experience in Cloudera CDP and Hadoop administration.
- Strong experience installing, configuring, maintaining, and troubleshooting Cloudera CDP environments.
- Experience with Cloudera CDP 7.1.9 or later and Cloudera Data Services, including versions 1.5.4 and 1.5.5.
- Strong understanding of Hadoop ecosystem components, particularly Spark, Hive, and YARN.
- Proven experience troubleshooting Spark, Hive, and YARN jobs in production environments.
- Experience optimizing Cloudera cluster performance, resource utilization, and workload execution.
- Strong understanding of CDP security configuration and implementation of security and regulatory requirements.
- Hands-on experience with automation using Ansible, Shell scripting, Terraform, Groovy, and Python.
- Experience building and managing automated CI/CD pipelines and workflows using GitHub Actions, Jenkins, ArgoCD, or equivalent tools.
- Good understanding of GitOps practices and source control using Git.
- Experience with containerization technologies such as Podman, Docker, Kubernetes, and OpenShift/OCP.
- Knowledge of Infrastructure as Code (IaC) concepts and automated infrastructure provisioning.
- Experience implementing observability and monitoring for data platforms and production environments.
- Experience automating security, compliance, regulatory checks, and patching activities.
- Strong Linux administration and basic networking knowledge.
- Experience working in Agile engineering and DevOps-oriented environments.
- Strong troubleshooting, analytical, and problem-solving skills with the ability to support critical production data platforms.
- Ability to collaborate effectively with data engineers, infrastructure teams, security teams, and other technical stakeholders.
Responsibilities
- Administer, install, configure, maintain, and support Cloudera CDP and Hadoop environments in Tier-2 production environments.
- Perform installation, configuration, upgrades, patching, and ongoing maintenance of the latest supported Cloudera CDP versions, including CDP 7.1.9 or later.
- Configure and implement security requirements across Cloudera CDP environments, including automated security and regulatory compliance checks.
- Configure and maintain Cloudera Data Services, including versions 1.5.4, 1.5.5, and later supported releases.
- Troubleshoot and resolve production issues related to Spark, Hive, and YARN jobs.
- Monitor and optimize cluster health, resource utilization, capacity, and overall CDP performance.
- Work closely with data engineering teams to troubleshoot and optimize Spark job performance and resource utilization.
- Implement automation for cluster administration, operational processes, security checks, patching, and data/analytics workloads.
- Develop automation scripts and infrastructure workflows using Shell, Ansible, Terraform, Groovy, and Python.
- Design and maintain CI/CD pipelines and automated workflows for data projects using tools such as GitHub Actions, Jenkins, and ArgoCD.
- Implement GitOps-based deployment and operational practices for data and analytics platforms where applicable.
- Support containerized Cloudera Data Services using technologies such as Podman, Docker, Kubernetes, and OpenShift Container Platform (OCP).
- Automate infrastructure provisioning and configuration using Infrastructure as Code (IaC) practices.
- Implement and maintain observability solutions for Cloudera clusters, data services, jobs, and infrastructure components.
- Perform automated patching and support lifecycle management activities across the platform.
- Collaborate with engineering, data, infrastructure, security, and operations teams to resolve production issues and improve platform reliability.
- Maintain source code, automation scripts, configurations, and deployment artifacts using Git-based source control.
- Follow Agile engineering practices and contribute to continuous improvement, operational automation, and platform standardization.
Qualifications
Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Company at a glance
Nagarro helps future-proof your business through a forward-thinking, fluidic, and CARING mindset. We excel at digital engineering and help our clients become human-centric, digital-first organizations, augmenting their ability to be responsive, efficient, intimate, creative, and sustainable. Today, we are 18,500+ experts across 40 countries, forming a Nation of Nagarrians, ready to help our customers succeed.
Tired of cold applications?
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Know someone who'd be great for this?