SS
Big Data Administrator & Development Engineer
full-time•Bengaluru
About this role
Description
Are you passionate about data platforms, high-performance systems, and large-scale data processing? Join our innovative team as a Big Data Administrator & Development Engineer, where you’ll be responsible for ensuring the stability, security, and efficiency of on-premise Big Data environments. You will manage and enhance clusters based on Hadoop, Kafka, and Druid, while also contributing to automation, system optimization, and strategic architectural decisions.
This role combines deep technical administration with development responsibilities, offering the opportunity to work on cutting-edge data infrastructure that powers critical business insights and decision-making.
Key Responsibilities
• Manage and Optimize Big Data Clusters
Ensure the reliable, secure, and high-performance operation of on-premise Hadoop, Kafka, and Druid clusters, proactively monitoring performance and system health.
• Implement and Maintain Monitoring Solutions
Deploy and maintain monitoring and alerting tools such as Cloudera Manager and Splunk to track system availability, detect anomalies, and ensure proactive issue resolution.
• Administer Access and Security Controls
Manage role-based access control (RBAC), encryption, and compliance policies to safeguard data integrity and meet security standards.
• Develop and Automate Data Workflows
Design and implement ETL processes, data transfers, and analysis pipelines using SQL, NiFi, Python, or Spark to support evolving business requirements.
• Support Architectural and Technical Evolution
Collaborate with cross-functional teams on architecture design, system upgrades, and technology evaluations to improve scalability, reliability, and performance.
Required Qualifications
• Minimum 8 years of hands-on experience in administering on-premise Hadoop, Kafka, and Druid clusters.
• Proven expertise with HDFS, Hive, Spark, Hue, and NiFi in enterprise data environments.
• Strong SQL proficiency, including query tuning and performance optimization.
• Solid understanding of Linux system administration and cluster maintenance best practices.
• Experience with automation and scripting tools such as Ansible, Python, or Bash.
Preferred Qualifications
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Experience developing ETL pipelines and integrating diverse data sources.
• Familiarity with cloud-based Big Data platforms (Azure preferred).
• Knowledge of disaster recovery, high-availability architectures, and runbook creation.
• Excellent English communication skills and ability to collaborate effectively in agile, cross-functional teams.
|
#bethechange We look forward to receiving your application. ∗ SMA is committed to diversity and equal opportunity - unattached of gender, age, origin, religion, disability or sexual orientation. |
What you'll do
- The Big Data Administrator & Development Engineer will manage and optimize on-premise Big Data clusters, ensuring their stability and performance. They will also implement monitoring solutions and develop data workflows to support business needs.
About SMA Solar Technology AG
Innovative and sustainable key technologies are prerequisites for renewable energy supply. More than 3,500 employees from 18 countries work to ensure that SMA is actively helping to promote the production and development of PV system technology worldwide.
SMA is the only inverter manufacturer worldwide that offers the right inverter for every module type and system size ; for small residential systems, medium-sized commercial systems and large-scale plants; grid-connected photovoltaic systems; and off-grid and hybrid systems.
SMA also develops technologically leading system solutions and is on the leading edge of the energy of the future, in areas such as intelligent optimization of self-consumption, grid integration of solar power and integration of batteries for more effective use of renewable energies.
The intention of this LinkedIn profile is to share expert knowledge in inverter technology, interesting reference projects and new products in the field of commercial and large-scale solar power plants and to discuss today’s and future energy supply structures and solutions. We are looking forward to your comments, questions and feedback.
Corporate information: https://www.sma.de/en/corporate-information.html
Data Protection: https://www.sma.de/en/data-protection-declaration.html
Ready to join SMA Solar Technology AG?
Take the next step in your career journey
Frequently Asked Questions
What does a Big Data Administrator & Development Engineer do at SMA Solar Technology AG?
As a Big Data Administrator & Development Engineer at SMA Solar Technology AG, you will: the Big Data Administrator & Development Engineer will manage and optimize on-premise Big Data clusters, ensuring their stability and performance. They will also implement monitoring solutions and develop data workflows to support business needs..
Is the Big Data Administrator & Development Engineer position at SMA Solar Technology AG remote?
The Big Data Administrator & Development Engineer position at SMA Solar Technology AG is based in Bengaluru, India. Contact the company through Clera for specific work arrangement details.
How do I apply for the Big Data Administrator & Development Engineer position at SMA Solar Technology AG?
You can apply for the Big Data Administrator & Development Engineer position at SMA Solar Technology AGdirectly through Clera. Click the "Apply Now" button above to start your application. Clera's AI-powered platform will help match your profile with this opportunity and guide you through the application process.