Big data hadoop admin

Comviva · Gurgaon

  • Experience4–10 yrs
  • SalaryNot disclosed
  • Work modeonsite
  • Posted1 Oct 2026

About Comviva

Comviva is hiring in Gurgaon in technology software. This role looks for around 4+ years of experience.

Skills

  • Hadoop
  • HDFS
  • Linux
  • Hadoop cluster administration
  • HDFS administration
  • Kerberos
  • Ambari
  • Cloudera Manager
  • Shell scripting
  • Python
  • Performance tuning
  • Monitoring
  • RHEL

The role

A Hadoop administrator at a technology software company installs and manages Hadoop clusters, HDFS administration, and Linux administration, while applying Kerberos authentication and Shell scripting to maintain secure, scalable platform operations. The role also uses Python and performance tuning for automation and reliability.

Full job description

Key Responsibilities

Install, configure, and manage HDP/CDP clusters in Linux environments. Perform Hadoop cluster administration, monitoring, and health checks. Manage HDFS storage, capacity planning, and space allocation. Configure and maintain NameNode High Availability (HA). Create, manage, and decommission cluster nodes as required. Deploy hardware, software, patches, and platform upgrades. Monitor cluster performance and perform tuning for optimal resource utilization. Manage HDFS file systems, permissions, quotas, and storage optimization. Troubleshoot Hadoop, Linux, infrastructure, and application-related issues. Configure and maintain security controls, including Kerberos authentication. Create and manage Linux users, groups, and Hadoop service accounts. Monitor and analyze logs to identify and resolve operational issues. Automate routine administrative activities using scripting and tools. Collaborate with infrastructure, application, network, database, and business teams to support platform operations. Maintain platform documentation and drive continuous improvement initiatives.

Required Technical Skills

Strong hands-on experience with Hadoop and Big Data platforms. Expertise in Linux administration, preferably RHEL. Experience with Ambari and/or Cloudera Manager. Strong knowledge of HDFS administration, storage management, and performance optimization. Experience deploying, configuring, and maintaining Hadoop clusters. Good understanding of cluster resource management and scalability concepts. Knowledge of networking, infrastructure, and security fundamentals. Experience with Kerberos authentication and access management. Strong troubleshooting, monitoring, and performance tuning skills. Familiarity with patch management, software upgrades, and environment maintenance. Experience with Shell scripting, Python, or other automation tools. Strong analytical, problem-solving, and debugging capabilities.

Preferred Qualifications & Experience

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. 4-10 years of experience in Hadoop Administration, Big Data Operations, or Platform Support. Experience working with enterprise-scale Hadoop deployments. Exposure to cloud-based Big Data platforms is an added advantage. Hadoop, Cloudera, or Linux certifications preferred.

Key Competencies

Strong ownership and operational excellence mindset. Effective communication and stakeholder management skills. Ability to work in a fast-paced production support environment. Strong collaboration and cross-functional coordination skills. Focus on reliability, scalability, security, and continuous improvement.