ApTask
Hadoop Administrator
Salary: $110k to $120k per annum
Responsibilities
- Deploy and maintain Hadoop clusters, adding and removing nodes using cluster monitoring tools such as Ganglia, Nagios, or Cloudera Manager.
- Configure and manage NameNode high availability.
- Track all running Hadoop jobs and monitor cluster connectivity and performance.
- Implement, manage, and administer overall Hadoop infrastructure.
- Take care of day‑to‑day operations of Hadoop clusters.
- Collaborate closely with database, network, BI, and application teams to ensure that all big‑data applications are highly available and perform as expected.
- Manually set up core configuration files (core-site.xml, hdfs-site.xml, yarn-site.xml, mapred-site.xml) across distributions such as Hortonworks, Cloudera, or MapR.
- Plan capacity and estimate requirements for scaling cluster size based on data stored in HDFS.
- Manage and review Hadoop log files, conduct backup and recovery tasks, and handle resource and security management.
- Troubleshoot application errors related to the Hadoop ecosystem.
Qualifications
- Minimum 5 years of experience deploying, maintaining, and managing Hadoop clusters.
- Proficiency with cluster monitoring tools and high availability configurations.
- Strong understanding of Hadoop distributions (Hortonworks, Cloudera, MapR) and their configuration files.
- Experience with capacity planning and scaling of Hadoop clusters.
- Ability to collaborate across cross‑functional teams and troubleshoot complex issues.
About ApTask
ApTask is a leading global provider of workforce solutions and talent acquisition services, dedicated to shaping the future of work. As an African American‑owned and Veteran‑owned company, ApTask offers a comprehensive suite of services including staffing, recruitment solutions, managed services, IT consulting, and project management. ApTask fosters a diverse and inclusive work environment and provides opportunities for professional growth and development.
#J-18808-Ljbffr