Leading IT Consulting and Outsourcing company in MEA, UK, Europe and India region
About the Company
KBC Technologies is an ISO Certified global IT solutions provider specializing in IT secondment, consulting, and outsourcing services. With operations across 14+ countries, KBC focuses on supporting clients in verticals like BFSI, Telecom, Government, and Retail. The company offers innovative technology solutions to expand business operations on a global scale.
About the Role
A Hadoop Admin is required for a global IT solutions provider. The role involves performing Big Data Administration and Engineering tasks across platforms such as Hadoop, Kafka, HBase, and Spark. The successful candidate will have 6+ years of experience and expertise in Hadoop, Kafka, Hive, Spark, HDFS, Linux, and PySpark. The role requires troubleshooting, debugging, capacity planning, and implementing high-availability solutions. Automation and scripting skills in Ansible, Shell, or Python are essential.
Key Responsibilities
-
Administer and engineer Big Data platforms including Hadoop, Kafka, HBase, and Spark.
-
Troubleshoot and perform root cause analysis of production incidents.
-
Implement high-availability solutions for services with single points of failure.
-
Plan and perform capacity expansions and upgrades to prevent scaling issues.
-
Automate repetitive tasks using Shell scripting, Ansible, or Python scripting.
-
Set up observability and alerting systems to proactively identify performance issues.
-
Collaborate with Level-3 teams to enhance cluster reliability and performance.
-
Create and maintain standard operating procedures for platform management.
-
Ensure platform performance and meet service level agreement (SLA) requirements.
-
Perform security remediation, automation, and self-healing tasks.
-
Develop automation tools and reports to streamline operations and reduce manual effort.
Required Skills
-
6+ years of experience in Hadoop Admin or related roles.
-
Strong expertise in Hadoop, Kafka, Hive, Spark, HDFS, Linux, and PySpark.
-
Proficiency in Shell scripting, Ansible, or Python scripting.
-
Experience in DevOps tools and practices.
-
Knowledge of incident, problem, and change management disciplines.