We architect, build and scale leading-edge platforms that underpin your next breakthrough.
About the Company
A leading consultancy firm providing innovative IT solutions, specializing in helping organizations navigate complex challenges. With a strong focus on data, business experience, and technology, this company assists clients in developing and scaling cutting-edge platforms to drive success. Their expertise spans multiple industries, ensuring the development of sustainable, impactful outcomes through systems thinking and integration of business, technology, and data insights.
About the Role
The Hadoop Application Support Specialist will be responsible for supporting and optimizing Hadoop-based applications, ensuring smooth operations within the Hadoop data lake. The position requires 24/7 monitoring, troubleshooting, and addressing issues across multiple projects. The role also involves maintaining a collaborative environment, interacting with development teams, and contributing to the improvement of the existing system infrastructure.
Responsibilities
- Support multiple Hadoop applications, managing competing project deadlines.
- 24/7 monitoring of production applications to meet SLAs.
- Triage and resolve job failures, ensuring timely resolutions.
- Work with upstream and downstream applications to address delays and data-related issues.
- Generate and submit regular reports to senior management.
- Apply knowledge of Hadoop tools (HDFS, MapReduce, Hive, Impala, Spark, Kafka) to troubleshoot and resolve platform-related issues.
- Debug and enhance existing shell scripts (Python, Perl, Bash).
- Collaborate with cross-functional teams to ensure system optimization and reliability.
- Troubleshoot and debug critical issues related to algorithms and software performance.
Required Skills
- Hadoop expertise, particularly with Cloudera.
- Core Java knowledge, with hands-on experience.
- Familiarity with Kafka and other Big Data tools.
- Strong experience with HDFS, MapReduce, Hive, Impala, Spark, Kafka, and Linux/Unix.
- Unix shell scripting proficiency.
- Experience working with relational databases (SQL).
- Minimum 7 years of experience in data warehousing and 4 years in Big Data (Cloudera).
- Experience working in distributed systems and performance optimization.
- Problem-solving and communication skills with a collaborative team approach.
- Bachelorโs degree in Computer Science or related field, or equivalent experience.
Preferred Qualifications
- Financial services industry experience.
- Previous production support experience.
- Familiarity with BofA technical systems and processes.
- Experience in designing and implementing analytical environments and business intelligence solutions.
- Familiarity with industry trends and relevant application technologies.