About the Company

A leading technology consulting firm known for delivering high-quality, innovative solutions. The company works with clients to implement cutting-edge technology and provide expertise in areas like Big Data, Cloud services, and Digital Transformation.

About the Role

The Hadoop Developer will be responsible for designing and implementing scalable, efficient, and reliable Big Data solutions. This role requires expertise in handling distributed systems, with a focus on Hadoop, Hive, Spark, and related technologies. The developer will also be tasked with optimizing system performance and collaborating with cross-functional teams.

Responsibilities

Develop and maintain Python-based processing pipelines using Spark.
Use Pandas for data profiling and analysis to optimize performance.
Design and implement Big Data solutions using Hadoop, Hive, Spark, HBase, Impala, Pig, and Kafka.
Build and deploy solutions in distributed systems using Cloudera or Hortonworks technologies.
Conduct performance profiling and apply memory optimization strategies.
Collaborate with teams to deliver high-quality solutions while identifying performance improvements.
Automate processes using CI/CD tools like Jenkins and Ansible.
Communicate effectively in a collaborative, agile environment, handling complex problems and sharing solutions.

Required Skills

Experience: 6-8 years working with Big Data technologies like Hadoop, Spark, Hive, HBase, Kafka.
Programming: Strong proficiency in Python and familiarity with functional programming (Python, Scala).
Tools: Hands-on experience with Pandas, Jupyter, and SQL for data profiling.
Distributed Systems: Extensive experience in designing and implementing solutions for distributed systems.
Performance Optimization: Expertise in performance profiling and memory optimization.
CI/CD: Experience with Jenkins and Ansible for automation.
Business Knowledge: Familiarity with Capital Markets and Regulatory Reporting.
Communication & Problem-Solving: Strong analytical, coding, debugging, and communication skills.

Preferred Qualifications

Familiarity with Cloudera or Hortonworks technology stacks.
Experience in Data Science, Digital Transformation, and Business Intelligence.
Background in App Development and Cloud services.
Knowledge in IT Application support and management.

Visit the official website below to access the full details of this vacancy:

Apply Now