Building tomorrow's world today
About the Company
ALTEN Polska is part of the ALTEN Group, a leading European provider of engineering and technology consulting services. The company focuses on delivering innovative IT solutions to meet the needs of clients across various industries. With a commitment to growth and development, ALTEN Polska offers career opportunities for professionals in the tech and engineering fields, providing an inclusive and dynamic environment where talents thrive.
About the Role
The Hadoop Administrator will play a crucial role in designing and building system capabilities for an on-premise Hadoop big data platform. This individual will contribute to the development of solutions focusing on resiliency, automation, and product requirements. The role requires collaboration with engineers, data scientists, and users to create scalable systems, improve platform availability, and ensure seamless integration and automation of data processing clusters.
Responsibilities
- Develop and design solutions for Hadoop big data platforms, focusing on resiliency and automation.
- Collaborate with data delivery teams to set up new Hadoop users, including configuring Linux users and Kerberos principals.
- Monitor Hadoop platform performance, ensuring 24/7 availability and troubleshooting system issues.
- Set up and configure Cloudera cluster components, including Hive, Spark, HDFS, Kafka, Yarn, and Zookeeper.
- Handle Hadoop security tasks using Apache Ranger, Knox, Kerberos, and encryption zone management.
- Implement centralized S3 data storage across the platform processing stack for enhanced data management.
- Contribute to the Agile development process and collaborate with cross-functional teams to improve platform performance.
- Execute troubleshooting and incident management to address system failures and vulnerabilities.
Required Skills
- 5+ years of experience in Big Data engineering, particularly with on-prem or cloud Hadoop environments.
- Strong problem-solving skills and the ability to work in a complex environment.
- Expertise in Hadoop ecosystem tools (Cloudera distribution, Hive, Spark, Kafka, HDFS, Yarn, Zookeeper, etc.).
- Hands-on experience with Cloudera cluster installation, capacity planning, performance tuning, and monitoring.
- Experience with Hadoop security protocols (Apache Ranger, Kerberos, TLS, Knox).
- Proficiency in orchestration and automation tools like Jenkins, Ansible.
- Linux system administration experience.
- Strong scripting skills in Python or Bash.
- Knowledge of data integration and automation processes in Big Data environments.
Preferred Qualifications
- Familiarity with cloud platforms (AWS, Azure, etc.).
- Experience with DevOps practices and tools.
- Previous work with S3 data storage systems.
- Understanding of CI/CD pipeline management for Big Data applications.
- Knowledge of Agile development methodologies.
What the Company Offers
- Full-time contract (B2B also possible).
- Well-defined career development path.
- Opportunities for participation in conferences, workshops, and trainings.
- Certification and training opportunities.
- Flexible relocation opportunities within ALTEN Polska branches.
- Benefits including Medicover medical and dental care, group life insurance, pension scheme, and employee referral programs.