Hadoop Developer
Scottsdale AZ – Day1 Onsite
Contract
Note: This role focuses strictly on the core Apache Big Data ecosystem running on bare metal. Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.
Core Responsibilities
• Develop and optimize robust data pipelines using native HDFS, MapReduce, and YARN.
• Write high-performance distributed processing jobs using Apache Spark (Core/SQL) and Hive.
• Manage cluster resource allocation, troubleshoot bottlenecks, and tune query performance at the core infrastructure level.
•Hands-on experience with build tools like Maven and/or Gradle.
•Strong understanding of distributed systems and big data architecture.
•Experience with streaming frameworks such as Spark Streaming and Kafka Streams.
Required Skills & Qualifications
• Proven experience as a dedicated Big Data / Hadoop Developer.
• Mastery of the core Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, Oozie).
• Strong proficiency in Apache Spark using Java, Scala, or Python.
• Deep understanding of distributed storage, cluster performance tuning, and Linux environments.
• Note: Cloud-native engineers (AWS EMR/Glue, Azure Synapse/ADF) will not be considered for this specific on-premise role.