Locations: Charlotte NC & New Jersey
Must Have Technical/Functional Skills
Primary Skill: Hadoop, Scala, Shell scripting
Secondary: Java, Spring Boot
Roles & Responsibilities
• Design, develop, and maintain large-scale Big Data solutions using Hadoop ecosystem technologies.
Develop data ingestion, transformation, and processing frameworks using Scala, Spark, and Hadoop.
• Create and maintain Shell scripts for automation, monitoring, deployment, and operational support.
• Build reusable and scalable backend services using Java and Spring Boot.
• Develop and optimize Spark applications for batch and real-time data processing.
• Design and implement RESTful APIs and microservices using Spring Boot.
• Work with HDFS, Hive, Sqoop, Kafka, Oozie, and other Hadoop ecosystem components.
• Perform performance tuning and optimization of Hadoop and Spark jobs.
• Troubleshoot production issues and provide L2/L3 support for critical applications.
• Collaborate with business analysts, architects, DevOps teams, and other stakeholders.
• Participate in code reviews, unit testing, CI/CD implementation, and release activities.
• Ensure compliance with enterprise security, governance, and data quality standards.