Senior Database Engineer(Hadoop)

CatchProbe

Gain full visibility into threats and attack surfaces. Leverage AI for strategic decisions and proactive defense

About the Company

CatchProbe is the creator of IntelligencySuite (IDA Mountain), the worldโ€™s first AI-driven, SaaS-based centralized intelligence platform. Trusted by organizations across multiple industries, CatchProbe delivers actionable intelligence through advanced modules covering web intelligence, OSINT, deception systems, threat intelligence, and digital crime analytics. Its AI-powered engines transform intelligence from open sources, private feeds, and internal datasets into predictive insights that empower organizations to detect, prevent, and respond to threats proactively.

About the Role

CatchProbe is seeking a Senior Database Administrator with strong expertise in MongoDB, ElasticSearch, Hadoop, and NoSQL technologies. This remote role (San Francisco, CA region) focuses on administration, optimization, and scaling of large database clusters, while also supporting data lake initiatives and contributing to secure, high-performance infrastructure. The position requires strong hands-on technical ability combined with proactive problem-solving and collaboration across application and engineering teams.

Responsibilities

  • Administer, maintain, and optimize MongoDB, Elastic, and Hadoop clusters.
  • Lead installations, upgrades, capacity planning, and performance analysis.
  • Configure and maintain sharded clusters, backups, and disaster recovery.
  • Support application teams with database performance assessments and bottleneck resolution.
  • Implement security standards including SCRAM-SHA1, X509, LDAP, TLS/SSL.
  • Automate deployments, upgrades, reporting, and monitoring tasks.
  • Manage containerized MongoDB environments with Docker.
  • Deploy and manage Hadoop clusters, nodes, and associated services (Zookeeper, HBase, SOLR).
  • Troubleshoot system-wide issues and provide L3 support for data lake platforms.
  • Contribute to scalable solutions with APIs, automation scripts, and CI/CD workflows.

Required Skills

  • 5+ years of experience installing, scaling, and supporting NoSQL databases (MongoDB, ElasticSearch, Hadoop).
  • Strong knowledge of MongoDB administration and native tools (mongodump, mongoexport, mongostat, etc.).
  • Hands-on experience with AWS, Azure, GCP, or similar public cloud platforms.
  • Proficiency in automation using Ansible, Python, Terraform, and Shell scripting.
  • Expertise in database performance tuning, query optimization, and storage management.
  • Solid understanding of relational and non-relational database concepts.
  • Strong communication, collaboration, and problem-solving skills.

Preferred Qualifications

  • Experience with additional database technologies (Postgres, MySQL, Kafka, Kinesis).
  • Knowledge of Hadoop ecosystem services and advanced data lake management.
  • Background in software development (Java, Go, Node.js, HTML, CSS).
  • Familiarity with AI/ML workflows and data-driven automation.
  • Contributions to infrastructure automation projects or open-source initiatives.

Head to the official website below for the full vacancy description and requirements:

Copyright © 2025 hadoop-jobs. All Rights Reserved.