Job Description:
Position: Big Data Engineer – Python/Scala, Spark, Hadoop
Location: Arlington, VA (3 Days onsite/week)
Hire Type: Full Time
Experience: 10+ Years
Job Summary:
Ability to easily move between business, data management, and technical teams;
ability to quickly intuit the business use case and identify technical solutions to enable it
Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required