Staff Data Engineer- Data Lake

H1

Where
Hybrid in New York
Pay
$190K to $220K a year

Posted 5 months ago· Checked live at H1 1 hour ago

Stale: open 169 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what H1 asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on H1's own hiring page 1 hour ago.
What is the job?
At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems.
What does it pay?
$190K to $220K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems.

What you'll do at h1

As a Staff Data Engineer on the Data Lake team at H1, you will play a critical role in shaping the architecture, scalability, reliability, and long-term direction of our core data platform. This role is designed for a highly technical engineer who is excited to grow into an Engineering Manager track while remaining deeply hands-on technically.

The Data Lake is the foundation of H1’s platform, responsible for the validation, accuracy, standardization, and quality of the data powering every downstream product and team across the organization. You will help lead the evolution of this platform while supporting and mentoring a growing team of engineers.

About you

You are a highly technical data engineer who thrives in lean, high-ownership environments and enjoys solving complex distributed systems challenges. You are excited by the opportunity to influence technical direction, mentor engineers, and grow into broader engineering leadership responsibilities while remaining hands-on.

  • You have deep experience designing and scaling distributed data platforms and large-scale pipelines in cloud-native environments.
  • You excel at building reliable, observable, and maintainable data systems supporting critical business and analytics workloads.
  • You have strong expertise in distributed processing, performance optimization, and modern data architecture patterns.
  • You are comfortable leading technical initiatives and influencing architecture decisions across teams.
  • You communicate effectively with both technical and non-technical stakeholders.
  • You enjoy mentoring engineers and helping raise the engineering bar across teams.
  • You are energized by ownership, autonomy, and solving ambiguous technical challenges.

Requirements

  • 8+ years of experience in data engineering, software engineering, or related fields with significant experience building and scaling distributed data platforms.
  • Demonstrated technical leadership experience with interest in or experience mentoring and leading engineers.
  • Strong proficiency in Python (PySpark), Java, Scala, or similar programming languages.

Advanced SQL expertise, including performance tuning and optimization across large datasets.

  • Deep experience with Apache Spark and cloud-native big data platforms, preferably within AWS environments (EMR, Glue, S3, Athena, Redshift, or similar).
  • Experience designing and scaling modern cloud-native data lake architectures and large-scale ingestion frameworks.
  • Experience with orchestration and workflow management tools such as Argo, Airflow, or similar technologies.
  • Strong understanding of distributed storage systems, partitioning strategies, and file formats such as Parquet, Avro, and ORC.
  • Experience with Docker, Kubernetes, and modern containerization technologies.
  • Experience implementing monitoring, observability, and data quality frameworks within production environments.
  • Experience with large-scale data cleaning, parsing, normalization, and validation workflows preferred.
  • Experience working with healthcare, life sciences, publication, or large-scale entity-resolution datasets preferred.
  • Exposure to ML/AI-driven data enrichment, parsing, or validation workflows is a plus.
  • Experience using AI-assisted coding tools (e.g., GitHub Copilot, Claude Code) to accelerate development while maintaining quality is encouraged

Compensation

This role pays $190,000 to $220,000 per year, based on experience, in addition to stock options.

Anticipated role close date: 12/15/2026

Similar open jobs

Data engineer jobs in New York (109)Jobs in New York (19157)