Senior Data Platform Engineer

Komodo Health

Where
San Francisco, CA
Pay
$196K to $230K a year

Posted 27 days ago· Checked live at Komodo Health 24 minutes ago

Stale: open 27 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Komodo Health asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Komodo Health's own hiring page 24 minutes ago.
What is the job?
We Breathe Life Into Data At Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data is essential to this mission. That’s why we built the Healthcare Map — the industry’s largest, most complete, precise view of the U.S. healthcare system — by combining de-identified, real-world patient data with innovative algorithms and decades of clinical experience.
What does it pay?
$196K to $230K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

We Breathe Life Into Data

At Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data is essential to this mission. That’s why we built the Healthcare Map — the industry’s largest, most complete, precise view of the U.S. healthcare system — by combining de-identified, real-world patient data with innovative algorithms and decades of clinical experience.

Key Responsibilities

  • Build, operate, and optimize large-scale batch pipelines using Python, SQL, Spark, and Airflow on AWS
  • Make storage and data layout decisions (table formats, partitioning, file sizing, compaction) that keep large datasets fast to query and cost-efficient
  • Ingest data from many external sources and keep pipelines correct through frequent schema changes
  • Transform healthcare claims, EHR, and reference data into trusted, serving-ready data products for customers and internal teams
  • Strengthen reliability through data quality checks, validation, lineage, observability, and alerting
  • Debug complex data, system, and performance issues across compute-heavy workflows
  • Contribute to system design, code quality, testing, documentation, CI/CD, and rotational production support

What you bring to Komodo Health

  • Strong hands-on experience building, owning, and debugging production data pipelines at multi-terabyte scale
  • Advanced Python, including performant, memory-efficient code for large-scale data processing, plus strong SQL
  • Deep production experience with Airflow, including operating and scaling it, not just writing DAGs
  • A solid understanding of how data is physically stored: columnar vs. row formats, and open table formats like Iceberg, Delta Lake, or Hudi (updates, compaction, small files, partitioning)
  • Experience with Spark or a comparable distributed processing framework
  • Proven experience designing and operating data systems in AWS
  • Strong instincts for data correctness, root-cause analysis, and production troubleshooting
  • The ability to communicate technical trade-offs clearly with engineering, product, and data partners
  • Comfort using AI-assisted engineering tools for coding, debugging, documentation, and technical exploration

Similar open jobs

Data engineer jobs in San Francisco (87)Jobs in San Francisco (11750)