Principal Staff Software Engineer - Data Lake Infrastructure

LinkedIn

Where
Hybrid in Mountain View, CA, United States
Pay
$231K to $378K a year

Posted 24 days ago· Checked live at LinkedIn 2 hours ago

Stale: open 24 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what LinkedIn asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on LinkedIn's own hiring page 2 hours ago.
What is the job?
Job Description This role will be based in Mountain View or Bellevue.
What does it pay?
$231K to $378K a year, as the posting states.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Job Description

This role will be based in Mountain View or Bellevue.

At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, and the evolving needs of our business. The work location of this role is hybrid, meaning it will be performed both from home and from a LinkedIn office on select days, as determined by the business needs of the team.

Core Responsibilities

  • Own the technical roadmap and architecture for OpenHouse and core data lake services (catalog, table format, compaction, retention, replication, governance).
  • Lead design and implementation of large-scale, highly available distributed systems handling petabyte-scale Iceberg tables.
  • Drive open-source contributions and engagement with Apache Iceberg and related ecosystem projects.
  • Partner with Analytics, AI Platform, and Data Infra teams to align on requirements, integration points, and long-term platform strategy.
  • Provide technical mentorship and code/design review leadership across the team; raise the engineering bar.
  • Evaluate and adopt emerging lakehouse technologies, driving build-vs-adopt decisions.
  • Ensure system reliability, performance, and cost efficiency through sound SLOs, monitoring, and capacity planning.
  • Lead technical design reviews, write RFCs/design docs, and drive consensus across stakeholders.
  • Guide incident response and root-cause analysis for critical data lake infrastructure issues.
  • Guide incident response and root-cause analysis for critical data lake infrastructure issues.

Basic Qualifications

  • BS in Computer Science or equivalent.
  • 10+ years of industry experience in software design, development, and algorithm related solutions.
  • 10+ years of experience in technical leadership: architecture ownership, mentoring, cross-team influence.
  • 8+ years of experience in table formats (Iceberg/Delta/Hudi), data lake/lakehouse architectures, and query engines (Spark, Trino, Presto).
  • 8+ years building large-scale distributed data systems (storage, databases, data lakes, or data infrastructure)
  • 10+ years of experience in systems programming (Java/Scala/Go) and understanding of distributed systems fundamentals (consistency, replication, metadata management.
  • 8+ years of experience with Open-source contribution experience preferred, especially in Apache Iceberg or similar projects.

Preferred Qualifications

  • MS/PhD in Computer Science or related field.
  • Experience in architecting, building, and running large-scale distributed systems.
  • Experience with communication and ability to influence cross-functional teams.
  • Background in industry thought leadership.
  • Demonstrated ability to align technical decisions with business outcomes and drive customer-centric innovation.
  • Production experience operating Iceberg (or similar table format) infrastructure at multi-petabyte, multi-tenant scale.
  • Open-source contribution experience strongly preferred, especially in Apache Iceberg, Trino, Spark, or related lakehouse/OSS projects, or similar projects.
  • Experience with catalog/metadata services, compaction, retention, and data governance.
  • Background in storage cost optimization (tiering, compaction, format evolution).
  • Track record leading cross-org technical initiatives as a technical lead or architect.

Suggested Skills

  • Distributed Systems
  • Data Infrastructure
  • Data Lake, Apache Iceberg, Trino, Spark
  • Deep understanding of concurrency, distributed algorithms, and data structures.
  • Large scale technical leadership

You will Benefit from our Culture

We strongly believe in the well-being of our employees and their families. That is why we offer generous health and wellness programs and time away for employees of all levels.

LinkedIn is committed to fair and equitable compensation practices.

The pay range for this role is $231,000 to $378,000. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location. This may be different in other locations due to differences in the cost of labor.

The total compensation package for this position may also include annual performance bonus, stock, benefits and/or other applicable incentive compensation plans. For more information, visit https://careers.linkedin.com/benefits.

Additional Information

Pay Transparency Policy Statement ​

As a federal contractor, LinkedIn follows the Pay Transparency and non-discrimination provisions described at this link: https://lnkd.in/paytransparency.

Global Data Privacy Notice and Compliance Posters for Job Candidates

Please use this link to access documents that provide information about how LinkedIn handles the personal data of employees and job applicants, as well as the E-Verify Participation Notice and the Department of Justice Immigrant and Employee Rights Section Right to Work posters: https://www.linkedin.com/legal/candidate-portal.

Company Description

LinkedIn is the world's largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We're also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture that's built on trust, care, inclusion, and fun – where everyone can succeed.

Join us to transform the way the world works.

Similar open jobs

Software engineer jobs in San Jose (1462)Jobs in San Jose (7796)