Senior Hardware Diagnostics Engineer - Infrastructure

Tensorwave

Where
Las Vegas, Nevada

Posted 26 days ago· Checked live at Tensorwave 2 hours ago

Stale: open 26 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Tensorwave asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Tensorwave's own hiring page 2 hours ago.
What is the job?
Our mission is simple: deliver seamless, secure, reliable, and resilient AI compute at scale. We've built a versatile cloud platform that eliminates infrastructure barriers, empowering builders to focus on innovation instead of fighting their stack. Because breakthrough AI should move at the speed of ideas, not infrastructure.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Our mission is simple: deliver seamless, secure, reliable, and resilient AI compute at scale. We've built a versatile cloud platform that eliminates infrastructure barriers, empowering builders to focus on innovation instead of fighting their stack. Because breakthrough AI should move at the speed of ideas, not infrastructure.

What You’ll Do

  • Own the firmware lifecycle across BIOS, BMC, NIC, GPU, and storage controllers: version qualification, approved baselines, staged rollout, and rollback
  • Design and build the validation harness that qualifies a firmware release before it reaches production, including regression and performance comparison between versions
  • Build automation against Redfish, IPMI, and vendor management APIs so firmware and validation work runs at fleet scale rather than node by node
  • Define what passing burn-in means: the test matrix, the thresholds, and the evidence we keep
  • Make fleet-wide changes safe and predictable through pre-flight validation, blast radius control, staged waves, and a rollback path that has actually been tested
  • Lead root cause analysis on hardware and firmware failures nobody else can reproduce, including PCIe error analysis, sensor and event log forensics, and thermal and power telemetry
  • Own technical escalation with OEM, ODM, and silicon vendors on firmware defects, and track fixes to closure
  • Prepare validation and bring-up capability for next-generation AMD platforms before the hardware lands
  • Mentor the diagnostics engineer on the team, and turn recurring findings into runbooks and tooling
  • Participate in incident response and root cause analysis
  • Contribute to runbooks, documentation, and operational best practices

Required Qualifications

  • 6+ years in infrastructure engineering, hardware validation, systems engineering, or a closely related field
  • Deep hands-on experience with BMCs and out-of-band management — Redfish, IPMI, iDRAC, iLO, or equivalent — including scripted interaction, not clicking through a web UI
  • Direct firmware experience flashing, qualifying, and troubleshooting BIOS, BMC, and device firmware on enterprise servers, and a clear sense of how badly this can go wrong at scale
  • Strong Linux systems skills: boot process, kernel and driver behavior, and hardware diagnostics such as {{dmesg}}, {{lspci}}, {{ipmitool}}, SMART, and vendor CLIs
  • Ability to read low-level hardware signals: PCIe topology and error output, SEL and sensor data, thermal and power telemetry
  • Python for automation against REST APIs — Redfish, vendor tooling, and internal systems
  • A rigorous diagnostic method: you form a hypothesis, design a test that can disprove it, isolate one variable at a time, and document the evidence behind your conclusion
  • Experience driving hardware issues with vendors through to resolution
  • Clear technical writing for runbooks, RCAs, and vendor escalations

Preferred Qualifications

  • AMD GPU and ROCm experience: {{amd-smi}}, {{rocm-smi}}, ROCm Validation Suite
  • GPU and HPC validation at scale: stress testing, collective communication testing with RCCL or NCCL, node health frameworks
  • Low-level bus and firmware work: I2C, SMBus, BMC firmware behavior, Redfish schema extensions
  • Kernel-level debugging, including crash dump analysis
  • Ansible for fleet operations, and Git-based workflows with CI/CD
  • NetBox or other DCIM and IPAM tooling as a source of truth
  • Prior work at an OEM, ODM, or hyperscaler on hardware bring-up or validation

What We Offer

  • Stock Options
  • 100% paid Medical, Dental, and Vision insurance for Employees
  • Company Health Savings Account Contributions
  • 100% paid Short Term and Long Term Disability Insurance for Employees
  • Life and Voluntary Supplemental Insurance Options
  • Other Insurance Options, such as Pet & Legal Insurance
  • Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support
  • Flexible Spending Account
  • 401(k)
  • Employee Assistance Program
  • Flexible PTO
  • Paid Holidays
  • Parental Leave
  • Other In-Office Perks