Rack-Scale AI Hardware Architect

Mythic Ai Com

Where
Hybrid in Austin, TX

Posted 57 days ago· Checked live at Mythic Ai Com 3 hours ago

Stale: open 57 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Mythic Ai Com asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Mythic Ai Com's own hiring page 3 hours ago.
What is the job?
Mythic builds AI compute platforms around large numbers of small, energy-efficient accelerators rather than a handful of very large ones. Serving frontier-scale models on that kind of architecture pushes the hardest engineering problems out of the die and into the rack: how many thousands of devices are packaged, connected, powered, and cooled in a very small volume.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Mythic builds AI compute platforms around large numbers of small, energy-efficient accelerators rather than a handful of very large ones. Serving frontier-scale models on that kind of architecture pushes the hardest engineering problems out of the die and into the rack: how many thousands of devices are packaged, connected, powered, and cooled in a very small volume.

What You’ll Own

  • Rack-level reference architecture — board, chassis, backplane, rack topology, mechanical envelope, physical constraints, and serviceability — from pathfinding through a working reference implementation.
  • Scale-up and scale-out interconnect: PCIe hierarchy and switching, high-speed Ethernet and SerDes, die-to-die and board-level links, copper versus optical at each tier, retimers, connectors and cable plant, topology, oversubscription, and the bandwidth and latency budget for each hop.
  • Thermal architecture for high-density racks: direct-to-chip and cold-plate cooling versus immersion, CDUs and manifolds, flow and pressure budgets, component thermal limits, and the rack-to-facility interface.
  • Power delivery architecture, including rack distribution and busbar design, high-voltage DC and 48V-class conversion and efficiency, transient behavior across very large device counts, redundancy, telemetry, and RAS.
  • Joint modeling with the software team of the full LLM solution — partitioning strategy, inter-layer traffic, collectives — translated into fabric, memory, and topology requirements and backed by quantitative rack- and cluster-level models of performance, power, thermal, and cost.

What We’re Looking For

  • Minimum Bachelor’s degree in Electrical Engineering, Mechanical Engineering, Computer Engineering, or a related field, with relevant experience in server, datacenter, HPC, or AI system design.
  • Demonstrated architecture and design ownership of dense, rack-based server systems taken to production, including authoring the specifications ODM and OEM partners build against.
  • Expert command of state-of-the-art copper and optical interconnect: PCIe, high-speed Ethernet and SerDes, DAC and twinax, backplane and cabled channels, AOCs, and pluggable or co-packaged optics, with the signal-integrity judgment to know where each approach stops working.
  • Expert command of removing heat from racks, cooling architecture, cold plates, manifolds, CDUs, flow and thermal budgeting, and the facility-side interface.
  • Ability to reason across interconnect, power, thermal, mechanical, and software boundaries rather than within one, including working directly with software on model partitioning, with a track record of modeling and trade studies driving architectural decisions.

Preferred Qualifications

  • Master’s degree or PhD in Electrical Engineering, Mechanical Engineering, Computer Engineering, or a related field.
  • Hyperscale or OCP experience, including ORv3 and contributions to relevant standards bodies.
  • Experience with systems built from many small accelerators, dataflow, or wafer-scale architectures rather than only GPU-tray designs.
  • Experience with LLM training or inference at scale and how parallelism strategies stress a fabric, plus familiarity with chiplets, die-to-die interfaces, and advanced packaging.
  • Experience carrying a reference design through ODM or CM partners into production and into customer datacenters, including EMC, structural, and shock and vibration qualification.

Similar open jobs

Jobs in Austin (4551)Jobs in San Jose (7796)