Research Scientist: Hierarchical RL Agents

Astera

Where
Hybrid in Emeryville HQ

Posted 8 months ago· Checked live at Astera 2 hours ago

Stale: open 267 daysUp for more than two weeks. It may already be filled.

See how you score for this job

One sentence and your resume. We score it against what Astera asks for, line by line.

See my score
Is this job still open?
Yes. We checked it live on Astera's own hiring page 2 hours ago.
What is the job?
Astera is a private foundation on a mission to steer science and technology toward a better future. We believe the coming years will bring an era of unprecedented scientific and technological advancement as exponential progress in AI converges with central advances in other fields to accelerate innovation.
What does it pay?
The posting doesn't say.
Our verdict
Stale. Up for more than two weeks. It may already be filled.

What the job is

Astera is a private foundation on a mission to steer science and technology toward a better future. We believe the coming years will bring an era of unprecedented scientific and technological advancement as exponential progress in AI converges with central advances in other fields to accelerate innovation.

Core responsibilities

  • Fundamental Research on Hierarchical World Model Learning from Experience: Develop and implement new architectures and learning/inference algorithms for hierarchical RL that supports hierarchical world modeling and hierarchical planning.
  • Ethologically constrained learning: Design tasks to evaluate the agent in ethologically constrained environments, and benchmark different agent designs. Design experiments to test hypotheses regarding high-level cognition, causal representations, sensory-motor integration, active inference, and unsupervised learning.
  • Cross-Disciplinary Collaboration: Work alongside neuroscientists and software engineers to translate abstract mathematical frameworks into scalable systems.
  • Contribute to Open Science: Help innovate new publication models that incentivize speedy dissemination, open source code releases, free open access, and impact measurements based on uptake.

Desired qualifications

  • Technical Depth: Preferred: PhD in Computer Science, Electrical Engineering, Neuroscience, Physics, or a related quantitative field. We are always open to considering exceptional candidates, even those with non-traditional educational histories.
  • Theoretical Rigor: Strong foundations in deep learning, graphical models, and information theory.
  • Coding Proficiency: Expert-level skills in deep learning frameworks (PyTorch/JAX), with a focus on clean, reproducible research code.
  • AGI Mindset: A demonstrated interest in the "big questions" of AI—robustness, generalization, and common-sense reasoning.
  • Curious About the Brain: A genuine passion for exploring the computational and architectural principles of the mammalian brain.
  • Startup DNA: Ability to thrive in a lean, fast-paced environment where you have high autonomy and a direct influence on research direction.

Why join us?

  • We recognize the need for fundamental research: No pressure to align research with quarterly revenue goals, market competition, or product roadmaps. We can focus on solving the core problems and achieving breakthroughs that enable the next generation of AGI technology.
  • Mission-First: Your work contributes directly to the global pool of knowledge and the safe development of AGI.
  • Collaborative culture: We work in teams, organized around challenge problems and attack paths, without big-company inertia or politics.

Compensation

The posted salary range is based on location in the Bay Area. The successful candidate will receive a competitive compensation package, commensurate with their experience and location.

  • Benefits summary https://www.notion.so/Astera-Benefits-Summary-Residents-and-Temporary-Staff-30caa1d01f248091ab8be9eaed84f998