Research Engineer
Datalab
- Where
- New York Office
Posted 4 months ago· Checked live at Datalab 39 minutes ago
Stale: open 135 daysUp for more than two weeks. It may already be filled.
See how you score for this job
One sentence and your resume. We score it against what Datalab asks for, line by line.
See my score- Is this job still open?
- Yes. We checked it live on Datalab's own hiring page 39 minutes ago.
- What is the job?
- Datalab is an applied research lab in New York. We train our own models to turn documents into data you can verify: scans, dense tables, handwriting, the pages other tools quietly get wrong. Because we own the models, a customer's hard problem becomes a roadmap conversation, not a feature request. Our open-source work (Marker, Surya, Chandra) has more than 75,000 GitHub stars.
- What does it pay?
- The posting doesn't say.
- Our verdict
- Stale. Up for more than two weeks. It may already be filled.
What the job is
Datalab is an applied research lab in New York. We train our own models to turn documents into data you can verify: scans, dense tables, handwriting, the pages other tools quietly get wrong.
Because we own the models, a customer's hard problem becomes a roadmap conversation, not a feature request. Our open-source work (Marker, Surya, Chandra) has more than 75,000 GitHub stars.
Day to day
A typical project might look like: identify a gap in extraction quality on long documents, train and benchmark a new model, optimize it for inference, and work with the team to ship it to users. Concretely:
- Train and evaluate models: Train task-specific models (OCR, layout, text recognition, extraction). Explore architectures and training strategies to optimize task performance. This includes our open source models, like Marker, Surya, and Chandra.
- Optimize inference: Profile and accelerate model inference across different hardware setups (H100s, B200s, L40s, CPUs).
- Ship to product: Work with the team to integrate models into our API and product, helping define how new capabilities surface for end users. You will be involved from model training through integration, although your work will be weighted much more towards the model side than the product side.
- Create and maintain datasets: Source, design, and clean datasets for supervised and synthetic training; create reproducible pipelines for data versioning and evaluation.
- Experiment and benchmark: Run ablations, track metrics, and publish findings that inform model design and internal research direction.
- Engage with users and partners: Occasionally join calls or Slack threads to better understand customer needs and inform your work.
Ideal candidate
You've shipped models that made it into production. You understand how to balance exploration with delivery, and how to turn research insights into products people actually use.
- 3+ years experience training, fine-tuning, and evaluating deep learning models
- Trained at least one production-grade model or system used in real-world applications
- Deep expertise in PyTorch and Python, with strong fundamentals in deep learning (optimization, evaluation, architecture design)
- Comfortable with data engineering, benchmarking, and performance profiling across hardware setups
- Comfortable with an early stage startup - balance running ablations/benchmarks with shipping velocity
Bonus points if you
- Have experience with OCR, document AI, or structured extraction
- Have published work, whether that's a paper, a benchmark report, or a deep technical blog post
- Have been a major contributor to open-source projects, especially in ML, vision, or NLP
- Enjoy writing about your work and sharing learnings with the community
About datalab
Datalab is an applied research lab in New York. We train our own models to turn documents into data you can verify: scans, dense tables, handwriting, the pages other tools quietly get wrong.
Because we own the models, a customer's hard problem becomes a roadmap conversation, not a feature request. Our open-source work (Marker, Surya, Chandra) has more than 75,000 GitHub stars. Customers include Anthropic, ElevenLabs, Gamma, Reflection AI, and Legora, along with insurers, financial firms, and healthcare companies. We deploy anywhere from our API to fully air-gapped on-prem.
We're a small, founder-led team. You'll have real influence on how we sell and what we build.
Role overview
We're looking for a Research Engineer to own problems end to end across our models, inference service, and product. You won't just train a model and hand it off. You'll take it from training through benchmarking, into our inference stack, and work with the team to integrate it into our products.
We're a small team that has shipped the current state of the art OCR model, Chandra. Our models collectively have 70k+ Github stars. Our tools are used internally at frontier AI labs like Anthropic, and Fortune 500 enterprises like Siemens.
Our team focuses on training small, efficient models that outperform much larger LLMs on domain-specific tasks (like OCR, structured extraction, tables). We move fast, prioritize practical results, and build tools that are open, reproducible, and built to last. You'll test hypotheses quickly, iterate on results, and balance experimental rigor with shipping to customers.
Day to day
A typical project might look like: identify a gap in extraction quality on long documents, train and benchmark a new model, optimize it for inference, and work with the team to ship it to users. Concretely:
- Train and evaluate models: Train task-specific models (OCR, layout, text recognition, extraction). Explore architectures and training strategies to optimize task performance. This includes our open source models, like Marker, Surya, and Chandra.
- Optimize inference: Profile and accelerate model inference across different hardware setups (H100s, B200s, L40s, CPUs).
- Ship to product: Work with the team to integrate models into our API and product, helping define how new capabilities surface for end users. You will be involved from model training through integration, although your work will be weighted much more towards the model side than the product side.
- Create and maintain datasets: Source, design, and clean datasets for supervised and synthetic training; create reproducible pipelines for data versioning and evaluation.
- Experiment and benchmark: Run ablations, track metrics, and publish findings that inform model design and internal research direction.
- Engage with users and partners: Occasionally join calls or Slack threads to better understand customer needs and inform your work.
Ideal candidate
You've shipped models that made it into production. You understand how to balance exploration with delivery, and how to turn research insights into products people actually use.
- 3+ years experience training, fine-tuning, and evaluating deep learning models
- Trained at least one production-grade model or system used in real-world applications
- Deep expertise in PyTorch and Python, with strong fundamentals in deep learning (optimization, evaluation, architecture design)
- Comfortable with data engineering, benchmarking, and performance profiling across hardware setups
- Comfortable with an early stage startup - balance running ablations/benchmarks with shipping velocity
Bonus points if you
- Have experience with OCR, document AI, or structured extraction
- Have published work, whether that's a paper, a benchmark report, or a deep technical blog post
- Have been a major contributor to open-source projects, especially in ML, vision, or NLP
- Enjoy writing about your work and sharing learnings with the community
Interview process
- A 30-minute video call to evaluate fit
- 90-minute live architecture discussion
- Culture fit interview/team meeting
At this stage of the company, every interview is somewhat custom, so these phases may be rearranged slightly.
Equal opportunity
Datalab is an equal opportunity employer. We do not discriminate on the basis of any characteristic protected by federal, state, or local law.
If you need an accommodation to participate in our hiring process, or if you believe you have experienced discrimination or harassment at any point in it, contact operations@datalab.to.
Similar open jobs
- Applied AI EngineerCAIS · New York, New York · $190K to $235K a year
- AI Advisory Director, Data and AI Engineering SolutionsAECOM · Hybrid, New York, NY, United States
- Sr AI Software EngineerThe Trade Desk · Bellevue · $125K to $229K a year
- Sr AI Enablement EngineerThe Trade Desk · Bellevue · $125K to $229K a year
- Machine Learning Infrastructure Engineer, TechnologyPoint72 · New York, NY · $180K to $300K a year
- Applied AI Architect, Beneficial Deployments (Non-Profits)Anthropic · San Francisco, CA | New York City, NY · $240K to $315K a year
Machine learning engineer jobs in New York (479)Jobs in New York (19157)