Mechanize, Inc.

We build environments and evals for frontier coding agents. In these environments, models carry out software engineering work such as building a feature, deploying an application, or debugging an issue in an unfamiliar codebase. A grader scores the model’s performance, and these scores serve as signals during reinforcement learning and evaluations.

Careers

We’re hiring software engineers to design and build these environments. Apply here.

Learn how our interview process works, or read about what working here is like.

Our work

GBA Eval

GBA Eval is a benchmark that measures how well coding agents can write a Game Boy Advance emulator from scratch in 24 hours. You can view more here.

Essays

• How to fully automate software engineering
• The upcoming GPT-3 moment for RL
• Sweatshop data is over
• Medical AI isn’t the bottleneck to medical progress
• Cheap RL tasks will waste compute
• The future of AI is already written
• Life after work
• Unfalsifiable stories of doom

Podcast

• How bad data teaches models to write terrible code

---

Company announcements are on our press releases page.

Mechanize is backed by Nat Friedman and Daniel Gross, Patrick Collison, Adam D’Angelo, Marco Mascorro, Dwarkesh Patel, Sholto Douglas, Devendra Chaplot, Alex Atallah, and Marcus Abramovitch.

For inquiries, you can reach us at our contact page.