ProgrammableMarketing/nitrode.com (opens in a new tab)
PDF

Views

  • Plan
  • Roadmap
  • Research

On this page

  • The brief
  • Start here
  • Idea portfolio
  • Effort vs impact
  • This week · 7
  • This quarter · 12
  • Big bets · 3
  • Wildcards · 2
Generated Nov 10, 2026 1 view
  1. Programmable
  2. Playbooks
  3. Nitrode
Nitrode logo

growth playbook · Nov 10, 2026

nitrode.com (opens in a new tab)

Nitrode growth playbook

Diagnosis

Nitrode is a team of eight, backed by Y Combinator (W25), that turned its 2025 AI game engine into a research-led data and evaluation business. GameEngineBench is its calling card: 110 UE5 C++ tasks, a July 2026 arXiv paper and a headline result that even the best configuration solves only 55.5%.

But the path from that research to a sales conversation is broken in places. The paper sends readers to a GitHub repository that returns 404. The site has no code link, the leaderboard rows can't be read in the page text, and none of the six pages has a sample, a price, a process or a customer.

Fix the benchmark's public home first, then make the leaderboard and its failure analysis a steady source of lab and studio conversations. Productize the enterprise offer as a fixed-scope pilot, and grow the expert network that every product depends on. The four open roles (evals, post-training, a game developer and a full-stack engineer) are the people who will run most of this.

Growth Score

6/10

Biggest Opportunity

Make GameEngineBench the public reference for AI in Unreal-scale game development. A working repo, a readable live leaderboard and regular failure analysis can turn every new model release into a reason for labs and studios to contact Nitrode.

Biggest Risk

A small team is selling to a few large labs against well-funded generalist data vendors (Mercor, Surge AI, Turing). If the benchmark can't be reproduced and the product pages show no proof, buyers may treat Nitrode as one more contractor network rather than the game-development specialist.

01

Start here

The three moves to make first. Each one is written up in full below.

  1. 1

    Make the GameEngineBench code link in the paper work, and give the benchmark a public home on nitrode.com

    Decide today whether the cited repo should hold the full scripts or a pointer to unrealbench, and make that URL load.

    High impact First result in 2 weeks
  2. 2

    Put the GameEngineBench leaderboard rows in the page text, so search engines and AI assistants can quote them

    Move the leaderboard data out of the client-side component into server-rendered HTML.

    High impact First result in 1 month
  3. 3

    Add a "join the expert network" path to nitrode.com and the contact form

    Add "Contribute as an expert" to the Interest dropdown today.

    High impact First result in 2 weeks

02

Your idea portfolio

24 ideas, grouped by when to run them. Open any idea for how to run it: the steps, who to approach, copy you can use, and how to measure it.

  • 8 ideas are marked Unexpected: plays you are unlikely to have tried.

Every idea placed by the effort it takes against the impact it could have. Quick wins sit top left; select a number to open that idea. The filters below narrow the list by status, timing, category and what Programmable can build.

Effort vs impactEach number is an idea. Select one to open it.
Impact →
Quick wins · 3Big bets · 8Fill-ins · 9Reconsider · 4
Effort →

Showing 24 of 24 ideas

This week 7

Quick wins with a clear first action.

  • 01

    The GameEngineBench paper tells readers that "the current repository already contains the key scripts required to reproduce benchmark runs" and points to github.com/Nitrode-Research/GameEngineBench. That address returns 404. Nitrode's GitHub organization shows only one public repository, "unrealbench" (14 Unreal tasks, 1 star), which doesn't mention the paper or nitrode.com. The research page itself links only to arXiv, with no code, download or submission route. Nitrode's YC launch promised to open-source a suite of benchmarks. The researchers and lab engineers most likely to become buyers are the people who click that link, and right now they hit a dead end.

    High impactLow effort First result in 2 weeks Member of Technical Staff

    First action

    Decide today whether the cited repo should hold the full scripts or a pointer to unrealbench, and make that URL load.

    How to measure it

    Benchmark-sourced lab and studio conversations

    Now
    –
    Target
    10 qualified conversations
    By
    90 days

    Steps

    1. 1

      Fix the cited URL

      Publish at github.com/Nitrode-Research/GameEngineBench, or create that repo with a README that points to the public release.

      Member of Technical Staff, Evals 1 day

    2. 2

      Write the README

      What the benchmark measures, the public and held-out task split, hardware and Epic access needs, a quick start, the license and a citation.

      Member of Technical Staff, Evals 2 days

    3. 3

      Link both ways

      Repo to /research and the paper; /research to the repo with a "Run GameEngineBench" block.

      Full-Stack Engineer 1 day

    4. 4

      Update arXiv

      Post a new version with the working code link.

      CTO 1 week

    5. 5

      Add a scoring route

      A "Get your model scored" link to the contact form, pre-set to Research / GameEngineBench.

      Full-Stack Engineer 2 hours

    6. 6

      Announce

      One post on X and LinkedIn with the repo, the 31 unsolved tasks and how to try them.

      CEO 1 day

    7. 7

      Track

      Repo traffic, clones, stars and tagged leads each week.

      COO weekly

    First result
    2 weeks
    Cost
    Staff time only
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Create the cited repo with a README pointing to unrealbench and the paper today, then count visits in two weeks.

    Why it works

    Publish the reproduction scripts at the exact URL the paper cites, or, if unrealbench is the public release, rename it or put a README at the cited address that points to it. Add a "Run GameEngineBench" block to /research: repo link, what is public (tasks, starter projects, verifiers) and what stays held out, hardware needs, a BibTeX citation and a "get your model scored" link to the contact form. Update the arXiv listing with a new version that carries the working link, and link the repo README back to nitrode.com/research and the paper. Then track repo traffic, clones and contact-form leads tagged "Research / GameEngineBench" each week.

    Benchmarks spread through people running them. A working repo turns each paper reader into a possible user, citer or contributor, and those users are the evals and post-training teams at labs who buy datasets and RL environments. It also keeps the open-source promise, which builds trust with researchers.

    Ready to use

    ChecklistBenchmark public-home checklist

    [ ] github.com/Nitrode-Research/GameEngineBench loads
    [ ] README: what it measures, public vs held-out split, hardware, Epic access, quick start
    [ ] License and NOTICE
    [ ] BibTeX citation
    [ ] Repo links to nitrode.com/research and arXiv
    [ ] /research links to the repo
    [ ] "Get your model scored" link to /contact
    [ ] arXiv version with the working link
    [ ] Weekly repo and lead tracking

    Risks and how to handle them

    • Releasing all tasks lets models train on the test set

      Publish scripts and a public split, and keep a held-out split for official scores, as unrealbench already does with solutions.

    • Engine licensing limits what can be shared

      Keep the NOTICE file and require users to bring their own Epic-linked access, as unrealbench does.

    Evidence

    • Research paperGameEngineBench paper (arXiv, submitted July 3, 2026, revised July 15, 2026; eight authors): tasks from "nine open-source Unreal projects" such as ActionRoguelike, GASShooter and Bomber; Appendix D points readers to github.com/Nitrode-Research/GameEngineBench and says "The current repository already contains the key scripts required to reproduce benchmark runs." It also compares cost and speed across configurations.Source
    • GitHubgithub.com/Nitrode-Research/GameEngineBench returns 404 (checked twice on November 9, 2026). The organization's only public repository is "unrealbench": 14 Unreal Engine coding tasks for agents on Harbor, Apache-2.0, with instructions, starter projects and verifiers public; 1 star, 0 forks, and no link to nitrode.com or the paper.Source
    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
  • 02

    The research page has a Leaderboard section, but its rows don't appear in the page text. Only the 55.5% top score and "under 30%" for everyone else can be read. People increasingly ask search engines and AI assistants how a given model does on game-engine code. Those tools can only quote what is in the HTML. The site is already fast (real visitors pass Core Web Vitals), so readability, not speed, is the gap.

    High impactLow effort First result in 1 month Full Stack Engineer

    First action

    Move the leaderboard data out of the client-side component into server-rendered HTML.

    How to measure it

    Organic and referral visits to /research

    Now
    –
    Target
    3x
    By
    90 days

    Steps

    1. 1

      Render as HTML

      Server-render the table with all 12 configurations.

      Full-Stack Engineer 1 day

    2. 2

      Add columns

      Effort, pass@1, compile rate, cost per task, date scored.

      Member of Technical Staff, Evals 1 day

    3. 3

      Add markup

      Dataset schema, title and meta description.

      Full-Stack Engineer 2 hours

    4. 4

      Row anchors

      A shareable link per configuration.

      Full-Stack Engineer 2 hours

    5. 5

      Submit

      Search Console and the sitemap, with a fresh lastmod.

      Full-Stack Engineer 1 hour

    6. 6

      Check answers

      Ask AI assistants about game-engine coding results each month and note whether they cite Nitrode.

      COO monthly

    First result
    1 month
    Cost
    $0
    Owner
    Full Stack Engineer

    Smallest test

    Add the table as static HTML today and check that it shows up in a text-only fetch.

    Why it works

    Render the leaderboard as a plain HTML table: configuration, effort setting, pass@1, compile rate, cost per task and the date scored. Add Dataset structured data, a page title and a meta description that name GameEngineBench and UE5 C++. Add a "last updated" date and an anchor link for each row so people can share a single result.

    A leaderboard that can be quoted gets cited in model comparisons, newsletters and AI answers. Each citation sends researchers and lab engineers to the page.

    Risks and how to handle them

    • Others copy the table without credit

      Add a citation line and the paper link under the table.

    Evidence

    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • PageSpeedGoogle PageSpeed (November 9, 2026): mobile 96, desktop 100; accessibility, best practices and SEO 100. Real visitors pass Core Web Vitals (75th percentile LCP 0.64s, INP 44ms, CLS 0); the largest lab saving is the hero background image (about 317 KB).Source
  • 03

    Every product Nitrode sells (coding datasets, developer traces, RL environments, computer-use trajectories) depends on its network of "hundreds of game developers and creative software specialists". Yet nitrode.com has no page for experts. The contact form's Interest options cover research, labs, enterprise and careers, but not contributing, and the six-URL sitemap has nothing for the supply side.

    High impactLow effort First result in 2 weeks COO

    First action

    Add "Contribute as an expert" to the Interest dropdown today.

    How to measure it

    Qualified expert applications

    Now
    –
    Target
    +50%
    By
    60 days

    Steps

    1. 1

      Dropdown option

      Add "Contribute as an expert" to the contact form.

      Full-Stack Engineer 1 hour

    2. 2

      Write the page

      Disciplines needed, sample tasks, pay model, time commitment.

      COO 2 days

    3. 3

      Build it

      /experts with nav and footer links.

      Full-Stack Engineer 1 day

    4. 4

      Connect

      Apply button to the contributor platform with source tracking.

      Full-Stack Engineer 2 hours

    5. 5

      Cross-link

      From the careers page and the Game Developer post.

      COO 1 hour

    6. 6

      Measure

      Applications by source and acceptance rate.

      COO monthly

    First result
    2 weeks
    Cost
    Staff time only
    Owner
    COO

    Smallest test

    Add the dropdown option and count expert inquiries for two weeks.

    Why it works

    Add an "Experts" page and a nav link: who Nitrode needs (engine programmers, technical artists, Blender and Unreal specialists, AAA veterans), what the work looks like, how it is paid, and an apply button to the existing contributor platform. Add "Contribute as an expert" to the contact form's Interest list. Link it from the Game Developer job post, since applicants who don't fit the role may still be strong contributors.

    Supply is the constraint in specialist data work. Game developers who search for paid AI work or click from the paper should be able to sign up without guessing where to go.

    Risks and how to handle them

    • A flood of unqualified applicants

      Ask for a portfolio and engine experience upfront.

    Evidence

    • Your websiteContact page: a form only (Name, Email, Organization, Interest, Message, Website). Interest options are Research / GameEngineBench, Products for labs, Enterprise, Careers and Other, with none for experts who want to contribute; no email address, booking link or promised response time.Source
    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
    • Your websiteSitemap (checked November 9, 2026): six URLs (/, /research, /products, /enterprise, /careers, /contact), all last modified October 15, 2026; no blog, case studies, documentation, sample data or page for experts who want to contribute.Source
  • 04

    Nitrode's homepage headline changed from "The Ultimate AI Game Engine." to "Advancing game development through frontier AI research." Product Hunt still describes Nitrode as an "AI game engine to prototype 3D games in a day" and links to nitrode.com. Its 318 points and #3 Day Rank keep it prominent for anyone searching the name. A lab buyer who searches Nitrode can find a consumer prototyping tool before the research company.

    Medium impactLow effort First result in 1 week CEO

    First action

    Edit the Product Hunt description and add a maker comment linking to /research.

    How to measure it

    Outdated profiles remaining

    Now
    –
    Target
    0 of the top 10 search results for "Nitrode"
    By
    30 days

    Steps

    1. 1

      List profiles

      The top 20 search results for "Nitrode" and "Nitrode AI".

      COO 2 hours

    2. 2

      Write one blurb

      Two sentences in the present tense, plus the origin story.

      CEO 1 hour

    3. 3

      Update Product Hunt

      Description, links and a maker comment.

      CEO 1 hour

    4. 4

      Update socials

      X, LinkedIn and the YC profile.

      COO 1 hour

    5. 5

      Directories

      Request edits on aggregator sites that still say "AI game engine".

      COO 1 week

    6. 6

      Recheck

      Search the name again each quarter.

      COO quarterly

    First result
    1 week
    Cost
    $0
    Owner
    CEO

    Smallest test

    Update Product Hunt today.

    Why it works

    Update the Product Hunt product description and maker comment to say the engine was the origin and the company now builds GameEngineBench and expert data. Then do the same on every directory and profile that still describes the engine (X bio, LinkedIn About, YC profile, startup directories). Keep the history; change the present tense.

    Buyers check a vendor's name before they reply. Consistent profiles make the pivot look deliberate, and the old launch becomes proof that the team has built games.

    Risks and how to handle them

    • Old engine users feel abandoned

      Say plainly what happened to the engine and where to go now.

    Evidence

    • Product HuntProduct Hunt still lists Nitrode as an "AI game engine to prototype 3D games in a day", launched July 28, 2025 (#3 Day Rank, 318 points), linking to www.nitrode.com.Source
    • Site historyChange tracking since December 4, 2025: the homepage headline changed from "The Ultimate AI Game Engine." to "Advancing game development through frontier AI research.", and the site dropped Next.js and React.Source
  • 05

    familiar.nitrode.com is still a live Nitrode product: a D&D assistant ("Your DnD Session's Second Brain") with Play Now, Sign In, Pricing and a Discord. Its "About Nitrode" link goes to nitrode.com/about, which returns 404. A consumer tabletop app on the company domain, linking to a dead page, sits oddly next to a SOC 2, lab-facing research brand.

    Medium impactLow effort First result in 1 day CEO

    First action

    Change the "About Nitrode" link to https://www.nitrode.com/.

    How to measure it

    Broken cross-site links

    Now
    –
    Target
    0
    By
    7 days

    Steps

    1. 1

      Fix the link

      Point "About Nitrode" to the homepage.

      Full-Stack Engineer 15 minutes

    2. 2

      Pull the numbers

      Active Familiar users, revenue and support load.

      COO 1 day

    3. 3

      Decide

      Showcase, spin out or sunset.

      CEO 1 day

    4. 4

      Explain it

      One line in Familiar's footer and, if it is a showcase, a mention on /research.

      Full-Stack Engineer 2 hours

    5. 5

      Tell users

      A Discord post on the decision.

      COO 1 hour

    6. 6

      Audit links

      Check every Nitrode subdomain for links to retired pages.

      Full-Stack Engineer 2 hours

    First result
    1 day
    Cost
    $0
    Owner
    CEO

    Smallest test

    Fix the link today.

    Why it works

    Choose one of three paths. Keep Familiar as a showcase of Nitrode's multimodal and transcription work, and say so on both sites. Move it to its own brand and domain. Or sunset it with notice to users. Whatever the choice, fix the /about link today (point it to the homepage or a real About page) and make sure Familiar's footer explains the relationship.

    A clear portfolio keeps lab buyers' attention on the core offer. Fixing a dead link from a live product is free.

    Risks and how to handle them

    • Losing a small paying user base

      Spin out rather than shut down if usage is real.

    Evidence

    • Your websitefamiliar.nitrode.com is a live Nitrode page for Familiar, a D&D assistant ("Your DnD Session's Second Brain") with Play Now, Sign In, Pricing and a Discord link; its "About Nitrode" link points to nitrode.com/about, which returns 404 (checked November 9, 2026).Source
    • Your websiteHomepage: H1 "Advancing game development through frontier AI research."; meta description "Nitrode is building the evaluation, data, and post-training layer for specialized AI systems in game development."; sections for Research (GameEngineBench), For labs ("contractor-sourced UE5 data and RL environments") and For enterprises; badges "SOC 2 Type I" and "Backed by Y Combinator"; footer "© 2025 Inception Technologies"; no privacy policy or terms link.Source
  • 06

    Nitrode's buyers are lab data teams and enterprise security reviewers, and the enterprise offer asks studios to hand over "proprietary workflow traces". The site shows a "SOC 2 Type I" badge but no privacy policy, terms or trust page. The footer still reads "© 2025 Inception Technologies", with no line explaining how that entity relates to Nitrode.

    Medium impactLow effort First result in 1 month COO

    First action

    Update the footer year and add the entity line.

    How to measure it

    Security review cycle time

    Now
    –
    Target
    -25%
    By
    2 quarters

    Steps

    1. 1

      Footer

      Current year and the entity relationship.

      Full-Stack Engineer 30 minutes

    2. 2

      Privacy and terms

      Have counsel draft or review both pages.

      COO 1 week

    3. 3

      Trust page

      SOC 2 scope, report request, data handling, contributor NDAs.

      COO 3 days

    4. 4

      Security FAQ

      The ten questions buyers ask most.

      CTO 2 days

    5. 5

      Link it

      From /enterprise, /products and the footer.

      Full-Stack Engineer 1 hour

    6. 6

      Review

      Update when Type II lands.

      COO quarterly

    First result
    1 month
    Cost
    Legal review fees
    Owner
    COO

    Smallest test

    Publish the trust page with a "request our SOC 2 report" link and count requests.

    Why it works

    Add a /trust page: SOC 2 Type I scope and how to request the report, plans for Type II, data handling for customer traces (storage, retention, access, deletion), contributor confidentiality and how experts are vetted. Link a privacy policy and terms in the footer, update the year and add "Nitrode is a product of Inception Technologies, Inc." (or the correct entity).

    Security review is the slowest step in an enterprise deal. A trust page answers the first questions before they are asked, and a current footer signals an active company.

    Risks and how to handle them

    • Overstating security

      Describe only controls in the audited scope.

    Evidence

    • Your websiteHomepage: H1 "Advancing game development through frontier AI research."; meta description "Nitrode is building the evaluation, data, and post-training layer for specialized AI systems in game development."; sections for Research (GameEngineBench), For labs ("contractor-sourced UE5 data and RL environments") and For enterprises; badges "SOC 2 Type I" and "Backed by Y Combinator"; footer "© 2025 Inception Technologies"; no privacy policy or terms link.Source
    • Your websiteEnterprise page: custom evaluation frameworks for gaming and creative enterprises; routing harnesses that work with existing coding agents to cut costs; post-training that turns proprietary workflow traces into SFT datasets and RL environments for private, domain-specific models; CTA "If your team is evaluating or deploying foundation models for specialized workflows, let's talk." No customers, pricing, timelines or case studies.Source
  • 07

    Every CTA on nitrode.com ("Work with us", "Get in touch", "let's talk") ends at one form with no email address, no booking link and no promised reply time. Lab and enterprise buyers are few and high-value. When one of them arrives ready to talk, a blank form is the weakest possible next step.

    Medium impactLow effort First result in 2 weeks CEO

    First action

    Add the reply promise and [email protected] to the page.

    How to measure it

    Inquiry-to-scoping-call rate

    Now
    –
    Target
    60%
    By
    60 days

    Steps

    1. 1

      Reply promise

      One line above the form.

      Full-Stack Engineer 30 minutes

    2. 2

      Booking link

      Shown when Interest is labs or enterprise.

      Full-Stack Engineer 2 hours

    3. 3

      Routing

      Each option to a named owner role.

      COO 1 hour

    4. 4

      Alert

      Flag anything unanswered after one business day.

      COO 1 hour

    5. 5

      Scoping script

      Five questions for the first call.

      CEO 2 hours

    6. 6

      Measure

      Reply time and call rate by Interest.

      COO monthly

    First result
    2 weeks
    Cost
    $0
    Owner
    CEO

    Smallest test

    Add the reply promise this week and measure reply time.

    Why it works

    After the Interest field, show a reply promise ("We reply within one business day") and, for Products for labs and Enterprise, a booking link for a 30-minute scoping call with a founder. Show [email protected], the address used in the YC launch, for researchers. Route each Interest option to the right owner and set an alert for anything not answered within a day.

    Fast, specific replies win early B2B deals, and a booking link removes a round of email.

    Risks and how to handle them

    • Founders' calendars fill with poor-fit calls

      Show the booking link only after Organization is filled in.

    Evidence

    • Your websiteContact page: a form only (Name, Email, Organization, Interest, Message, Website). Interest options are Research / GameEngineBench, Products for labs, Enterprise, Careers and Other, with none for experts who want to contribute; no email address, booking link or promised response time.Source
    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source

This quarter 12

The core plays for the next three months.

  • 08

    The For labs page sells RL environments and coding datasets, but offers no sample, no process and no proof. Turing invites visitors to request dataset samples. Meanwhile Nitrode already has a public, Apache-licensed sample of exactly what it sells: unrealbench, 14 Unreal coding tasks on Harbor with starter projects and verifiers. It has 1 star and isn't linked from the site.

    High impactMedium effort First result in 1 month Member of Technical Staff

    First action

    Add a two-paragraph sample section and the repo link to /products.

    How to measure it

    Sample-sourced lab calls

    Now
    –
    Target
    5 a month
    By
    90 days

    Steps

    1. 1

      Write the sample section

      What it is and how to run it.

      Member of Technical Staff, Evals 1 day

    2. 2

      Repo README

      A "custom environments" section linking to /products.

      Member of Technical Staff, Evals 2 hours

    3. 3

      One-hour quick start

      Test it on a clean machine.

      Game Developer 2 days

    4. 4

      Paid vs free table

      Scale, held-out tasks, traces, custom categories.

      CEO 1 day

    5. 5

      Guided run offer

      Booking link for lab teams.

      Full-Stack Engineer 1 hour

    6. 6

      Track

      Repo traffic to /products and calls.

      COO monthly

    First result
    1 month
    Cost
    Staff time only
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Link unrealbench from /products and watch referral traffic for a month.

    Why it works

    Add a "Try a sample environment" section to /products: what unrealbench contains, how to run one task in an hour, and how a paid environment differs (scale, held-out tasks, expert traces, custom categories). Give the repo a README section called "Need more? Custom environments from Nitrode" that links to the labs page. Offer a guided run on a call for lab teams.

    Lab data teams judge vendors by running their samples. A runnable sample shortens evaluation and shows the verifier quality that sets Nitrode apart.

    Risks and how to handle them

    • The sample sets the price expectation at zero

      Show clearly what only the paid work includes.

    Builds on

    Evidence

    • GitHubgithub.com/Nitrode-Research/GameEngineBench returns 404 (checked twice on November 9, 2026). The organization's only public repository is "unrealbench": 14 Unreal Engine coding tasks for agents on Harbor, Apache-2.0, with instructions, starter projects and verifiers public; 1 star, 0 forks, and no link to nitrode.com or the paper.Source
    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
    • Competitor researchRivals' own homepages: Mercor, "organizing human intelligence to power the AI economy", with an expert network and benchmarks; Surge AI, "Human Intelligence for AGI"; Turing, "Accelerate superintelligence", which invites visitors to request dataset samples or join its expert network and lists RL environments.Source
  • 09

    GameEngineBench shows that every configuration except one scores under 30%, and that failures cluster in replication, actor lifecycle and save/persistence. That breakdown is exactly what a model team needs to decide what data to buy. Today there is no way to ask for a score: the research page has no submission route, and the contact form only lumps research questions together.

    High impactMedium effort First result in 6 weeks Member of Technical Staff

    First action

    Write a one-page "Get scored" process and link it from /research.

    How to measure it

    Scoring requests to paid work

    Now
    –
    Target
    1 in 4
    By
    2 quarters

    Steps

    1. 1

      Define the process

      Inputs, NDA, held-out split, turnaround.

      Member of Technical Staff, Evals 2 days

    2. 2

      Report template

      Category breakdown, failed tasks, traces.

      Member of Technical Staff, Evals 1 week

    3. 3

      Matched offers

      Map each failure category to a data or environment product.

      Member of Technical Staff, Post-Training 3 days

    4. 4

      Publish

      "Get scored" section and form option.

      Full-Stack Engineer 1 day

    5. 5

      Outreach

      Invite model teams not yet on the leaderboard.

      CEO 2 weeks

    6. 6

      Review

      Requests, reports delivered and contracts.

      COO monthly

    First result
    6 weeks
    Cost
    Compute per run plus staff time
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Offer one model team a private category report this month.

    Why it works

    Publish a "Get scored" process: a model team submits an endpoint or weights under NDA, Nitrode runs the held-out split, and the team gets a private report of pass@1 by category, the hardest failed tasks and example traces. Public listing is optional. The report ends with matched offers: RL environments and expert traces for the categories where the model failed.

    It turns the benchmark from a press asset into the first step of a sale, and the private report gives the team something specific to act on.

    Risks and how to handle them

    • Scoring looks like a conflict of interest when Nitrode also sells training data

      Keep a held-out split that no customer data ever touches, and publish the policy.

    Builds on

    Evidence

    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
  • 10

    The leaderboard has 12 configurations from one July 2026 run, and the paper was last revised on July 15. Model releases arrive every few weeks, and "how does the new model do on real game-engine code?" is the question developers and lab teams ask on release day. A leaderboard that waits months to update can't be the place people check.

    High impactMedium effort First result in Next major release Member of Technical Staff

    First action

    Write the run-book and budget for one release a month.

    How to measure it

    Median time to score

    Now
    –
    Target
    7 days or less
    By
    2 quarters

    Steps

    1. 1

      Run-book

      Splits, settings, judge calibration, sign-off.

      Member of Technical Staff, Evals 3 days

    2. 2

      Automate

      One command per new configuration.

      Full-Stack Engineer 2 weeks

    3. 3

      Budget

      Compute per run, approved in advance.

      COO 1 day

    4. 4

      Changelog

      Dated entries on /research.

      Full-Stack Engineer 1 day

    5. 5

      Release note

      300 words and one chart per release.

      Member of Technical Staff, Evals per release

    6. 6

      Distribute

      X, LinkedIn and Unreal developer forums.

      CEO per release

    First result
    Next major release
    Cost
    Compute per release plus staff time
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Score the next major release within seven days and compare traffic with the July launch.

    Why it works

    Set a standing rule: when a major model or agent ships, run the public and held-out splits within seven days, update the leaderboard with a dated row, and post a short note on what changed by category. Keep a changelog on /research.

    Release-week results get shared while attention is highest, and a living leaderboard gives people a reason to come back and to cite Nitrode by name.

    Risks and how to handle them

    • Rushed runs produce wrong numbers

      Mark scores "preliminary" until the judge audit is done.

    Builds on

    Evidence

    • Research paperGameEngineBench paper (arXiv, submitted July 3, 2026, revised July 15, 2026; eight authors): tasks from "nine open-source Unreal projects" such as ActionRoguelike, GASShooter and Bomber; Appendix D points readers to github.com/Nitrode-Research/GameEngineBench and says "The current repository already contains the key scripts required to reproduce benchmark runs." It also compares cost and speed across configurations.Source
    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
  • 11

    The research page already contains standout material: a "Zombie System" task no configuration solves because AI control, round state, server-authoritative damage and replicated feedback must all agree, and persistence tasks that lose actor identity across streaming levels. But the site has no blog or notes section, so this material lives in one page and a PDF.

    Medium impactMedium effort First result in 1 month Game Developer

    First action

    Turn the "Zombie System" analysis into the first note.

    How to measure it

    Notes-sourced expert applications

    Now
    –
    Target
    20 a month
    By
    2 quarters

    Steps

    1. 1

      Set up /research/notes

      Simple index with dates and RSS.

      Full-Stack Engineer 2 days

    2. 2

      Pick the calendar

      Six categories for six months.

      Member of Technical Staff, Evals 1 day

    3. 3

      Write note one

      "Zombie System": why nobody solves it.

      Game Developer 1 week

    4. 4

      Technical review

      Accuracy and no held-out task leakage.

      Member of Technical Staff, Evals 2 days

    5. 5

      Share

      Unreal forums, r/unrealengine, X and LinkedIn.

      CEO 1 day

    6. 6

      Link to experts page

      "Think you can solve it? Join the network."

      Full-Stack Engineer 1 hour

    First result
    1 month
    Cost
    Staff time only
    Owner
    Game Developer

    Smallest test

    Publish the first note and count shares and expert sign-ups.

    Why it works

    Start /research/notes with a monthly post on one failure category (replication, actor lifecycle, save/load, gameplay ability systems). Show the task, what the agents tried, why it broke and what an experienced Unreal developer does differently. Have the Game Developer hire write or review each one, and share it where Unreal developers gather.

    Specific, technical failure stories travel in developer communities, attract expert contributors and show labs the depth of Nitrode's judgment.

    Risks and how to handle them

    • Leaking held-out tasks

      Write only about public tasks.

    Evidence

    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • Your websiteSitemap (checked November 9, 2026): six URLs (/, /research, /products, /enterprise, /careers, /contact), all last modified October 15, 2026; no blog, case studies, documentation, sample data or page for experts who want to contribute.Source
    • HiringCareers page (November 9, 2026), four open full-time roles on the Y Combinator job board: Game Developer (San Francisco or remote US, $95K-$145K, Unreal/Unity, "Triple-A game development" preferred), Full-Stack Engineer ($110K-$160K), Member of Technical Staff, Evals ($120K-$250K, 1-3% equity) and Member of Technical Staff, Post-Training ($150K-$350K, 1-3% equity). YC lists a team of 8, founded 2024, batch W25.Source
  • 12

    The enterprise page sells "routing harnesses" that cut costs with existing coding agents, but gives no number. The GameEngineBench paper already measures cost and speed by configuration and finds that the most accurate setting isn't the cheapest. That is the core argument for routing, and it is sitting in a paper's figures, not on the page studios read.

    High impactMedium effort First result in 1 month Member of Technical Staff

    First action

    Pull cost and pass rates per configuration from the paper's data into one table.

    How to measure it

    Routing-led enterprise inquiries

    Now
    –
    Target
    5 a quarter
    By
    2 quarters

    Steps

    1. 1

      Build the table

      Cost, time and pass@1 per configuration and category.

      Member of Technical Staff, Evals 2 days

    2. 2

      Model the routed mix

      Best mix at a target pass rate.

      Member of Technical Staff, Post-Training 3 days

    3. 3

      Chart it

      One clear chart and a worked example.

      Full-Stack Engineer 2 days

    4. 4

      Publish

      On /enterprise and /research.

      Full-Stack Engineer 1 day

    5. 5

      Sales one-pager

      PDF for studio calls.

      CEO 1 day

    6. 6

      Refresh

      With each leaderboard update.

      Member of Technical Staff, Evals monthly

    First result
    1 month
    Cost
    Staff time only
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Post the cost-per-solved-task chart on LinkedIn and count studio replies.

    Why it works

    Add a chart to /enterprise and /research: cost per solved task and time per solved task for each configuration, by task category. Add a worked example: a studio running 1,000 agent tasks a month, with costs for the most accurate setting, the cheapest acceptable one and a routed mix. End with "Get this analysis on your own codebase".

    Engineering leaders buy on cost per useful outcome. Showing the trade-off with Nitrode's own data makes routing concrete.

    Risks and how to handle them

    • Model prices change quickly

      Date the chart and show the price assumptions.

    Evidence

    • Your websiteEnterprise page: custom evaluation frameworks for gaming and creative enterprises; routing harnesses that work with existing coding agents to cut costs; post-training that turns proprietary workflow traces into SFT datasets and RL environments for private, domain-specific models; CTA "If your team is evaluating or deploying foundation models for specialized workflows, let's talk." No customers, pricing, timelines or case studies.Source
    • Research paperGameEngineBench paper (arXiv, submitted July 3, 2026, revised July 15, 2026; eight authors): tasks from "nine open-source Unreal projects" such as ActionRoguelike, GASShooter and Bomber; Appendix D points readers to github.com/Nitrode-Research/GameEngineBench and says "The current repository already contains the key scripts required to reproduce benchmark runs." It also compares cost and speed across configurations.Source
  • 13

    The enterprise page lists evaluations, routing and post-training, but has no price, timeline, deliverable or customer. The only next step is "let's talk". Nitrode's YC launch asks for introductions to creative and gaming companies, but when those introductions come, the studio has nothing concrete to say yes to.

    High impactMedium effort First result in 6 weeks CEO

    First action

    Write the pilot scope and a sample report outline.

    How to measure it

    Studio pilots

    Now
    –
    Target
    3
    By
    2 quarters

    Steps

    1. 1

      Scope it

      Tasks, configurations, timeline, deliverables.

      Member of Technical Staff, Evals 2 days

    2. 2

      Price it

      One starting price, credited toward post-training.

      CEO 1 day

    3. 3

      Sample report

      Built on public GameEngineBench tasks.

      Member of Technical Staff, Evals 1 week

    4. 4

      Update /enterprise

      Offer, steps, sample and a booking link.

      Full-Stack Engineer 2 days

    5. 5

      Ask for intros

      YC network and investors, with the one-pager.

      CEO 2 weeks

    6. 6

      First case study

      With the first studio's permission.

      COO after pilot

    First result
    6 weeks
    Cost
    Staff time; expert hours per pilot
    Owner
    CEO

    Smallest test

    Offer the pilot to three warm studio introductions this month.

    Why it works

    Offer "GameEngineBench on your codebase": in about four weeks, Nitrode's experts write 20-30 tasks from the studio's own engine code, score 4-6 model and agent configurations, and deliver a report with a routing recommendation and a cost estimate. Set one public starting price and credit it toward post-training work. Put the offer, its steps and a sample report outline on /enterprise.

    A fixed scope lowers the risk of a first purchase for studios that are new to AI evaluation, and the report leads naturally to routing and post-training.

    Ready to use

    CopyStudio evaluation pilot outline

    Week 1: kickoff, pick 3 workflows, sign data terms
    Week 2: experts write 20-30 tasks with verifiers
    Week 3: score 4-6 model/agent configurations
    Week 4: report: pass@1 by category, failure examples, cost per solved task, routing recommendation, post-training estimate
    Price: one fixed fee, credited toward post-training

    Risks and how to handle them

    • Studios won't share code

      Offer on-premises runs and tasks written from interface specs.

    Evidence

    • Your websiteEnterprise page: custom evaluation frameworks for gaming and creative enterprises; routing harnesses that work with existing coding agents to cut costs; post-training that turns proprietary workflow traces into SFT datasets and RL environments for private, domain-specific models; CTA "If your team is evaluating or deploying foundation models for specialized workflows, let's talk." No customers, pricing, timelines or case studies.Source
    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
  • 14

    The For labs page lists five product lines (coding datasets, tool-calling environments, computer-use trajectories, multimodal data, benchmarks) in one paragraph each, with no example record, quality process or volume. Turing invites visitors to request dataset samples. Lab buyers compare vendors on exactly these details.

    Medium impactMedium effort First result in 1 month Member of Technical Staff

    First action

    Draft the card for developer traces, the most distinctive product.

    How to measure it

    Sample-pack requests from labs

    Now
    –
    Target
    8 a quarter
    By
    2 quarters

    Steps

    1. 1

      Pick examples

      One record per product line, cleared for sharing.

      Member of Technical Staff, Post-Training 3 days

    2. 2

      Write the cards

      Sourcing, review, volume, formats.

      Member of Technical Staff, Post-Training 1 week

    3. 3

      Redact

      Remove anything client-specific.

      COO 1 day

    4. 4

      Build pages

      Cards on /products with anchors.

      Full-Stack Engineer 2 days

    5. 5

      Sample-pack button

      Routes to the labs inbox.

      Full-Stack Engineer 2 hours

    6. 6

      Measure

      Requests and calls per card.

      COO monthly

    First result
    1 month
    Cost
    Staff time only
    Owner
    Member of Technical Staff, Post Training

    Smallest test

    Publish the developer-trace card first and count requests.

    Why it works

    For each product line, publish a short data card: one redacted example record (a developer trace, a computer-use trajectory in Blender or Unreal, an RL task with its verifier), how experts are selected, how each item is reviewed, typical volume per month and the formats delivered. Add a "Request a sample pack" button that routes to the labs inbox.

    Data cards answer the first technical questions before a call and show that Nitrode's quality process is real.

    Risks and how to handle them

    • Revealing client work

      Use only internally made or public-task examples.

    Builds on

    Evidence

    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
    • Competitor researchRivals' own homepages: Mercor, "organizing human intelligence to power the AI economy", with an expert network and benchmarks; Surge AI, "Human Intelligence for AGI"; Turing, "Accelerate superintelligence", which invites visitors to request dataset samples or join its expert network and lists RL environments.Source
  • 15

    Nitrode's edge over generalist data vendors is its specialists, but the site describes them in one line: "hundreds of game developers and creative software specialists". Mercor, Surge AI and Turing all lead with their expert networks too. A claim with no breakdown is hard to tell apart from theirs.

    Medium impactLow effort First result in 2 weeks COO

    First action

    Export contributor profiles and count them by discipline and engine.

    How to measure it

    Calls citing network depth

    Now
    –
    Target
    50% of lab calls
    By
    2 quarters

    Steps

    1. 1

      Export

      Contributor disciplines, engines, years.

      COO 1 day

    2. 2

      Count

      Anonymized totals only.

      COO 1 day

    3. 3

      Vetting steps

      Describe the test and review process.

      Member of Technical Staff, Post-Training 1 day

    4. 4

      Design

      A compact stats block.

      Full-Stack Engineer 1 day

    5. 5

      Publish

      On /products and /experts.

      Full-Stack Engineer 2 hours

    6. 6

      Refresh

      Each quarter.

      COO quarterly

    First result
    2 weeks
    Cost
    $0
    Owner
    COO

    Smallest test

    Add three numbers to /products this week.

    Why it works

    Add an anonymized breakdown of the network to /products and the experts page: counts by discipline (engine programmers, gameplay, technical art, animation, rendering, tools), by engine (Unreal, Unity, Godot, Blender), years of experience, the share with shipped AAA or indie titles, and the vetting steps. Refresh it every quarter.

    Specific numbers make the specialist claim checkable, and they help experts see that they would be working alongside peers.

    Risks and how to handle them

    • Numbers look small next to generalist vendors

      Lead with depth (years, shipped titles) rather than headcount.

    Builds on

    Evidence

    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
    • Competitor researchRivals' own homepages: Mercor, "organizing human intelligence to power the AI economy", with an expert network and benchmarks; Surge AI, "Human Intelligence for AGI"; Turing, "Accelerate superintelligence", which invites visitors to request dataset samples or join its expert network and lists RL environments.Source
  • 16

    GameEngineBench is built from nine open-source Unreal projects, including well-known learning repositories such as ActionRoguelike and GASShooter. Their maintainers and users are exactly the Unreal C++ developers Nitrode needs as experts and readers, but nothing on the site credits the projects or links to them.

    Medium impactLow effort First result in 1 month Member of Technical Staff

    First action

    List the nine projects with repo links and licenses.

    How to measure it

    Source-project backlinks and expert sign-ups

    Now
    –
    Target
    4 of 9
    By
    90 days

    Steps

    1. 1

      List and license-check

      All nine projects.

      Member of Technical Staff, Evals 1 day

    2. 2

      Credit section

      On /research with links.

      Full-Stack Engineer 2 hours

    3. 3

      Per-project results

      Pass rates on each project's tasks.

      Member of Technical Staff, Evals 2 days

    4. 4

      Write to maintainers

      Thanks, results, badge, invitation.

      CTO 1 week

    5. 5

      Badge

      A simple README badge linking to /research.

      Full-Stack Engineer 2 hours

    6. 6

      Follow up

      Track replies and links.

      COO monthly

    First result
    1 month
    Cost
    $0
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Write to two maintainers this week.

    Why it works

    Add a "Source projects" section to /research that credits each project with a link and license. Write to each maintainer with how their project is used and an offer: early access to results on their project, a "used in GameEngineBench" badge for their README and an invitation to join the expert network. Respect any maintainer who prefers not to be listed.

    Crediting sources is good research practice, and maintainers who add a badge or mention send Unreal developers back to Nitrode.

    Risks and how to handle them

    • A maintainer objects to the use

      Check licenses first and honor opt-out requests.

    Builds on

    Evidence

    • Research paperGameEngineBench paper (arXiv, submitted July 3, 2026, revised July 15, 2026; eight authors): tasks from "nine open-source Unreal projects" such as ActionRoguelike, GASShooter and Bomber; Appendix D points readers to github.com/Nitrode-Research/GameEngineBench and says "The current repository already contains the key scripts required to reproduce benchmark runs." It also compares cost and speed across configurations.Source
    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
  • 17

    Nitrode's YC launch asked for introductions to creative and gaming companies, and its enterprise offer targets gaming and creative enterprises. A studio has little reason to take a cold call from an eight-person startup. It has a good reason to help decide what the next benchmark measures in its own engine work.

    Medium impactMedium effort First result in 1 quarter CEO

    First action

    Ask the YC network for ten introductions to studio technical directors.

    How to measure it

    Advisory-sourced pilots

    Now
    –
    Target
    2
    By
    3 quarters

    Steps

    1. 1

      Define the group

      Purpose, cadence, what members get.

      CEO 1 day

    2. 2

      Ask for intros

      YC network and investors.

      CEO 2 weeks

    3. 3

      Recruit

      Five to eight members.

      CEO 1 month

    4. 4

      First session

      Pain points by category.

      Member of Technical Staff, Evals 1 day

    5. 5

      Early readouts

      Two weeks before each release.

      Member of Technical Staff, Evals quarterly

    6. 6

      Pilot offer

      Offer the fixed-scope pilot to interested members.

      CEO ongoing

    First result
    1 quarter
    Cost
    Staff time
    Owner
    CEO

    Smallest test

    Hold one call with three studio engineers on next-benchmark priorities.

    Why it works

    Invite five to eight technical directors or engine leads from studios of different sizes to a quarterly advisory group. They propose task categories from real pain points, see results two weeks early and get a private readout. They don't pay, and Nitrode commits to nothing commercial. The group becomes a natural source of pilots.

    Shaping the research gives studio leaders a reason to engage now, and Nitrode gets task ideas grounded in production.

    Risks and how to handle them

    • Members' legal teams limit participation

      Keep it advisory, with no data sharing required.

    Evidence

    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
    • Your websiteEnterprise page: custom evaluation frameworks for gaming and creative enterprises; routing harnesses that work with existing coding agents to cut costs; post-training that turns proprietary workflow traces into SFT datasets and RL environments for private, domain-specific models; CTA "If your team is evaluating or deploying foundation models for specialized workflows, let's talk." No customers, pricing, timelines or case studies.Source
  • 18

    Mercor, Surge AI and Turing all sell expert data, benchmarks and RL environments to the same labs, with far bigger brands. Nitrode's six pages never say why a lab should buy game-development data from a specialist. The best evidence is Nitrode's own: models compile but fail on authority, replication and lifecycle, skills only experienced engine developers can judge.

    Medium impactLow effort First result in 1 month CEO

    First action

    Outline five ways game-engine data differs from general coding data.

    How to measure it

    Page-assisted lab inquiries

    Now
    –
    Target
    30% of lab inquiries
    By
    2 quarters

    Steps

    1. 1

      Outline

      Five differences, each with a GameEngineBench example.

      CEO 1 day

    2. 2

      Technical proof

      Runtime verifiers versus reference diffs.

      Member of Technical Staff, Evals 2 days

    3. 3

      Write

      Fair, specific, no unverifiable rival claims.

      CEO 3 days

    4. 4

      Publish

      Linked from /products.

      Full-Stack Engineer 2 hours

    5. 5

      Use in sales

      Send before first calls.

      CEO ongoing

    6. 6

      Refresh

      Twice a year.

      CEO 6 months

    First result
    1 month
    Cost
    $0
    Owner
    CEO

    Smallest test

    Send the outline to two lab contacts and ask what is missing.

    Why it works

    Publish a fair page on choosing a data vendor for game and creative-software work: which tasks need engine-level judgment, how verifiers run in real Unreal builds, why runtime tests beat reference diffs, and where a generalist network is fine. Use GameEngineBench failure examples as proof. Avoid claims about competitors that can't be verified.

    Labs comparing vendors search for this, and a clear specialist case keeps Nitrode on shortlists where it would otherwise lose on brand.

    Risks and how to handle them

    • Reads as an attack on bigger vendors

      Frame it as a guide for choosing, not a takedown.

    Evidence

    • Competitor researchRivals' own homepages: Mercor, "organizing human intelligence to power the AI economy", with an expert network and benchmarks; Surge AI, "Human Intelligence for AGI"; Turing, "Accelerate superintelligence", which invites visitors to request dataset samples or join its expert network and lists RL environments.Source
    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • Your websiteSitemap (checked November 9, 2026): six URLs (/, /research, /products, /enterprise, /careers, /contact), all last modified October 15, 2026; no blog, case studies, documentation, sample data or page for experts who want to contribute.Source
  • 19

    Nitrode's contributor platform has "hundreds of contributors" across game development and creative software. Its products need specific, scarce skills (engine C++, CUDA, Rust, Blender, Unreal and Resolume operators). Good game developers know other good game developers, and the hardest disciplines are the ones a general job post fills slowest.

    Medium impactLow effort First result in 1 month COO

    First action

    List the three disciplines with the biggest gap between demand and supply.

    How to measure it

    Referral share of accepted experts

    Now
    –
    Target
    30%
    By
    2 quarters

    Steps

    1. 1

      Find the gaps

      Disciplines with the longest task backlog.

      COO 1 day

    2. 2

      Set bonuses

      Higher for scarce skills, paid after first accepted task.

      COO 1 day

    3. 3

      Build links

      Personal referral links in the platform.

      Full-Stack Engineer 1 week

    4. 4

      Most-needed list

      On /experts and in updates.

      COO monthly

    5. 5

      Announce

      To current contributors.

      COO 1 day

    6. 6

      Measure

      Referral acceptance and quality.

      Member of Technical Staff, Post-Training monthly

    First result
    1 month
    Cost
    Bonus per accepted expert
    Owner
    COO

    Smallest test

    Offer a referral bonus for one scarce discipline for a month.

    Why it works

    If the contributor platform doesn't already pay for referrals, add a referral bonus paid once the referred expert's first accepted task passes review. Set higher bonuses for the disciplines with the longest backlog. Show a "Most needed this month" list on the experts page and in contributor updates.

    Referrals from vetted experts arrive pre-screened and match the skills the current projects need.

    Risks and how to handle them

    • Low-quality referrals for the bonus

      Pay only after the first task passes review.

    Builds on

    Evidence

    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source

Big bets 3

Larger plays that can change the trajectory.

  • 20

    Nitrode promised "a suite of benchmarks", but only GameEngineBench is public. It already sells computer-use trajectories for Blender and Unreal. Its own finding is that model rankings track spatial reasoning benchmarks more than coding benchmarks. An editor-level computer-use benchmark would measure the spatial, visual work that code benchmarks miss.

    High impactHigh effort First result in 2 quarters CTO

    First action

    Write 10 pilot tasks and test that each check passes or fails as expected.

    How to measure it

    Labs requesting editor-benchmark scores

    Now
    –
    Target
    3
    By
    3 quarters

    Steps

    1. 1

      Pick task families

      Scene, asset, material, level fixes.

      Game Developer 2 weeks

    2. 2

      Build checks

      Programmatic tests on saved projects.

      Member of Technical Staff, Evals 1 month

    3. 3

      Pilot

      10 tasks across three agents.

      Member of Technical Staff, Evals 2 weeks

    4. 4

      Scale

      To 100+ tasks with experts.

      COO 2 months

    5. 5

      Paper and repo

      Public split, working code link.

      CTO 1 month

    6. 6

      Launch

      Leaderboard, notes and lab outreach.

      CEO 2 weeks

    First result
    2 quarters
    Cost
    Expert hours and compute
    Owner
    CTO

    Smallest test

    Run 10 Blender tasks with two agents and publish a note.

    Why it works

    Build a benchmark of tasks in the Unreal and Blender editors (place and light a scene, rig and export an asset, fix a material or a broken level) with programmatic checks on the saved project. Keep a held-out split and launch it with the same paper, repo and leaderboard pattern. Paid computer-use trajectories then come from the same task design.

    A second benchmark makes the "suite" real and extends Nitrode's authority into the computer-use data it already sells.

    Risks and how to handle them

    • Editor automation is flaky

      Score saved files, not screenshots.

    Builds on

    Evidence

    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
    • Your websiteFor labs page: coding datasets and evaluations for game engines, C++, CUDA, Rust and debugging, plus traces of how experienced game developers work; tool-calling RL environments; computer-use trajectories for Blender, Unreal, Resolume, SAP and Jira; multimodal datasets; an expert network of "hundreds of game developers and creative software specialists". No pricing, process, sample data, named customers or case studies; the main CTA is "See GameEngineBench".Source
  • 21

    Nitrode sits on data no one else publishes: pass rates by game-system category, cost per solved task, recurring failure patterns and what expert developers do differently. Its buyers (lab research teams and studio technical leaders) need a trusted yearly view of where AI can and can't do engine-scale work, and right now there isn't one.

    High impactHigh effort First result in 2 quarters CEO

    First action

    Choose the report's five headline questions.

    How to measure it

    Qualified report downloads

    Now
    –
    Target
    300
    By
    60 days after launch

    Steps

    1. 1

      Pick questions

      Five that buyers care about.

      CEO 1 week

    2. 2

      Gather data

      Leaderboard history and category trends.

      Member of Technical Staff, Evals 1 month

    3. 3

      Survey experts

      Where AI helps and hurts in their work.

      COO 1 month

    4. 4

      Write and design

      Report, short version and charts.

      CEO 1 month

    5. 5

      Launch

      Post, webinar and outreach.

      CEO 2 weeks

    6. 6

      Follow up

      Offer pilots to studio downloaders.

      CEO 1 month

    First result
    2 quarters
    Cost
    Staff time and design
    Owner
    CEO

    Smallest test

    Publish one chapter (failure categories) as a standalone post.

    Why it works

    Publish a yearly report: leaderboard history, progress by category, the tasks still unsolved, cost trends, and a survey of the expert network on where they use AI today. Release it with a launch post, a webinar for studios and a short version for press. Gate the full data appendix behind an email for follow-up.

    An annual report gets cited all year, starts sales conversations with both audiences and grows a list of studio and lab readers.

    Risks and how to handle them

    • Too few data points in year one

      Pair the leaderboard with the expert survey.

    Builds on

    Evidence

    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
    • Launch YCLaunch post "Nitrode - Advancing AI for Game Development": Nitrode "will open-source a suite of benchmarks" over the coming months; Mint connects game development experts (engine programmers, technical artists) and has "hundreds of contributors"; the ask is companies that need custom datasets or evals, and introductions to creative or gaming companies; contact [email protected]; model rankings track spatial reasoning benchmarks more closely than traditional agentic coding benchmarks.Source
  • 22

    Nitrode's enterprise work (custom evaluations, routing, post-training) is currently sold as projects. A studio's question, which model to use for which workflow, changes every time a new model ships. A studio-specific benchmark built in a pilot loses its value unless someone re-runs it on every release.

    High impactHigh effort First result in 2 quarters Member of Technical Staff

    First action

    Offer the first pilot customer a quarter of re-scoring at a set price.

    How to measure it

    Recurring studio subscriptions

    Now
    –
    Target
    3
    By
    4 quarters

    Steps

    1. 1

      Define tiers

      Re-score, refresh, post-training.

      CEO 1 week

    2. 2

      Automate re-runs

      Private task sets in the same harness.

      Member of Technical Staff, Evals 1 month

    3. 3

      Readout template

      One page per release.

      Member of Technical Staff, Post-Training 1 week

    4. 4

      Routing updates

      Ship configuration changes with each readout.

      Member of Technical Staff, Post-Training per release

    5. 5

      Offer to pilots

      At the end of every pilot.

      CEO ongoing

    6. 6

      Measure

      Retention and expansion.

      COO quarterly

    First result
    2 quarters
    Cost
    Compute and expert hours per subscriber
    Owner
    Member of Technical Staff, Post Training

    Smallest test

    Re-score one pilot's tasks on the next release and ask for a renewal.

    Why it works

    After a pilot, offer a subscription: Nitrode keeps the studio's private task set, re-scores it within a week of each major release, updates the routing configuration and sends a short readout. Higher tiers add quarterly task refreshes by experts and continuous post-training on the studio's traces.

    It turns one-off pilots into recurring revenue and makes Nitrode part of each studio's model decisions.

    Risks and how to handle them

    • Studios want results without paying for upkeep

      Price the first pilot to include one quarter of re-scoring.

    Builds on

    Evidence

    • Your websiteEnterprise page: custom evaluation frameworks for gaming and creative enterprises; routing harnesses that work with existing coding agents to cut costs; post-training that turns proprietary workflow traces into SFT datasets and RL environments for private, domain-specific models; CTA "If your team is evaluating or deploying foundation models for specialized workflows, let's talk." No customers, pricing, timelines or case studies.Source
    • Research paperGameEngineBench paper (arXiv, submitted July 3, 2026, revised July 15, 2026; eight authors): tasks from "nine open-source Unreal projects" such as ActionRoguelike, GASShooter and Bomber; Appendix D points readers to github.com/Nitrode-Research/GameEngineBench and says "The current repository already contains the key scripts required to reproduce benchmark runs." It also compares cost and speed across configurations.Source

Wildcards 2

Unexpected experiments, each with a cheap way to test it.

  • 23

    Nitrode already built two communities: game makers drawn to its AI game engine (a #3 Product Hunt launch with 318 points) and tabletop creators on Familiar's Discord. Both are full of people who make games and creative content, the profile the expert network recruits. Nobody has told them about the new work.

    Medium impactLow effort First result in 2 weeks COO

    First action

    Count reachable users on each list.

    How to measure it

    Legacy-community experts accepted

    Now
    –
    Target
    25
    By
    90 days

    Steps

    1. 1

      Count lists

      Engine users, Product Hunt followers, Discord.

      COO 1 day

    2. 2

      Write the update

      What changed, what's next, how to apply.

      CEO 1 day

    3. 3

      Check consent

      Only email people who agreed to updates.

      COO 1 day

    4. 4

      Send

      Email, Product Hunt update, Discord post.

      COO 1 day

    5. 5

      Vet

      Usual skills test.

      Member of Technical Staff, Post-Training ongoing

    6. 6

      Measure

      Applications and acceptance by source.

      COO monthly

    First result
    2 weeks
    Cost
    $0
    Owner
    COO

    Smallest test

    Post in the Familiar Discord and count applications in a week.

    Why it works

    Send one honest update to the engine's sign-up list, the Product Hunt followers and the Familiar Discord: what Nitrode does now, and an invitation for experienced developers, technical artists and Blender or Unreal users to apply as paid contributors. Track applications from each source and accept only on the usual vetting.

    Warm communities convert better than cold job posts, and the update also closes the loop with early users.

    Risks and how to handle them

    • Hobbyists outnumber professionals

      State experience requirements clearly.

    Builds on

    Evidence

    • Product HuntProduct Hunt still lists Nitrode as an "AI game engine to prototype 3D games in a day", launched July 28, 2025 (#3 Day Rank, 318 points), linking to www.nitrode.com.Source
    • Your websitefamiliar.nitrode.com is a live Nitrode page for Familiar, a D&D assistant ("Your DnD Session's Second Brain") with Play Now, Sign In, Pricing and a Discord link; its "About Nitrode" link points to nitrode.com/about, which returns 404 (checked November 9, 2026).Source
  • 24

    GameDevBench is the other prominent game-development benchmark for agents: 333 tasks derived from web and video tutorials, with the best agent and method at 53.8%. GameEngineBench measures something different: scoped C++ changes in real Unreal projects, tested at runtime. People comparing the two will ask which one matters, and a rivalry helps neither.

    Medium impactMedium effort First result in 1 quarter Member of Technical Staff

    First action

    Write to the GameDevBench authors proposing a short joint note.

    How to measure it

    Academic citations of GameEngineBench

    Now
    –
    Target
    10
    By
    4 quarters

    Steps

    1. 1

      Reach out

      Propose a joint comparison.

      CTO 1 week

    2. 2

      Pick agents

      Four to six configurations on both.

      Member of Technical Staff, Evals 1 day

    3. 3

      Run

      Both benchmarks, same settings.

      Member of Technical Staff, Evals 2 weeks

    4. 4

      Analyse

      Rank agreement and category differences.

      Member of Technical Staff, Evals 1 week

    5. 5

      Publish

      A note on /research and the authors' channels.

      CEO 1 week

    6. 6

      Repeat

      Yearly, alongside the report.

      Member of Technical Staff, Evals yearly

    First result
    1 quarter
    Cost
    Compute and staff time
    Owner
    Member of Technical Staff, Evals

    Smallest test

    Run two agents on a GameDevBench subset and share the result privately with its authors.

    Why it works

    Run the same small set of agents on both benchmarks and publish a short side-by-side: where rankings agree, where they diverge, and what each measures (tutorial-scale tasks versus engine-scale C++). Invite the GameDevBench authors to co-write or comment. Link both ways.

    A joint view positions GameEngineBench as the engine-scale counterpart in a recognised category, and attaches Nitrode to the academic attention around game-dev agents.

    Risks and how to handle them

    • The authors decline

      Publish a fair independent comparison with their public tasks, citing them properly.

    Builds on

    Evidence

    • Competitor researchGameDevBench (arXiv, submitted February 11, 2026, revised June 30, 2026): 333 game development tasks derived from web and video tutorials; the best agent and method solves 53.8%, and visual feedback raises scores.Source
    • Your websiteGameEngineBench page: "110 UE5 C++ tasks", "9 source projects", "12 model configurations evaluated", "55.5% best pass rate"; every other configuration scores under 30% and 31 tasks are unsolved by all; failure analysis by category (save/persistence, replication, actor lifecycle). The leaderboard rows are not in the page text, only the top score, and the only outbound links are the arXiv paper, X and LinkedIn: no code, dataset download or submission route.Source
More example playbooks and reviews

More growth playbooks

Other companies we have researched, each read from what they are hiring for.

  • January growth strategyAn AI-led debt collection agency (formerly Debtsy) that recovers charged-off and late consumer debt for banks, credit unions, fintechs…21 growth ideas
  • Woolpert growth strategyA global architecture, engineering and geospatial firm with a digital division (Woolpert Digital Innovations, a Google Cloud Premier…21 growth ideas
  • Suki growth strategyAmbient clinical intelligence: an AI assistant for clinicians (ambient notes, dictation, coding, order staging, patient summaries and Q&A)…21 growth ideas
  • Jiminy's growth strategyDog food, treats and dental chews made with insect protein (crickets and black soldier fly larvae), sold online and through pet stores…21 growth ideas
  • Bitwarden growth strategyOpen source, end-to-end encrypted password management, secrets management and passkey tools for individuals, teams and enterprises, with…22 growth ideas
  • Manko Window Systems growth strategyA family-owned manufacturer of aluminum storefront, entrance doors, curtain wall, projected, hung and sliding windows and sunshades, and a…21 growth ideas
  • WitnessAI growth strategyAn AI security and governance platform that observes, controls and protects how employees, models, applications and AI agents use AI, with…21 growth ideas
  • Return growth strategyA family-owned nutrient logistics company that sources turkey and chicken litter from 70+ partner barns, tests it, delivers it and spreads…21 growth ideas

See every playbook and website review

Independent research. Programmable wrote this playbook from public sources, as they stood on November 10, 2026, and cites them throughout. Nitrode did not commission, review or endorse it, and Programmable is not affiliated with Nitrode. Company and product names are trademarks of their owners, used only to identify them. The ideas are suggestions and opinion, not professional, legal or financial advice, and not statements about how Nitrode runs its business.

Something wrong, or do you represent Nitrode? Email [email protected] and we will correct it or take it down.

30/60/90 roadmap

What to focus on in each month, and the ideas that carry it.

  1. Days 1 to 307 ideas

    Repair the benchmark's public home: working code link, readable leaderboard, an expert path, profiles that match the new positioning, the Familiar decision, legal and trust basics, and a faster reply path for labs and studios.

  2. Days 31 to 6012 ideas

    Turn research into pipeline: unrealbench as the free sample, model scoring requests, a release-week scoring habit, failure-category notes, cost per solved task, a fixed-scope studio pilot, data cards, expert network proof, credit for the source projects, a studio advisory group, a specialist comparison page and contributor referrals.

  3. Days 61 to 905 ideas

    Commit to the bets: the next benchmark in the suite, an annual state-of-AI-in-game-development report, recurring private evaluations for studios, and two wildcards (the old engine and Familiar community as contributors, and a joint view with GameDevBench).

The research behind the plan

3 research areas, each summarised in a few lines. Open any of them for the full detail.

Customers

What customers say

Customers value evaluations that run real Unreal builds and runtime tests, not reference-diff matching. The most cited problem: models that compile but break gameplay, multiplayer and save systems.

  • Specialist game-development and creative-software experts that generalist data vendors lack
  • Few trustworthy benchmarks for engine-scale C++ work
  • In their words: “evals”

Market

Competitive landscape

4 competitors compared: Mercor, Surge AI, Turing and GameDevBench (academic benchmark).

  • Gap to exploit: Reproducible, engine-scale game-development evaluations
  • Mercor: Generalist; no game-engine depth
  • Surge AI: No game-development specialism

Hiring signals

An eight-person team hiring for the work that grows the business.

  • Member of Technical Staff, Evals: Benchmark upkeep, scoring and failure analysis. Ideas 1, 9, 10, 12.
  • Member of Technical Staff, Post-Training: Data products and studio post-training. Ideas 14, 22.
  • Game Developer: AAA Unreal/Unity experience for tasks and notes. Ideas 11, 20.

From the team that wrote this playbook

All products
  • ProgrammableAgencyWorking AI systems in days, not quarters (opens programmable.agency in a new tab)
  • ProgrammableInfoAn agent that finds, researches and asks first (opens programmable.info in a new tab)
  • ProgrammableDigitalScreenshots in, an animated product demo out (opens programmable.digital in a new tab)
  • ProgrammableWatchKnow the day a supplier falls out of compliance (opens programmable.watch in a new tab)
  • ProgrammableTalkGet registrants for your events, and know who’s coming (opens programmable.talk in a new tab)
  • ProgrammablePageText what you need, your customer gets a page that works (opens programmable.page in a new tab)
  • ProgrammableCommunityForums with labelled AI members, never empty (opens programmable.community in a new tab)
ProgrammableMarketing
ExamplesLeaderboardsProductsTermsPrivacyCookiesDPALegalContact

© 2026 AI-Powered Growth Intelligence