Astraea published a benchmark on October 27: on six study packages, 94% of its SDTM mapping rules were judged correct, against 87% and 84% for two general-purpose coding agents, and every row cited a verified source quotation (74% and 65% for the others). None of the three SDTM pages buyers land on shows it. /platform/sdtm has no figures and no link to the demo form, and mentions specbench only as a link called "How we measure SDTM spec accuracy". The ad landing page and /landing/sdtm-automation show no figures either. The site's strongest proof sits in a blog post.
First action
Add a demo button and the 94% line to /platform/sdtm today.
How to measure it
SDTM-page demo requests
- Now
- –
- Target
- 2x the current monthly count
- By
- 60 days
Steps
Write the proof block
Three figures (94% correct, 100% cited, 2,137 rules) and one line on method and limits, linked to the full post.
Founder/CEO 2 hours
Add the demo button
"Request an SDTM demo" on /platform/sdtm above the fold and after step 5 of the workflow.
Founding Engineer 1 hour
Place the block
On /platform/sdtm, /landing/sdtm-automation, /ads/sdtm-automation and /landing/sdtm-qc, next to the call to action.
Founding Engineer 2 hours
Rename the link
Change "How we measure SDTM spec accuracy" to "94% of SDTM rules correct: see the method".
Founder/CEO 15 minutes
Check the claims
The CTO confirms each figure and the wording of the limits against the post.
Founder/CTO 1 hour
Reuse in sales
Add the block to demo follow-up emails, the pilot proposal and the conference one-pager.
Founding GTM Lead 1 day
Measure
Demo requests and click-through from the three SDTM pages, before and after.
Founding GTM Lead monthly
Why it works
Add a short proof block to /platform/sdtm, /landing/sdtm-automation and /ads/sdtm-automation: 94% of rules correct, 100% of rows with a verified citation, 2,137 rules across 116 datasets, plus a one-line note on the method and its limits (synthetic packages, model-judged). Add a "Request an SDTM demo" button to /platform/sdtm at the top and after the workflow, and change the specbench link text to the result itself. Use the same block in demo follow-up emails and pilot proposals.
Biometrics buyers are statisticians and programmers who trust measured numbers over adjectives. Every vendor in the category says "AI SDTM automation". Few show a rule-level accuracy figure with its method. Putting it next to the call to action turns curiosity into a demo request.
Ready to use
CopySDTM proof block
Measured, not claimed 94% of SDTM mapping rules judged correct across 116 datasets and 2,137 rules, against 84-87% for general-purpose coding agents. 100% of specification rows cite a verified source quotation. Method: six synthetic study packages from specbench, judged against known references. Your study still needs your own validation and review. [Request an SDTM demo] [See the method]
Risks and how to handle them
Buyers read a synthetic benchmark as a guarantee for their study
State the method and limits next to the number, as the post already does, and offer a pilot on a study with known outputs.
Naming rival tools invites disputes
Describe them as general-purpose coding agents on the product pages and leave detail to the post.
Evidence
- Your websiteBlog, "Measuring SDTM spec-writing accuracy with specbench" (October 27, 2026): on six synthetic study packages (116 datasets, 2,137 inferable mapping rules), 94% of Astraea's rules were judged correct, against 87% and 84% for two general-purpose coding agents, and 100% of Astraea's rows carried a verified quotation (74% and 65% for the others); the full benchmark has 40 packages and 15,709 rules; the post links no public specbench repository and notes the packages are synthetic and accuracy was judged by a model.Source
- Your websiteSDTM product page: title "Astraea SDTM | AI Mapping, Specifications & Datasets"; a five-step workflow and its deliverables (datasets, editable specs, programs, Define-XML, annotated CRF, reviewer's guide); no performance figures; none of its links goes to the demo form, the main actions are "Read Astraea's technical overview" and "Explore ADaM", and specbench appears only as a link, "How we measure SDTM spec accuracy".Source
- Your websitePaid landing page /ads/sdtm-automation (listed in the sitemap): H1 "SDTM mapping software. Automation you can inspect."; CTA "Request an SDTM demo"; its own form (first name, last name, work email, optional organization and "What would you like to automate?") with a note not to send patient data; no customer proof or performance figures; "Agency acceptance cannot be guaranteed."Source
- Your websiteLanding page /landing/sdtm-automation: "Source mapping is a study decision, not just a conversion."; suggests starting with one representative domain before wider deployment; CTA "Book a working session"; no quantitative claims, logos or case studies.Source