When we tested absoluteweb.com on October 20, the homepage, careers page and sitemap all returned a 403 "Just a moment..." challenge to a standard HTTP client and to an AI assistant's web-reading tool. Your robots.txt welcomes every crawler, but the firewall turns them away. A brand that asks ChatGPT, Claude or Perplexity to compare Shopify Plus agencies is likely to get answers built from Clutch and partner directories, not from your own pages, while Barrel sells "SEO/GEO" on its homepage.
First action
Ask an AI assistant to summarise your homepage and see what it says.
How to measure it
Key pages readable by assistants
- Now
- –
- Target
- 100% of top 20
- By
- 30 days
Steps
Test today
Homepage, services, case studies, sitemap from a plain client and an assistant.
SEO Lead 1 hour
Review the rule
Which Cloudflare setting challenges non-browser traffic.
Lead Developer 1 hour
Allow good bots
Verified bots and AI assistant fetchers; keep the challenge for the rest.
Lead Developer 1 day
Open the basics
robots.txt, sitemaps and a new llms.txt always reachable.
SEO Lead 1 day
Retest
Same pages from three assistants and a link-preview checker.
SEO Lead 1 day
Monitor
Monthly check and an alert when sitemaps return 403.
SEO Lead monthly
Why it works
In Cloudflare, keep the challenge for suspicious traffic but allow verified bots and the user-triggered fetchers that AI assistants use (Cloudflare's verified bot and AI crawler settings). Make sure robots.txt, sitemap_index.xml and an llms.txt are always reachable. Then retest the homepage, three service pages and a case study from an assistant and a link-preview checker, and repeat after every firewall change.
Agency shortlists are now often built in AI assistants. If they can read your own Platinum, migration and case study pages, you are described in your words, with current prices and work, instead of from 2019-era reviews.
Ready to use
ChecklistAI access check
[ ] Homepage, top service pages and a case study return 200 to verified bots [ ] robots.txt and sitemap_index.xml reachable without a challenge [ ] llms.txt published [ ] Link previews show title, description and image [ ] Three assistants describe you correctly [ ] Monthly automated check in place
Risks and how to handle them
More scraping traffic
Allow named, verified agents only and keep rate limits.
Rules change silently
Add a monthly automated check of key URLs.
Evidence
- Your websiteSite access check (October 20, 2026): every request we made to absoluteweb.com (the homepage, /careers and /sitemap_index.xml), from a standard HTTP client and from an AI assistant's web-reading tool, got HTTP 403 and a Cloudflare challenge page titled "Just a moment..." (header "cf-mitigated: challenge", with a "noindex,nofollow" robots tag). Only /robots.txt answered, and it allows all user agents apart from a few folders. /llms.txt returns 404. A website-audit tool reading the homepage saw only the challenge page, so it reported no meta description, share image or favicon.Source
- Competitor researchRivals' own homepages: Barrel, "a CPG Commerce Agency and a Shopify Platinum Partner" connecting Shopify sites to "email, SMS, SEO/GEO, marketplaces, and retail"; Solo Media Group, "A Shopify Platinum Agency Building unified commerce"; Fyresite, a "Shopify Premier Partner in Phoenix building YMM fitment, B2B, and POS"; Swanky, a Shopify Plus agency "with offices in the UK, Australia & France"; Elogic, B2B ecommerce with "ERP integrations, portals, replatforming and rescue. 200+ specialists."Source
- ReviewsClutch profile: 4.9 from 83 reviews, minimum project $10,000+, $100-$149 an hour, 50-249 employees, founded 1999, offices in Miami, Los Angeles and Lisbon; service mix 50% ecommerce development, 20% web development, 10% email marketing, 10% marketing strategy, 10% web design. The newest review shown is from April 4, 2024 (Summer Fridays); December 2023's Inner Dimension TV review credits email work with lifting newsletter open rates by about 32%. Much of the review history is from 2019-2020, before the Platinum projects.Source
- Shopify Partner DirectoryShopify lists Absolute Web as a Platinum tier partner: "Based in Miami, since 1999, Absolute Web drives digital growth by delivering custom ecommerce solutions." Starting prices: custom apps and integrations from $15,000, email marketing from $7,500, store build or redesign from $30,000, store migration from $50,000, theme customization from $7,500. Featured work: Swanson Vitamins (legacy system to Shopify Plus), Summer Fridays (ongoing growth retainer), Open Farm (headless to Shopify's native frontend, "lowering costs and speeding up releases"), Glo Skin Beauty (Magento to Shopify Plus with B2C and B2B modules), Four Sigmatic (headless to native, smart cart, performance) and Lashify (CRO, memberships, subscriptions). Languages: English and Spanish; supported locations: United States, Canada, United Kingdom, Portugal.Source