AtlasSchemaBot

The crawler that reads websites for AtlasSchema, a structured data checker. It only visits a website when someone asks AtlasSchema to check it.

When it visits

• When the owner of an AtlasSchema account adds a website, presses Check now, or has scheduled checks turned on (every month, week or day).
• When someone uses the free check on one page. That reads one page only.

What it reads

• robots.txt first, and it follows it: the rules for AtlasSchemaBot if you name it, otherwise the rules for *.
• Your sitemaps (from robots.txt, /sitemap.xml or /wp-sitemap.xml), or the links on your home page when there is no sitemap.
• Public pages only, a few at a time, up to the number of pages the account’s plan allows per check. It never fills in forms or signs in.

It identifies itself as:

AtlasSchemaBot/1.0 (+https://atlasschema.com/bot/)

The AI crawler access check

Once per website check, AtlasSchema also asks for the home page as each AI crawler (for example GPTBot or PerplexityBot), to tell the website owner whether a firewall or CDN refuses crawlers their robots.txt allows. These requests keep the crawler’s name and add AtlasSchema-AccessCheck/1.0 to the user agent, so you can tell them apart from the real crawlers. They come from AtlasSchema’s servers, about ten requests per check. How the check works.

Blocking it

Add this to your robots.txt to keep AtlasSchemaBot out of your whole site:

User-agent: AtlasSchemaBot
Disallow: /

Website checks then find no pages to check. Questions or a problem with the crawler: contact@atlasaidev.com.