AI search readiness · Website builders and CMSs
Blogger SEO for AI search: custom robots.txt, sitemap and schema
Blogger generates a robots.txt and an XML sitemap for every blog. You can replace robots.txt in Settings under Crawlers and indexing, which is also how you handle AI crawlers, since Blogger has no AI-specific switch. You cannot upload arbitrary files, so llms.txt is not an option. Structured data comes from your theme, and you can add JSON-LD through Edit HTML.
- Edit robots.txt
- YesGenerated by default. Replace it in Settings > Crawlers and indexing > Enable custom robots.txt; the text you enter is served instead of the default.
- XML sitemap
- YesGenerated automatically and listed in the default robots.txt. A separate sitemap-pages.xml covers static pages.
/sitemap.xml - llms.txt
- NoBlogger has no way to upload files to the blog root, and /llms.txt returns 404 on Blogger-hosted blogs.
- AI crawlers
- No AI-specific setting documented. To block or allow AI crawlers, write named user-agent groups in the custom robots.txt field.
- Structured data
- Theme-dependent. Blogger's own blog (on a Blogger theme) outputs schema.org microdata for Blog, BlogPosting and Person. Add JSON-LD by editing the theme HTML.
Blogger robots.txt: the default and the custom field
Every Blogger blog serves a generated robots.txt. On Blogger's own blog the live file is:
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Disallow: /share-widget
Allow: /
Sitemap: https://blogger.googleblog.com/sitemap.xml
/search covers label and search result pages, which keeps thin archive pages out of crawlers' way. To replace the file:
- In Blogger, open Settings.
- Scroll to Crawlers and indexing.
- Turn on Enable custom robots.txt, then click Custom robots.txt and paste your rules.
Blogger's help describes this text as used instead of the default robots.txt. That is the main mistake people make: a custom file that omits Disallow: /search or the Sitemap: line silently drops them. Start from the default above, swap in your own address, and add only what you need. Check the result with the robots.txt checker.
Blogger sitemap and Search Console
Blogger builds the XML sitemap for you at /sitemap.xml (posts) and /sitemap-pages.xml (static pages). There is nothing to install. Under Settings > Crawlers and indexing, the Google Search Console item links the blog to Search Console, where you can submit the sitemap and watch indexing. Also confirm that Privacy > Visible to search engines is on; if it is off, nothing else here matters.
AI crawlers and llms.txt
Blogger has no AI crawler toggle. The custom robots.txt field is the control. For example, to keep GPTBot out of model training while still letting OAI-SearchBot surface your posts in ChatGPT search, add a User-agent: GPTBot group with Disallow: / and leave the * group as it is. Google-Extended works the same way for Gemini training.
llms.txt is not possible on Blogger. You cannot upload files to the blog root, and /llms.txt returns a 404 on Blogger-hosted blogs.
Structured data on Blogger
Schema output depends on the theme. Blogger's own blog marks up the page with schema.org microdata for Blog, BlogPosting and Person, and no JSON-LD. To add JSON-LD, such as Organization details for your brand, go to Theme, open More under "My theme", choose Edit HTML, paste a script type="application/ld+json" block inside the head, and click Save. Copy your theme's HTML somewhere safe first. For each post, also fill in Search description (enable it under Settings > Meta tags) so search and AI answers have a clean summary to quote.
Check your Blogger site
Paste your domain to see which AI crawlers your live robots.txt lets in.
robots.txt checker
Test your robots.txt against every AI crawler
robots.txt generator
# robots.txt generated with https://www.getpicked.app/tools/robots-txt-checker
# Preset: Allow AI search, block training
User-agent: *
Allow: /
# Model training crawlers
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Meta-ExternalAgent
User-agent: Amazonbot
User-agent: CCBot
User-agent: Bytespider
Disallow: /
Questions
- Where is the Blogger sitemap?
- At /sitemap.xml on your blog address, for example yourblog.blogspot.com/sitemap.xml. Blogger also serves /sitemap-pages.xml for static pages, and the default robots.txt already points to /sitemap.xml. Submit it in Google Search Console after linking the blog under Settings, Crawlers and indexing.
- Should I enable custom robots.txt on Blogger?
- Only if you need a rule the default lacks, such as blocking a specific AI crawler. Whatever you type replaces the whole default file, so copy the default lines (including the Sitemap line) into your custom version first.
- Can I add llms.txt to a Blogger blog?
- No. Blogger does not let you place files at the root of your blog, and /llms.txt returns a 404. If llms.txt matters to you, it needs a platform where you control the file system.
- How do I stop one Blogger post from being indexed?
- Turn on Settings, Crawlers and indexing, Enable custom robots header tags. Then open the post, find Custom robots tags in the post settings and switch on No index.
Other website builders and cmss
Related
Sources
Checked against these pages on 2026-10-19. Operators change their crawlers; check the source before relying on a detail.