AI search readiness · Website builders and CMSs
Weebly SEO for AI search: robots.txt, sitemap.xml and SEO settings
Weebly generates both robots.txt and sitemap.xml automatically. You control them indirectly: a site-wide Hide site from search engines toggle and a per-page hide option, both of which feed robots.txt. There is no field for custom rules, so you cannot target individual AI crawlers, and there is no documented way to host llms.txt.
- Edit robots.txt
- PartlyAuto-generated. You can hide the whole site or single pages from search, which updates robots.txt, but you cannot write your own rules.
- XML sitemap
- YesCreated automatically for every Weebly site; the filename is always sitemap.xml.
/sitemap.xml - llms.txt
- NoNo documented way to place an llms.txt file at the site root.
- AI crawlers
- No AI-specific setting documented. Weebly says some user agents that send excessive crawl requests are blocked on all sites, but you cannot add your own per-crawler rules.
- Structured data
- Weebly says structured data markup is included automatically on product pages. For other pages, no built-in option is documented; code can go in the header code box in the SEO settings.
How robots.txt works on Weebly
Every Weebly site has a generated robots.txt at yourdomain.com/robots.txt (or yoursite.weebly.com/robots.txt). Weebly's default is to allow search engines to index the whole site. You cannot open the file and type rules. Instead, two settings write to it:
- Whole site: in the editor, go to Settings > SEO and switch on Hide site from search engines, then republish.
- Single pages: make sure the site-wide toggle is off, go to the Pages tab, click the page, open SEO Settings, tick the box to hide the page from search engines, and publish.
Two side effects from Weebly's help: hidden pages also disappear from Weebly's own site search, and some paths are blocked on every Weebly site, such as the folder that stores Digital Item downloads and certain user agents that send excessive crawl requests.
Weebly sitemap and Search Console
Weebly creates a sitemap for every hosted site and the filename is always sitemap.xml. To submit it, verify the site in Google Search Console (the HTML tag method works: paste Google's meta tag into the header code area in Settings, save and publish), open Sitemaps and enter sitemap.xml.
While you are there, fill in the site Description under Settings > SEO, and page descriptions under Pages > Edit Page > Advanced. Weebly recommends leaving the Home page fields blank so it uses the site-level description. Publish afterwards: changes do nothing until you do.
AI crawlers and llms.txt on Weebly
Weebly has no AI crawler setting, and because you cannot add User-agent groups, you cannot treat GPTBot differently from Googlebot. Hiding a page blocks everyone. For most small sites that is fine: being readable by AI search crawlers such as OAI-SearchBot is what gets you cited. If you need fine-grained control, put a CDN with bot rules in front of your domain, or move to a platform with an editable robots.txt.
Weebly documents no way to host llms.txt at the root.
Structured data
Weebly says structured data markup is included automatically on product pages, which helps store listings get rich results. For a business site, add an Organization or LocalBusiness JSON-LD block to the header code box in Settings > SEO. Weebly's blog warns that the header and footer code boxes are meant only for HTML or JavaScript, so do not paste keywords or plain text into them.
Check your Weebly site
Paste your domain to see which AI crawlers your live robots.txt lets in.
robots.txt checker
Test your robots.txt against every AI crawler
robots.txt generator
# robots.txt generated with https://www.getpicked.app/tools/robots-txt-checker
# Preset: Allow AI search, block training
User-agent: *
Allow: /
# Model training crawlers
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Meta-ExternalAgent
User-agent: Amazonbot
User-agent: CCBot
User-agent: Bytespider
Disallow: /
Questions
- Can I edit robots.txt on Weebly?
- Not directly. Weebly generates the file. You can hide the whole site with the Hide site from search engines toggle under Settings, SEO, or hide single pages from each page's SEO Settings, and Weebly updates robots.txt to match.
- Where is my Weebly sitemap?
- Weebly creates one automatically for every site, and its filename is always sitemap.xml. Submit sitemap.xml in Google Search Console under Sitemaps after verifying the site.
- Can I block GPTBot or other AI crawlers on Weebly?
- Not with a targeted rule. The only robots.txt controls are hiding the site or individual pages, which applies to every crawler, search engines included. Hiding a page to stop AI crawlers would also remove it from Google.
- Does Weebly add structured data?
- Weebly says structured data markup is automatically included on product pages. It does not document schema for other page types, so add your own JSON-LD in the header code box if you need it.
Other website builders and cmss
Related
Sources
Checked against these pages on 2026-10-19. Operators change their crawlers; check the source before relying on a detail.