GetPicked

AI search readiness · Website builders and CMSs

Weebly SEO for AI search: robots.txt, sitemap.xml and SEO settings

Weebly generates both robots.txt and sitemap.xml automatically. You control them indirectly: a site-wide Hide site from search engines toggle and a per-page hide option, both of which feed robots.txt. There is no field for custom rules, so you cannot target individual AI crawlers, and there is no documented way to host llms.txt.

Edit robots.txt
PartlyAuto-generated. You can hide the whole site or single pages from search, which updates robots.txt, but you cannot write your own rules.
XML sitemap
YesCreated automatically for every Weebly site; the filename is always sitemap.xml. /sitemap.xml
llms.txt
NoNo documented way to place an llms.txt file at the site root.
AI crawlers
No AI-specific setting documented. Weebly says some user agents that send excessive crawl requests are blocked on all sites, but you cannot add your own per-crawler rules.
Structured data
Weebly says structured data markup is included automatically on product pages. For other pages, no built-in option is documented; code can go in the header code box in the SEO settings.

How robots.txt works on Weebly

Every Weebly site has a generated robots.txt at yourdomain.com/robots.txt (or yoursite.weebly.com/robots.txt). Weebly's default is to allow search engines to index the whole site. You cannot open the file and type rules. Instead, two settings write to it:

  • Whole site: in the editor, go to Settings > SEO and switch on Hide site from search engines, then republish.
  • Single pages: make sure the site-wide toggle is off, go to the Pages tab, click the page, open SEO Settings, tick the box to hide the page from search engines, and publish.

Two side effects from Weebly's help: hidden pages also disappear from Weebly's own site search, and some paths are blocked on every Weebly site, such as the folder that stores Digital Item downloads and certain user agents that send excessive crawl requests.

Weebly sitemap and Search Console

Weebly creates a sitemap for every hosted site and the filename is always sitemap.xml. To submit it, verify the site in Google Search Console (the HTML tag method works: paste Google's meta tag into the header code area in Settings, save and publish), open Sitemaps and enter sitemap.xml.

While you are there, fill in the site Description under Settings > SEO, and page descriptions under Pages > Edit Page > Advanced. Weebly recommends leaving the Home page fields blank so it uses the site-level description. Publish afterwards: changes do nothing until you do.

AI crawlers and llms.txt on Weebly

Weebly has no AI crawler setting, and because you cannot add User-agent groups, you cannot treat GPTBot differently from Googlebot. Hiding a page blocks everyone. For most small sites that is fine: being readable by AI search crawlers such as OAI-SearchBot is what gets you cited. If you need fine-grained control, put a CDN with bot rules in front of your domain, or move to a platform with an editable robots.txt.

Weebly documents no way to host llms.txt at the root.

Structured data

Weebly says structured data markup is included automatically on product pages, which helps store listings get rich results. For a business site, add an Organization or LocalBusiness JSON-LD block to the header code box in Settings > SEO. Weebly's blog warns that the header and footer code boxes are meant only for HTML or JavaScript, so do not paste keywords or plain text into them.

Check your Weebly site

Paste your domain to see which AI crawlers your live robots.txt lets in.

robots.txt checker

Test your robots.txt against every AI crawler

robots.txt generator

Preset
robots.txt
# robots.txt generated with https://www.getpicked.app/tools/robots-txt-checker
# Preset: Allow AI search, block training

User-agent: *
Allow: /

# Model training crawlers
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: Meta-ExternalAgent
User-agent: Amazonbot
User-agent: CCBot
User-agent: Bytespider
Disallow: /

Questions

Can I edit robots.txt on Weebly?
Not directly. Weebly generates the file. You can hide the whole site with the Hide site from search engines toggle under Settings, SEO, or hide single pages from each page's SEO Settings, and Weebly updates robots.txt to match.
Where is my Weebly sitemap?
Weebly creates one automatically for every site, and its filename is always sitemap.xml. Submit sitemap.xml in Google Search Console under Sitemaps after verifying the site.
Can I block GPTBot or other AI crawlers on Weebly?
Not with a targeted rule. The only robots.txt controls are hiding the site or individual pages, which applies to every crawler, search engines included. Hiding a page to stop AI crawlers would also remove it from Google.
Does Weebly add structured data?
Weebly says structured data markup is automatically included on product pages. It does not document schema for other page types, so add your own JSON-LD in the header code box if you need it.

Other website builders and cmss

Related

Sources

Checked against these pages on 2026-10-19. Operators change their crawlers; check the source before relying on a detail.