Files
niumalll/website/robots.txt

12 lines
173 B
Plaintext
Raw Normal View History

User-agent: *
Allow: /
Disallow: /api/
Disallow: /private/
Sitemap: https://www.niumall.com/sitemap.xml
# Host
Host: https://www.niumall.com
# Crawl-delay
Crawl-delay: 10