Robots txt configuration (Edit config using page properties)

User-agent: *
Crawl-Delay: 1

Disallow: /search-results
Disallow: /search-results*
Disallow: /404
Disallow: /500
Disallow: /search
Disallow: /search/*
Disallow: Search.aspx
Disallow: Search?search*
Disallow: search?q=*
Disallow: admin
Disallow: admin/*
Disallow: assets/*
Disallow: /sitecore
Disallow: /sitecore/*
Disallow: /styles
Disallow: /styles/*
Disallow: /WebResource.axd
Disallow: /List.aspx
Disallow: /ll/List.aspx
Disallow: /Macintosh
Disallow: /Macintosh/*
Disallow: /en/E3D%20Microsite/E3D%20Home/
Disallow: /zh-cn/E3D%20Microsite/E3D%20Home/
Disallow: /en/LFM%20Microsite/LFM%20Home/
Disallow: /en/AVEVA%20World/Home/
Disallow: /en/Tribon-Migration/Tribon-Home/
Disallow: /en/E-mail Campaign/
Disallow: /Tracked_Content.aspx
Disallow: /CMS%20Help/*
Disallow: /en/Redesign/home/
Disallow: /zh-cn/Redesign/home/
Disallow: /fr-fr/Redesign/home/
Disallow: /de-de/Redesign/home/
Disallow: /ja-jp/Redesign/home/
Disallow: /ko-kr/Redesign/home/
Disallow: /pt-br/Redesign/home/
Disallow: /ru-ru/Redesign/home/
Disallow: /es-es/Redesign/home/
Disallow: /ko-kr/~/*/link.aspx?*

Sitemap: https://www.aveva.com/sitemap.xml