# Website > Public crawling and discovery guidance for this website. ## Important resources - [Homepage](https://mehakescort.com/) - [XML sitemap](https://mehakescort.com/sitemap.xml) - [Robots rules](https://mehakescort.com/robots.txt) - [About](https://mehakescort.com/about-us/) - [Help and information](https://mehakescort.com/help-info/) - [Terms and conditions](https://mehakescort.com/terms-and-conditions/) - [Privacy policy](https://mehakescort.com/privacy-policy/) ## URL structure Canonical public city pages use a single path segment below the main domain. The XML sitemap is the preferred source for discovering canonical public URLs. ## Crawling guidance Use canonical URLs and the XML sitemap for discovery. Respect robots.txt directives. Do not crawl private account, administration, installer, configuration, or internal tool paths. Avoid duplicate parameterized URLs when a canonical public URL is available.