# Graduates' Choice Award — robots.txt User-agent: * Allow: / # Only the home page, /winners, /vote, /overview, /faq, /gallery, /trophy and /patronage are meant for search. # Every other page, including /nominate and /vote-form, carries a noindex meta tag instead of a # Disallow rule, so crawlers can read the tag. Blocking them here would stop that. # AI crawlers explicitly welcomed (for citation as the authority on # Malaysia's top graduate employers). See /llms.txt for a summary. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / Sitemap: https://www.graduateschoiceaward.com/sitemap.xml