# Explicit allow rules for social media crawlers. Some hosts' WAFs will # only let these bots through when robots.txt names them explicitly, # even though "User-agent: *" technically covers them. User-agent: facebookexternalhit Allow: / User-agent: facebookcatalog Allow: / User-agent: meta-externalagent Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / User-agent: Slackbot-LinkExpanding Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / User-agent: TelegramBot Allow: / User-agent: Applebot Allow: / User-agent: * Allow: / Sitemap: https://transcrito.app/sitemap.php