User-agent: * Disallow: /*? Allow: / User-agent: ia_archiver Disallow: / Host: https://pedportal.net Sitemap: https://pedportal.net/sitemap.xml