User-agent: * User-Agent: Googlebot Disallow: /wp-admin Disallow: /redirect.php Disallow: /users/register Disallow: */embed Disallow: */wlwmanifest.xml Disallow: /xmlrpc.php Disallow: *utm*= Disallow: *openstat= User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: /