Mobile app version of topseosmo.com
Login or Join
Courtney195

 query : Redirecting robots.txt when moving to a new domain I'm moving a site to a new domain, to a local tld. I already redirected everything successfully to the new domain, except the robots.txt. My

@Courtney195

Posted in: #Indexing #Redirects #RobotsTxt #Seo

I'm moving a site to a new domain, to a local tld. I already redirected everything successfully to the new domain, except the robots.txt. My question would be that is it needed to redirect the olddomain.com/robots.txt to newdomain.com/robots.txt with 301 redirect? Is there any common practice for this situation?

10.02% popularity Vote Up Vote Down


Report

Login to follow query

More posts by @Courtney195

2 Comments

Sorted by latest first Latest Oldest Best

 

@Odierno851

This is really interesting question, It took me few minutes to search official statement from gary tweet..

When Google see 404/30X status, then Google will ignore your robots.txt completely. It is like not having a robots.txt at all.

But if Google see 50X status or server side errors, then Google will stop crawling your site, because may be you're busy to configure your server.

So do not redirect your robots.txt or if you do then make sure you've block same thing in new site robots.txt

10% popularity Vote Up Vote Down


Report

 

@Margaret670

The robots.txt on the old domain is now useless cause it helps google crawling the current domain website.

So if you correctly redirect olddomain.com/* to newdomain.com/*
The robots.txt will be forwared to, and you should put approriate rules in your new robots.txt (change the content if you also change the cms or url format ...)

hope it helps ...

10% popularity Vote Up Vote Down


Report

Back to top | Use Dark Theme