Updated Robot.txt file, how long to see changes?

Discussion in 'Blogs, Wikis, and other CMP's' started by tokyoice, May 10, 2017.

  1. tokyoice

    tokyoice Adherent

    391
    95
    +18
    Hi all.

    A site of mine has had disallow for all and I have only just realised. I've changed it all now to what it should be like in the robot.txt file.

    How long does it take for Google to update it's system to reflect the change?

    Thanks all.
     
  2. mysiteguy

    mysiteguy Habitué

    1,905
    867
    +1,244
    It depends entirely on the site. On busier sites Googlebot will fetch robots.txt many times per day, and recrawl the site when it sees the change. Less busy sites it might be once per day, or several days. Changes will be reflected in Google's Search Console (Webmaster Tools) usually within 48 hours, but it might take a couple of weeks for the recrawl to take effect in Google's search.
     
  3. tokyoice

    tokyoice Adherent

    391
    95
    +18
    Okay, great. Thanks for clearing that up!
     
Verification:
Draft saved Draft deleted