Google's John Mueller said that since the robots.txt file is cached by Google for about 24-hours, it does not make much sense ...