Google: Don’t Make A Dynamically Generated robots.txt

1924 days ago via tekkiram    Discuss    Environmental
John Mueller from Google said in a Stack Exchange thread that although it is good practice to make a dynamically driven XML sitemap file, it is not good practice to make a dynamically driven robots.txt file. He said that file should probably be kept more static and updated by hand. John wrote: Making the robots.txt […]
The post Google: Don’t Make A Dynamically Generated robots.txt appeared first on Best Part Time Job.

Submit a Comment

Log in to comment or register here