Edit robots.txt
Set follow, unfollow and other robots.txt options for the website.
More about robots.txt