A Robots.txt file is applied mostly to handle crawler visitors to your site, and usually to maintain a file off Google, depending upon the file style: robots.txt impact on different file types If you are building the file manually, then you might want to concentrate on the guidelines Employed in https://seotoolstube.com/