If you need to block your site from search results, use Yet another approach like password safety or noindex. If your Web content is blocked with a robots.txt file, its URL can nevertheless surface in search results, though the look for outcome will not have an outline. Graphic files, online video files, PDFs, and other non-HTML information embedde