In order to avoid undesirable written content while in the search indexes, website owners can instruct spiders to not crawl certain information or directories through the common robots.txt file in the foundation directory with the domain. In addition, a website page can be explicitly excluded from the search engine's database https://www.theepochtimes.com/entertainment/the-firing-squad-new-must-watch-movie-that-will-inspire-and-uplift-you-5681479