To stop undesirable articles during the lookup indexes, site owners can instruct spiders never to crawl sure files or directories throughout the common robots.txt file in the basis Listing of the domain. Moreover, a web site may be explicitly excluded from the search engine's database by utilizing a meta tag https://news.rafeeg.ae