# BEGIN FILE ### # # allow-all # DR # # The use of robots or other automated means to access the KB Direct site # without the express permission of KB Direct is strictly prohibited. # Notwithstanding the foregoing, KB Direct may permit automated access to # access certain KB Direct pages but soley for the limited purpose of # including content in publicly available search engines. Any other # use of robots or failure to obey the robots exclusion standards set # forth at is strictly # prohibited. # # v1_August_2020 ### DIRECTIVES ### User-agent: * Allow: / User-agent: Yeti Allow: / User-agent: bingbot Allow: / User-agent: Slurp Allow: / User-agent: EtaoSpider Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru/ Disallow: / User-agent: MegaIndex.com/2.0 Disallow: / User-agent: MegaIndex.com/ Disallow: / User-agent: +https://www.megaindex.ru/ Disallow: / User-agent: +http://megaindex.com/crawler Disallow: / User-agent: +http://megaindex.com/ Disallow: / User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/?tab=linkAnalyze) Disallow: / User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://www.megaindex.com/?tab=linkAnalyze) Disallow: / User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +https://www.megaindex.ru/) Disallow: / User-agent: Mozilla/5.0 (compatible; MegaIndex.ru/2.0; +http://www.megaindex.com/) Disallow: / User-agent: AdsBot-Google allow: / User-agent: AdsBot-AdIdxBot Disallow: / Sitemap: https://www.direct.kbcarinsure.co.kr/sitemap.xml ### END FILE ###