User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: Amazonbot Disallow: /event Disallow: /calendar User-agent: * Crawl-delay: 5 Disallow: /ad/ Disallow: /event/*/contact Disallow: /event/ics Disallow: /event/join Disallow: /event/personalize_json Disallow: /event/search_json Disallow: /event/social_count Disallow: /events/dots_mark Disallow: /login Disallow: /promotion/dots_summit_2015 Disallow: /slide/tagpage_json Disallow: /user/* Sitemap: https://techplay.jp/sitemap_index.xml