# START TOKYO TRIP GUIDE # --------------------------- # As a condition of accessing this website, you agree to abide by # the following content signals: # (a) If a content-signal = yes, you may collect content for the # corresponding use. # (b) If a content-signal = no, you may not collect content for # the corresponding use. # (c) If the website operator does not include a content signal # for a corresponding use, the website operator neither grants nor # restricts permission via content signal with respect to the # corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results # (e.g., returning hyperlinks and short excerpts from your # website's contents). Search does not include providing # AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., # retrieval augmented generation, grounding, or other real-time # taking of content for generative AI search answers). # ai-train: training or fine-tuning AI models. # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS # RESERVATIONS OF RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION # DIRECTIVE 2019/790 ON COPYRIGHT AND RELATED RIGHTS IN THE # DIGITAL SINGLE MARKET. User-Agent: * Content-Signal: ai-train=no, search=yes, ai-input=yes Allow: / Allow: /wp-json/yoast/ Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Disallow: /wp-json/ Disallow: /?rest_route= Disallow: /wp-content/uploads/wpo/wpo-plugins-tables-list.json Disallow: /wp-content/uploads/complianz/* Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ # AI and answer-engine crawlers — explicitly welcome. # robots.txt has no inheritance: a bot named here reads ONLY this group, # so the hygiene rules are repeated rather than inherited from *. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended Allow: / Allow: /wp-json/yoast/ Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Disallow: /wp-json/ Disallow: /?rest_route= Disallow: /cdn-cgi/bm/cv/ Disallow: /cdn-cgi/challenge-platform/ # Google advertising crawlers User-agent: Mediapartners-Google Allow: / # Unwanted crawlers User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: / # Discovery # ----------------- Sitemap: https://tripguide.tokyo/sitemap_index.xml Schemamap: https://tripguide.tokyo/wp-json/yoast/v1/schema-aggregator/get-xml # Site summary for language models # LLM-Content: https://tripguide.tokyo/llms.txt # --------------------------- # END TOKYO TRIP GUIDE