###### tech.mydiv.net User-agent: Mediapartners-Google* Disallow: User-agent: Google-Site-Verification Disallow: User-agent: Adsbot-Google Disallow: User-Agent: GoogleOther Disallow: ### Disallow AI bots User-agent: ChatGPT Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bard Disallow: / User-agent: Gemini Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Anthropic Disallow: / User-agent: CCBot Disallow: / User-agent: Sogou-Test-Spider Disallow: / User-agent: OpenAI User-Agent Disallow: / User-agent: YouBot Disallow: / User-agent: OpenAI API Disallow: / User-agent: OpenAI-Rewriter Disallow: / User-agent: OpenAI-Content-Extractor Disallow: / User-agent: Amazonbot Disallow: / User-agent: AnthropicAI Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Perplexity Disallow: / User-agent: Quora-Bot Disallow: / User-agent: AIContentDetector Disallow: / User-agent: AI Writer Bot Disallow: / User-agent: AI-Copywriter Disallow: / User-agent: NeuroBot Disallow: / User-agent: CopyLeaksBot Disallow: / User-agent: WriterAI Disallow: / User-agent: AISEO-Bot Disallow: / User-agent: INK-Bot Disallow: / User-agent: ContentBot Disallow: / User-agent: Hypotenuse-Bot Disallow: / User-agent: JasperBot Disallow: / User-agent: Writesonic Disallow: / User-agent: RytrBot Disallow: / User-agent: CopyAI Disallow: / User-agent: KafkaiBot Disallow: / User-agent: ScalenutBot Disallow: / User-agent: Copymatic Disallow: / User-agent: GrowthBar-AI Disallow: / User-agent: LongShotAI Disallow: / User-agent: FraseBot Disallow: / User-agent: SurferBot Disallow: / User-agent: NeuralTextBot Disallow: / User-agent: INKForAll Disallow: / User-agent: ScalenutAI Disallow: / User-agent: ZyroBot Disallow: / User-agent: OutrankingBot Disallow: / User-agent: INK-AI Disallow: / User-agent: SimplifiedAI Disallow: / User-agent: AnywordBot Disallow: / ### Disallow SEO bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SEMrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Wotbox Disallow: / User-agent: YisouSpider Disallow: / User-agent: 360Spider Disallow: / User-agent: YandexImages Disallow: / User-agent: SeznamBot Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Sogou Orion spider Disallow: / User-agent: Exabot Disallow: / User-agent: ia_archiver Disallow: / User-agent: spbot Disallow: / User-agent: DotCrawler Disallow: / User-agent: SeobilityBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: Baiduspider-image Disallow: / User-agent: PetalBot Disallow: / User-agent: Cocolyzebot Disallow: / User-agent: MojeekBot Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: Nimbostratus-Bot Disallow: / User-agent: Crawler4j Disallow: / User-agent: LinkpadBot Disallow: / User-agent: BoardReader Favicon Fetcher Disallow: / User-agent: Domain Re-Animator Bot Disallow: / User-agent: HeadlessChrome Disallow: / User-agent: Scrapy Disallow: / User-agent: python-requests Disallow: / User-agent: Node.js Disallow: / User-agent: libwww-perl Disallow: / User-agent: axios Disallow: / User-agent: Go-http-client Disallow: / User-agent: Java/1.8.0 Disallow: / User-agent: curl Disallow: / User-agent: * Disallow: /search Disallow: /exports/ Disallow: /imgs/core/captcha/ Disallow: /gf/ Disallow: /cgi-bin/ Disallow: /clicklink Disallow: /clicksite Disallow: /commentsredir Disallow: /postinfo Disallow: /buy Disallow: /ddl Disallow: /informers Disallow: /sf Disallow: /ajax Disallow: /subsc Disallow: /comments.a Disallow: /reviews.a Disallow: /reviews.ra Disallow: /qans.stmp Disallow: /qans.addq Disallow: /qans.t0 Disallow: /qans.r Disallow: /qans.a Disallow: /addscreens Disallow: /dfile Disallow: /dlfile Disallow: /adload Disallow: /tags Disallow: /viewtags Disallow: /buylink Disallow: /collections/show. User-agent: Yandex Disallow: /search Disallow: /exports/ Disallow: /imgs/core/captcha/ Disallow: /gf/ Disallow: /cgi-bin/ Disallow: /clicklink Disallow: /clicksite Disallow: /commentsredir Disallow: /postinfo Disallow: /buy Disallow: /ddl Disallow: /informers Disallow: /sf Disallow: /ajax Disallow: /subsc Disallow: /comments.a Disallow: /reviews.a Disallow: /reviews.ra Disallow: /qans.stmp Disallow: /qans.addq Disallow: /qans.t0 Disallow: /qans.r Disallow: /qans.a Disallow: /addscreens Disallow: /dfile Disallow: /dlfile Disallow: /adload Disallow: /tags Disallow: /viewtags Disallow: /buylink Disallow: /collections/show. Clean-param: __cf_chl_tk Clean-param: __cf_chl_jschl_tk__ Clean-param: __cf_chl_captcha_tk__