Dave Jarvis' Repositories

git clone https://repo.autonoma.ca/repo/keenwrite.git
keenwrite / Commits / b47cce9

Disallow robots in downloads

AuthorDaveJarvis <email>
Date2023-11-12 11:58:12 GMT-0800
Commitb47cce96323540ba345416cc486aeb56c74ccef3
Parent86aa81c
Delta4 lines added, 0 lines removed, 4-line increase
www/robots.txt
user-agent: Googlebot
disallow: /repository/*
+disallow: /downloads/*
user-agent: Bingbot
disallow: /repository/*
+disallow: /downloads/*
user-agent: YandexBot
disallow: /repository/*
+disallow: /downloads/*
user-agent: MicrosoftBot
disallow: /repository/*
+disallow: /downloads/*