fedora-ansible/roles/pagure
Kevin Fenzi 4a3da58a9e pagure: drop Bytespider crawler
This crawler is hitting pagure.io really hard.
Sent it a 403 and block in robots.txt

Signed-off-by: Kevin Fenzi <kevin@scrye.com>
2024-05-01 12:19:43 -07:00
..
files pagure: fix pagure_mirror.service 2022-05-23 10:43:29 -07:00
handlers pagure: drop the frontend sub-directory 2020-10-01 16:14:06 +02:00
tasks [Pagure] Enable safe directories for production 2023-09-21 17:19:38 +02:00
templates pagure: drop Bytespider crawler 2024-05-01 12:19:43 -07:00