authorise les crawlers des moteurs de recherche

main^2
Lzebulon 2025-07-13 13:24:38 +02:00
parent afbbcf7ade
commit 0bfacad632
No known key found for this signature in database
GPG Key ID: D6CDAB8050CBBE7D
1 changed files with 4 additions and 0 deletions

View File

@ -66,6 +66,10 @@ let
- 46.105.102.188/32
- 2001:41d0:2:d5bc::/128
# on authorise les indexers des moteurs de recherche, liste dispo ici :
# https://github.com/TecharoHQ/anubis/blob/main/data/crawlers/_allow-good.yaml
- import: (data)/crawlers/_allow-good.yaml
- name: no-user-agent-string
action: DENY
expression: userAgent == ""