mirror of
https://github.com/getgrav/grav.git
synced 2025-10-26 07:56:07 +01:00
268714863e
Prevent search engines from crawling and indexing unnecessary files and directories. The "/user/plugins/" directory may need to be added to the Allow list if plugins use frontend accessible assets. This is tested at a basic level using Google Fetch and Render.
12 lines
197 B
Plaintext
12 lines
197 B
Plaintext
User-agent: *
|
|
Disallow: /backup/
|
|
Disallow: /bin/
|
|
Disallow: /cache/
|
|
Disallow: /grav/
|
|
Disallow: /logs/
|
|
Disallow: /system/
|
|
Disallow: /vendor/
|
|
Disallow: /user/
|
|
Allow: /user/pages/
|
|
Allow: /user/themes/
|