Nemcio/Grav
1
0
Fork 0
mirror of https://github.com/getgrav/grav.git synced 2025-10-26 07:56:07 +01:00
Code Issues Packages Projects Releases Activity
4,121 Commits 6 Branches 310 Tags
636bc97d29376928c45678a11bbf684b64e5aab5
Commit Graph

2 Commits

Author SHA1 Message Date
Ben Lee
268714863e Prevent crawling of unnecessary directories 
Prevent search engines from crawling and indexing unnecessary files and directories. The "/user/plugins/" directory may need to be added to the Allow list if plugins use frontend accessible assets. This is tested at a basic level using Google Fetch and Render.
 2015-11-20 19:33:24 -07:00
Andy Miller
d32ec013dd Added a default all-access robots.txt 2014-12-22 10:51:10 -07:00