[FEATURE] Add robots.txt
This will improve performance as currently bots are fetching contents from /changes which contains JSON data of patches, diffs as files and archives which are generated on the fly, really nothing of relevance to search engines.
assets/etc/robots.txt
0 → 100644
Please register or sign in to comment