diff options
| author | David T. Sadler <davidtsadler@googlemail.com> | 2021-05-21 18:59:36 +0100 |
|---|---|---|
| committer | David T. Sadler <davidtsadler@googlemail.com> | 2021-05-21 18:59:36 +0100 |
| commit | b1a6600a3a331506195eb3c7e52858718efdbc8a (patch) | |
| tree | 63939c31b12172fef061176bb67cb29f57dd127b /www/robots.txt | |
| parent | 0b9acaf9eb8ba65595fe2762abfa79b0cd636acf (diff) | |
Add robots.txt
Diffstat (limited to 'www/robots.txt')
| -rw-r--r-- | www/robots.txt | 5 |
1 files changed, 5 insertions, 0 deletions
diff --git a/www/robots.txt b/www/robots.txt new file mode 100644 index 0000000..d0e5f1b --- /dev/null +++ b/www/robots.txt @@ -0,0 +1,5 @@ +# www.robotstxt.org/ + +# Allow crawling of all content +User-agent: * +Disallow: |