Add robots.txt
Recently we got visited by duckduckbot
│52.204.97.54 - - [04/May/2020:22:10:26 +0200] "GET /users/new_user/ HTTP/1.1" 200 3914 "-" "'Mozilla/5.0 (compatible; DuckDuckBot-Https/1.1; https://duckduckgo.com/duckduckbot)'"
But I guess we don't want it to index this page. It would be nice to have a proper robots.txt
. See here for how to do it.