Add custom robots.txt field

Great little plugin! Unfortunately, it doesn’t tolerate a physical robots.txt file and doesn’t allow the manual addition of more crawlers, so in the end I took the crawler list from the plugin, pasted it into my physical robots.txt file and then deactivated the plugin again.

Of course, I would prefer it the other way round – keep the plugin active and add more entries to the virtual robots.txt manually, but that isn’t possible right now.

Icing on the cake would be full support for multisites, so you don’t have to configure each site individually, but not sure if that’s worth the hassle.