Hyrax added a dynamic robots.txt in https://github.com/samvera/hyrax/pull/7316. We should get this work into Hyku, and ensure it works with Hyku's path structure.