This breaks certain apps that uses /RPC2 such as transdroid.
Possible solution includes moving the .scgi_local somewhere else or changing the group owner for /home/rtorrent.
Currently I'm just using setfacl to give www-data access to that one socket file.