Remove workaround for vhost-user binding