Turned out, that if I use this --namespace argument when launching the controller_spawner, the gazebo_ros_control plugin is launched in that namespace and you can launch several of them this way.
  <node name="controller_spawner" pkg="controller_manager" type="spawner" respawn="false"