The way I do it is to remove all gazebo files from the /usr/local subdirectories (assuming that is where you installed gazebo) and the .gazebo dir in my home directory.