With a a nod to Mariano, Kuntz consulting looks at uninstalling GP 2010 the hard way.
Issues with GP2010 and uninstalling
Install, Upgrade & AdminGP 2010
Archived post from 2010. Dynamics GP and the links it points to have changed since; check current documentation before relying on version-specific steps.