Try a 3M eraser wheel. It attaches to your drill. They can be purchased (about 30 bucks) at any body shop supplier and some bigger auto parts stores.
Can't hurt to try that either - cheaper than the eraser wheel...well maybe not anymore! :bigroll:If that's paint from another source try using Gasoline.