I would get some of
3M's Specialty Adhesive Remover. It comes in a spray can or in a 1L metal can. IF you have a MATOS autobody supply shop near you... you can also buy it there. 3M's Specialty Adhesive Remover is made just for removing this sort of stuff that is left over when a badge or door trim piece comes off.
http://www.griotsgarage.com/product/...do?from=Search
or...
http://www.amazon.com/3M-38984-Speci...hesive+Remover
Btw... I don't think you are the first 1M to have its badge stolen. I seem to remember a thread last year where a one month old 1M had its badge pried off with a screw driver and he had to have the trunk lid repainted.