I'd have thought you could set the Magic Wand's Tolerance very low - like 2 - then zoom in to make sure you're only clicking on the white bit.