Need to quickly remove a solid color from an image within Publisher? Use the "Set Transparent Color" tool.
With an image selected, click on the Picture Tools Format tab and select "Recolor." Choose "Set Transparent Color" from the option and then click on the solid color of your image. Image shown below.
Tip: for non-solid color backgrounds, use Photoshop (tip link here).