"Milk" was the fifth and final single taken from Garbage's 1995 platinum debut album Garbage.

Garbage collaborated with UK trip-hop artist Tricky on a new single remix of "Milk" in Chicago and New York in May 1996. After initial reports that the band and collaborator were unhappy with results, Garbage re-worked the track at Smart Studios and released the remix as a single.