"That's Too Bad" is the debut single by Tubeway Army, the band which provided the initial musical vehicle for Gary Numan. It was released in February 1978 by independent London record label Beggars Banquet. On the day of its release, Numan quit his job in a warehouse to become a professional musician.

Although it failed to enter the UK singles charts, "That's Too Bad" nonetheless sold relatively well, taking into account the small numbers pressed (4,000) and the lowly status of both label and artist. Numan later said, "The song was written 99% to get a contract. It was a naive attempt to make punk commercial, which it didn't do!"

The B-side of the single was "Oh! Didn't I Say". Both songs are in an aggressive punk rock style, very different from the synthesizer-based music which became Numan's trademark.

At this stage of his career Numan (born Gary Webb) had not yet found his future stage name and called himself 'Valerian'; his band mates Paul Gardiner and Jess Lidyard also used assumed names. Webb's compositional credits on the original vinyl single were under the Valerian pseudonym as well. The back of the original vinyl single's sleeve contained two discrepancies: Valerian was spelt 'Valeriun'; and the band picture featured live drummer Bob Simmonds, not Jess Lidyard ('Rael') who actually played in the recording session.

These tracks have subsequently been included on CD reissues of the album The Plan (1984).