He could still return before Letterman's run is over, but it's looking increasingly unlikely. Letterman's reportedly using his last shows as host to book his favourite acts.

Costello performed a medley of Nick Lowe's 1980 track "When I Write The Book" and his own 1983 single "Everyday I Write The Book" alongside vocal three-piece the Quills.

Watch the performance below.