He could still return before Letterman's run is over, but it's looking increasingly unlikely. Letterman's reportedly using his last shows as host to book his favourite acts.
Costello performed a medley of Nick Lowe's 1980 track "When I Write The Book" and his own 1983 single "Everyday I Write The Book" alongside vocal three-piece the Quills.
Watch the performance below.