"I've Been the One" originally featured on Little Feat's self-titled debut album that dropped in 1971.
Callahan takes the lead on vocals for this cover, while Bonnie "Prince" Billy contributes backing vocals.
As well as covering Little Feat, Callahan and Oldham have shared their versions of Steely Dan's "Deacon Blues", Billie Eilish's "Wish You Were Gay" with The High Llamas’ Sean O’Hagan. Other covers by Callahan and Oldham include their version of Yusuf/Cat Stevens' "Blackness of the Night" with AZITA, and a cover of Hank Williams Jr.'s "O.D.'d in Denver" featuring Matt Sweeney.