"Pontius Pilate’s Home Movies" will feature on their Continue as a Guest album with previous singles "Angelcover" and "Really Really Light".

A.C. Newman says, "Lyrically, it is very much a stream-of-consciousness story about the disease of social media and online culture. The narrator that only likes art when it changes the subject, buried in daydream, thinking it’s an entrance, and the idea of Pontius Pilate entertaining his friends with home movies of the crucifixion (what else would he be showing? That part’s clear, right?). It was a product of being stuck at home at a time when online was the only way for many to communicate, and obviously it had its negatives. One of those songs that might seem like word salad but is not, its disjointed nature very deliberate."

Newman started work on Continue as a Guest at his Woodstock, New York home after the band's 2019 tour in support of In the Morse Code of Brake Lights, and spent a year writing and recording the 10-track album. It's produced by Newman, and features bandmates Neko Case, Kathryn Calder, John Collins, Todd Fancey and Joe Seiders, as well as contributions from saxophonist Zach Djanikian and a song co-written by Sadie Dupuis (Speedy Ortiz, Sad13).