Elvis Costello embarked on a small, intimate tour with his longtime pianist Steve Nieve in the spring of 1996 to promote All This Useless Beauty. All of the shows from the five-date tour were recorded, and highlights from each show were issued on a series of promotional EPs that were later released commercially as the box set Costello & Nieve. Stripped down to their basics, the songs from All This Useless Beauty sit elegantly next to Costello classics, as well as several lesser-known gems from his rich back catalog. The performances are all understatedly passionate, and rank among the best that Costello has given, making Costello & Nieve five discs that any hardcore fan will treasure.

Track List CD1 - Los Angeles: Live At The Troubadour:

01. Temptation 03:49
02. Poor Fractured Atlas 04:58
03. I Just Don't Know What to Do With Myself (Burt Bacharach / Hal David) 03:27
04. It's Time 05:59
05. Man Out of Time 04:54
06. Shallow Grave (Paul McCartney / Elvis Costello) 02:55

Track List CD2 - San Francisco: Live At The Fillmore:

01. Just About Glad 03:59
02. Why Can't a Man Stand Alone? 04:10
03. My Dark Life 07:13
04. All This Useless Beauty 05:59
05. Ship of Fools (Jerome J. Garcia / Robert C. Hunter) 06:12

Track List CD3 - Chicago: Live At The Park West:

01. The Long Honeymoon 04:24
02. Starting to Come to Me 02:47
03. The Other End of the Telescope (Elvis Costello / Aimee Mann) 04:32
04. All the Rage 04:03
05. Watching the Detectives 06:09

Track List CD4 - Boston: Live At The Paradise:

01. You Bowed Down 04:54
02. The Long Honeymoon 04:46
03. Distorted Angel 04:45
04. The Angel Want to Wear My Red Shoes 02:50
05. Little Atoms 05:39
06. My Funny Valentine (Lorenz Hart / Richard Rodgers) 03:01

Track List CD5 - New York: Live At The Supper Club:

01. Black Sails in the Sunset 03:17
02. You'll Never Be a Man 03:16
03. Just a Memory 03:44
04. I Want to Vanish 03:22
05. Medley:
◊ Alison (Elvis Costello)
◊ Living a Little, Laughing a Little (Tom Bell / Linda Creed)
◊ Tracks of My Tears (Marvin Tarplin / Warren Moore / William Robinson, Jr.)
◊ Tears of a Clown (William Robinson, Jr. / Stevie Wonder / Henry Cosby)
◊ No More Tearstained Makeup (William Robinson, Jr.)
◊ Clowntime Is Over (Elvis Costello) 06:16