Billy Joel launched into his classic “New York State of Mind” during Friday’s performance at NYC’s Madison Square Garden, but fans were in for a special surprise.

After singing the first verse, the Piano Man was joined by Kevin Spacey, with the “House of Cars” star striding onstage to join in, taking on the second verse without missing a beat.

RELATED: Watch: Jimmy Fallon & Billy Joel Cover Rolling Stones’ “Beast Of Burden”

Spacey and Joel continued to trade verses, with Spacey pausing at one point to take a selfie of the two, which he later shared on Twitter.

Check out this fan-shot footage of the unforgettable duet:

Joel — who is performing monthly at Madison Square Gardens until August — also offered a special tribute to guitarist J. Geils, who passed away this week, performing a cover of The J. Geils Band’s “Centerfold”. Watch: