You Can Leave Your Heels On

After the huge breakthrough success of The Stranger in 1977, Joel decided to go in a different direction with his follow-up LP. Named after the street in midtown Manhattan that used to be littered with jazz clubs, 52nd Street is a jazzy album full of horns. Side two kicks off with "Stiletto," the tale of a man infatuated with a poisonous woman whose sharp shoes begin to seem like a knife. "You've been slashed in the face," Joel sings. "You've been left there to bleed/You want to run away/But you know you're gonna stay." He played it a ton in the 1980s and on his 2006 tour it came out nearly every night, but he hasn't performed it a single time since 2009.