I used to hate guitar solos. But something happened to my musical psyche a few years ago, and now I love 'em...
+1 on Sympathy For the Devil.
Some of Glenn Tilbrook's solos during Squeeze's heyday were pretty amazing, in the economical, hummable school. In Quintessence, Another Nail In My Heart, Black Coffee In Bed all come to mind.
Rikki Don't Lose That Number (I don't even know who played it... Jeff Baxter? Denny Dias?) Ever since I was a kid and that was all over AM radio I just loved that solo. While we're on the topic of Steely Dan (I can sense Larry Crane's ire rising...) the electric sitar solo on Do It Again is pretty great.
Obvious, garage-y faves: Louie, Louie by the Kingsmen, You Really Got Me by the Kinks.
The solo on Charlie Chesterman's "Question Mark", played by Andy Pastore, always slays me. And I was there. The band had never played the song before (Charlie showed it to them in the studio) and the take that got used was the first one (later ones were more accurate but didn't have the manic energy), with Andy whipping this solo off live, as part of basic tracks. It's here:
http://www.charliechesterman.com/mp3/questionmark.mp3
While we're on the topic of extemporaneous solos, I always dug David Gilmore's on "Another Brick In The Wall", apparently played as a level check.
Wichita Lineman. Communication Breakdown. Mama Tried. Peaches En Regalia. The Paul/George/John hoo-ha on The End. Especially the John stuff.
And finally I must recommend Neil Innes' solo on The Rutles' Hold My Hand. One of only a small number of guitar solos that are capable of actually making me laugh out loud.
-Pete
www.weissy.com
www.weisstronauts.com
www.verdantstudio.com