I've always heard it as "baffled," as have a lot of other people, according to the lyrics listings I checked on Google. But for what it's worth, Wikipedia says that these days Leonard Cohen sings the song with different sets of lyrics nearly every time he performs it, except for the last verse, so who knows what the mean, median, or mode would turn out to be. :)