Never, on the first time I listen to a song, do I hear the words. I might catch a phrase or two, and usually I comprehend a chorus (though I don't particularly like music that follows the chorus-verse pattern).
And never do lyrics make a song any worse for me; there is one exception to that...