The lyrics of Heart Songs include the lines, "'Til my roommate said, 'Come on' and put a brand new record on; Had a baby on it, he was naked on it; Then I heard the chords that broke the chains I had upon me". The naked baby is a reference to the album cover art.