Bjorn told the Guardian: "Personally I didn't pay attention to all that – it didn't mean s*** to me, even if they hated us.
"Because we got so much response from the whole world. Right from the start, we had contemporary colleagues, musicians, who liked what we were doing."
Benny also admitted that he couldn't fathom how perceptions of the group have changed so much over the years.
Reflecting on the changing views of critics, he said: "It's difficult to fathom, you know, I really don't get it."
ABBA have recently returned to the spotlight with their long-awaited new album, Voyage.
And Bjorn revealed they didn't seek too many outside influences when they were making the record.
Speaking about the current landscape of the music industry, he shared:
"We decided early on that we're not going to look at anything else.
"We're just going to do the songs, the best songs we can right now. That meant writing lyrics I could get some of my thoughts of these past 40 years into, and add some kind of depth that, hopefully, comes with age and that makes it different from the lyrics I wrote 40 years ago."