But Federer has a special affinity for the sport through his South African heritage. The 33-year-old revealed his fond memories of the 1995 World Cup, which South Africa won on home soil amid huge emotion and President Nelson Mandela famously wore a number six Springbok jersey before the final against New Zealand.
"It was a big, big moment in sports for everybody, more so for the people in South Africa," said Federer. "I think it was wonderful how [Mandela] brought the country together [at that time]. It was an amazing moment."
Federer says he is a rugby fan but has struggled to see many of the quadrennial showpiece tournaments due to his tennis career.
"With rugby, for some reason I don't see it enough," said Federer. "It's a great sport [but] honestly I don't see it very often, I don't know why. I don't know where we are in the world when it's happening, why I keep missing it. "
The 17-time grand slam champion tries to follow other codes as much as possible.
"I see cricket frequently," said Federer. "When we go to the States we follow the American sports over there ... I went to an Arsenal [football] game last year," he said.
"But I've never been to a rugby game. Never been to Formula One [either]."