Meanwhile, Simon, 55, disaproves of former member Zayn Malik's twitter battles and thinks he needs to keep "quiet".
He said: "I don't like this Twitter stuff, you are always going to regret what you say on Twitter. With Zayn I just think he needs to get a sense of perspective back in his life, which is that he had a really great opportunity, he decided for whatever reason he didn't want to do it anymore so maybe just keep quiet for a while, make a great record and enjoy life.
He continued: "I haven't spoken to him recently. Once the decision was made that he was going to leave the group we always said we would never have him compete with them.
Speaking at the launch of this year's X Factor show in London, he added: "I was nervous for the lads because they were in the middle of a tour when it happened, I thought it was a bombshell. What was amazing was how they stuck together as a four, no complaining and just got on with it. When you see them in their latest music video or on tour now, you kind of think, 'OK, I miss Zayn but they are still amazing together'."
- Bang! Showbiz