With only one album under her belt, there's good reason why New Zealanders would question Frost's ability to critique up-and-coming stars.
But it's clear that beneath Frost's sweet demeanour, she's a feisty battler - in 2009 she won MTV's 42Unheard competition and she beat a bunch of her musical peers at two auditions for the coveted spot on the panel.
Though Frost may not be dishing out nasty comments left, right and centre, as the first of the episodes last Sunday and Monday revealed, she's not afraid to speak her mind.
"I try to say whatever comes into my head first and to not think about it or filter it too much. I want to be honest. People can smell a rat from a mile away."
Frost says she's been blown away by the level of talent on the show and believes they will find a real star who can cut it on the international stage.
"I was worried that it would be just another singing competition, but it was really obvious from the start that we were looking for people with that real spark," she says.
"I am genuinely excited about the talent and the diversity of the talent."
The X Factor is on TV3 on Sunday at 7pm and Monday at 7.30pm.