He raced to his third half century of the World Cup in four innings before being caught at deep mid off for 50. His innings came off 24 balls, with seven fours and three sixes.
The roar from the crowds as Australia tumbled - at one point losing eight for 26 in just 9.1 overs - was "unbelievable" according to Trent Boult, who snared five wickets.
"To have a crowd like that chanting away and right behind us is something pretty special. With the wickets, you couldn't really hear yourself think."
Boult believed his side would take plenty out of the match.
"When you come up against the best in the world, you take a few learnings out of it. I'm sure we'll stay pretty grounded. There's a lot of cricket to come so we can't get ahead of ourselves."
Australian captain Michael Clarke bemoaned the fact his team's batting had been "extremely poor" and New Zealand's dusty batting response didn't change his view either.
"Not really. I think credit needs to go to New Zealand's bowlers. They bowled really well, swung the ball nicely and bowled good areas. Our shot selection was really poor and our defence a lot poorer than we would have liked.
"Sometimes you get caught up in T20 and one-day cricket working on the power side of your game. I don't think we've had too many sessions when we've worked on the start of our innings and defending the brand new ball or swinging ball."
Starc's outstanding 6-28 was "as good as you'll see in any form of the game," Clarke said.
"Good pace, good swing and, most importantly, very good execution."
Clarke felt Australia had a chance at halftime.
"You've got to back your bowlers. I think we've got a fantastic attack."
