Experienced seamer Chris Martin got the breakthrough when Philander slashed a catch to gully. Jacques Rudolph added six before he perished after flashing a drive to Trent Boult,
Morne Morkel helped the cause with a couple of drives down the ground before Imran Tahir was the last man dismissed, run out for 10.
New Zealand's reply got off to a poor start with Rob Nicol netting just six runs in his maiden test innings, and Martin Guptill played on in the first over after lunch.
Brendon McCullum and Ross Taylor, who was celebrating his 28th birthday, batted quite nicely. Taylor (44) stroked some memorable drives and McCullum (48) was starting to warm to his work with a couple of lovely shots down the ground.
It was a rush of blood which brought about McCullum's demise. He tried to sweep Tahir against the spin and got a top edge.
You did not need to read lips to work out what McCullum said next.
Taylor was just as disappointed with the shot which caused his downfall.
He hit two glorious drives then edged a cut shot he was in no position to play.
Daniel Vettori slapped and swatted his way to 46 from 78 deliveries before bailing out of a pull shot and spooning a catch to back to the bowler Jacques Kallis, and Kruger van Wyk made a useful debut with 36.