Welsh referee Nigel Owens will take charge of the All Blacks' semifinal against England on Saturday night.
Owens will be assisted by French referees Romain Poite and Pascal Gauzere, while South Africa's Marius Jonker will be the TMO.
Jerome Garces has been named as the ref for Sunday's semi between South Africa and Wales, with Kiwi officials Ben O'Keeffe and Ben Skeen getting the nod as assistant referee and TMO respectively. Wayne Barnes is the other assistant referee.
World Rugby said that the match officials selection committee did not consider Jaco Peyper for selection this weekend.
"Peyper recognises that a picture of him with Wales fans, which appeared on social media after the Wales versus France quarter-final, was inappropriate and he has apologised," the statement said.
Owens, 47, is no stranger to the pressure of a Rugby World Cup, taking charge of the 2015 final between the All Blacks and Australia at Twickenham, and also holds the record for most Test matches refereed by a single official.
He also took charge of the All Blacks' quarter-final win over Ireland last weekend.
World Rugby Chairman Sir Bill Beaumont said: "I would like to congratulate Nigel and Jerome, the assistant referees and TMOs on their selection for the semifinals.
"These are the best of the best, supported by a superb team, and we now look forward to compelling semifinals at International Stadium Yokohama over the weekend."