"Rapidly increasing house prices increase the likelihood and the potential impact of a significant fall in house prices at some point in the future," he said.
"This is particularly the case in a market that is already widely considered to be over-valued," he said.
Wheeler said house prices are high by international standards compared to household disposable income and rents.
"Household debt, at 145 per cent of household income, is also high and, despite dipping during the recession, the percentage is rising again,'' he said.
"Furthermore, the growth in house prices is occurring after only a small correction following the house price boom of 2003-2007 that saw New Zealand house prices increase more rapidly than in any other OECD country," he said.
Over the past several months the IMF, OECD, and the three major international rating agencies have pointed to the economic and financial stability risks associated with New Zealand's inflated housing market.
ASB's chief economist Nick Tuffley said the Reserve Bank was continuing to highlight the need for fundamental issues such as the shortage of land and housing to be addressed in the long-term.
"Unfortunately, the supply response of more houses will take years, and the Reserve Bank is left with restraining demand for housing/credit to meet its objective of reducing the financial system risk it perceives from the current house price momentum," Tuffley said.
The new lending restrictions would slow housing market activity over the coming months, although the effects were likely to be modest, he said.
"However, given the persistence of supply and demand imbalances we continue to expect house prices will continue to increase over the next couple of years."
Tuffley said New Zealand interest rates fell following the speech.
To see the full text of Graeme Wheeler's speech to Otago University today, click here.