Standard and Poor's has also warned of a credit ratings downgrade for Malaysia if it fails to tighten its public finances.
Analysts hailed the government's move to implement aggressive fiscal reforms.
"This will translate into a positive message to investors, which is a major policy change that they have been waiting for," said Wan Suhaimi Saidie, economist with Kenanga Investment Bank.
Opposition lawmakers, however, said the government has consistently overspent its budget for the past 15 years and the move to cut subsidies and raise tax revenue wasn't match by tightening its purse strings.
"The subsidy cuts aren't going toward reducing our debt or deficit, instead it is just providing more funds for the government to go shopping," said lawmaker Tony Pua. "The 2014 Budget paints an obvious picture of a government failing to reform despite a brave goods and services tax proposal."
Najib said the government plans to spend 264.2 billion ringgit ($84 billion) next year, of which 82 percent is for operating expenditure and the rest for development.
He said the economy is expected to strengthen to between 5 and 5.5 percent growth in 2014, up from 4.5-5 percent this year. With rising revenue, he said the fiscal deficit is expected to narrow to 3.5 percent of GDP in 2014, from 4 percent this year, with hopes of achieving a balanced budget by 2020.
"This budget ensures that the economy expands at a strong pace, the fiscal deficit is reduced and the nation and the people continue to prosper," he said.
To sweeten the deal, Najib said cash handouts will be increased next year to 4.6 billion ringgit ($1.5 billion) to benefit 7.9 million poor people.
Under plans to raise progressive income tax scales for individual taxpayers, he said some 300,000 people will no longer have to pay taxes. At the same time, he said corporate tax will be cut by 1 percentage point to 24 percent from 2016.
The government, in an economic report released with the budget, said fuel and other subsidies will be cut by nearly 16 percent to 39.4 billion ringgit ($12.5 billion) next year.