It was alleged on September 24 last year Rangitoheriri was in allegedly in possession of a shotgun without a lawful, proper or sufficient purpose.
He was also jointly charged with receiving two shotguns that had earlier been stolen. The charge sheet stated the accused received the guns from "persons unknown".
But on reviewing the case at the end of last week, police found it did not stack up and therefore offered no evidence.
Judge Mina Wharepouri dismissed the charges.
However, Rangitoheriri had admitted two counts of driving while disqualified.
He has been convicted "at least twice previously" for similar driving offences, according to court documents.
Rangitoheriri will be sentenced in August.
Moko died on August 10 last year after suffering months of violent abuse at the hands of his caregivers.
The 3-year-old was left in the care of his mother's friend, Tania Shailer, and her partner, David Haerewa, for two months while his mother was in Auckland with another of her children at Starship Hospital.
While Moko was in the care of the couple they subjected him to abuse including stomping, hitting, kicking and biting.
On August 6 last year they inflicted horrific injuries on the little boy and left him for four days before calling 111.
When he was admitted to hospital on August 10 he had facial swelling, internal bleeding, septic shock from his leaking bowel and swelling of the brain. He died hours later.
Shailer and Haerewa were initially charged with murder but later pleaded guilty to manslaughter.
