"I would like to thank the adult on my left," quipped Finn while accepting the ARIA alongside Kelly and he also worried aloud about the sharp-ended trophy.
"Has anyone died with an Aria award? They are so dangerous later in the night, when everyone has been drinking."
Among other Kiwi nominees was Shihad in the Best Heavy Metal Hard Rock Album Category who went away empty handed.
Frequent Herald contributor Graham Reid was in attendance at the ARIAs, an event he described on his Elsewhere blog "as one of the most bizarre media events of my life" and " ludicrously long".
The big winner of the night was Sia, the notoriously shy pop star from Adelaide who won four gongs for Best Pop Release, Best Video, Best Female Artist and the biggest award of the night - Album of the Year for 1000 Forms of Fear.
The singer didn't make an appearance at the ceremony in Sydney on Wednesday night. However, she did draft in her BFF, superstar Katy Perry, to accept the award on her behalf.
Another no-show on the night was Iggy Azalea, who won the ARIA for Best Breakthrough Artist. She had her Fancy collaborator Charli XCX accept the award.
"I'm going to drop it off to her and she's going to enjoy it," Charli XCX said.
Proving they weren't too big to show their hometown they still cared, Sydney boys 5 Seconds of Summer were there to open the ceremony with their hit song She Looks So Perfect, which earned them the publicly voted ARIA for Song Of The Year.
"Every single Australian has been behind our band and we're just from Sydney and we can't believe what's happened to us," Ashton Irwin said.
They weren't the only big boyband to light up the stage. Superstars One Direction performed their latest hit Steal My Girl.
They also accepted the award for Best International Artist, to whoops and cheers from the crowd - many of whom had been waiting since the early hours of Wednesday morning to catch a glimpse of the British quintet.
Band member Zayn Malik gave a shout out to their Aussie fans as they band accepted their award. "This award is for our Australian fans, this was one of the first markets we felt support in outside of the UK and we can't wait to get back out here in February," Malik said.
Electronica musician Chet Faker, who had been nominated for nine ARIAs, took home two awards on the night - Best Independent Release and Best Male artist. Faker had already won three awards he won prior to the ceremony.
The Melbourne future soul artist just seemed surprised to even be at the awards and wearing a suit.
"I make music, I don't know why I'm here in a suit. It's overwhelming," he said.
The Best Group ARIA went to Sheppard.
Music industry legend and Countdown host Molly Meldrum was given a standing ovation as he was inducted into the ARIA hall of fame.
Other talking points included Kasey Chambers' dress, it was apparently 10 years old.
It was a high night for Australian music, the only low point was when the John Butler pointed out that the organisers hadn't acknowledged the traditional owners of the land on which the event was held.
The veteran musician, who is outspoken on indigenous issues both in and out of his music, acknowledged the Eora people during his acceptance speech for Best Blues and Roots Album.
"It's a simple thing to do, it's the right thing to do, it doesn't take much," he said.
"It shouldn't be up to me, but I don't mind doing it if I have to."
WINNERS OF THE 2014 ARIA AWARDS:
ALBUM OF THE YEAR
Sia - 100 Forms of Fear (Inertia Recordings)
BEST ADULT CONTEMPORARY ALBUM
Neil Finn & Paul Kelly - Goin' Your Way (EMI)
BEST BLUES AND ROOTS ALBUM
John Butler Trio - Flesh & Blood (Jarrah Records/MGM)
BEST CHILDREN'S ALBUM
The Wiggles - Apples & Bananas (ABC Music/UMA)
BEST COMEDY RELEASE
Buddy Goode - It's A Buddy Goode Christmas (ABC Music/UMA)
BEST COUNTRY ALBUM
Kasey Chambers - Bittersweet (Essence Group)
BEST DANCE RELEASE
Peking Duck feat. Nicole Millar - High (Vicious Bitch/Universal)
BEST FEMALE ARTIST
Sia - 1000 Forms of Fear (Inertia Recordings)
BEST GROUP
Sheppard - Bombs Away (Empire of Song/Chug Music)
BEST HARD ROCK/HEAVY METAL ALBUM
DZ Deathrays - Black Rat (I Oh You/Ilusive/UMA)
BEST INDEPENDENT RELEASE
Chet Faker - Built On Glass (Future Classic)
BEST MALE ARTIST
Chet Faker - Built On Glass (Future Classic)
BEST POP RELEASE
Sia - 100 Forms of Fear (Inertia Recordings)
BEST ROCK ALBUM
Dan Sultan - Blackbird (Liberation Music)
BEST URBAN ALBUM
Hilltop Hoods - Walking Under Stars (Golden Era Records/(Island Records Australia/Universal Music Australia)
BREAKTHROUGH ARTIST
Iggy Azalea - The New Classic (Virgin/Universal Music Australia)
2014 ARIA AWARD PUBLIC VOTED NOMINEES:
BEST AUSTRALIAN LIVE ACT
Keith Urban (EMI)
BEST INTERNATIONAL ARTIST
One Direction - Midnight Memories (Syco Music)
BEST VIDEO
Sia Furler and Daniel Askil - Chandelier (Inertia Recordings)
SONG OF THE YEAR
5 Seconds of Summer - She Looks So Perfect (EMI)
