"And for the people who do want to take a chance to make it a bit different, special, and add some of their personality to it, there just aren't options out there that cater to something really different like that.
"Which is not to say that this is going to be anarchic and disrespectful of the whole tradition of the day, but what appeals to me is really having fun with the day and making it really special and memorable for them in a way that not many people can."
Mr Potter said the project, which he describes as a "ridiculous kitschy Vegas wedding chapel" will provide a "left of field" option for couples.
"The last thing I want to do is to not take marriage seriously.
"There are plenty of people out there who do rocking jobs of being just a good old-fashioned regular day-to-day celebrant, so there's no need for me to jump into that market.
"But if somebody wants something really different and really fun and playful but still respectful then I'm your guy."
Mr Potter hopes that if enough people support the $8500 project, which is being crowdfunded online, he will have the chapel built and "ready to go" by early December.
"I'm really committed to making it happen. I really just want to get it going. I'm pretty impatient when it comes to getting good stuff out into the world."
He said that his main target audience for the project is Wairarapa, Wellington and other areas in the lower North Island.
Visit www.vinylburns.com for more information and to watch a video about the "Vinyl Burns" Vegas Wedding Chapel.