"I made a machine, so when my mum came home from work at night, when she pulled the door it would pull a string which was attached to a tape player that would play a recorded message from me saying, 'Welcome home, mum'. Things like that," he says.
In his early 20s he started getting obsessed with the Rube Goldberg Machine, a contraption that carries out a simple task in a complex way.
"My flatmates and I started building this thing in the living room and after a while they lost interest but I kept going and going and after seven months I ended up with this thing going around the whole apartment."
He filmed it, put it up on YouTube, and after it went viral he started to realise that perhaps he could make a living out of his childhood hobby.
His most popular invention so far has been The Page Turner which has clocked up 7.5 million views on YouTube and was the reason he got invited on to Sesame Street.
The episode screened overseas in February and while he was beamed into millions of households around the world it hasn't resulted in more work and a run on commissions just yet.
Not that he minds. He's just happy to have Sesame Street on his CV because in the future he has plans for a kids' TV show of his own.
"I'm only just realising how much kids feel inspired by watching kinetic art. It's a really good demonstration of creativity in its true sense because you're taking something like a cup and saying, 'This isn't just a cup. What else is it?', which means kids are using their imagination. I think it's a great way to teach them creativity."
His current project is The Dresser, his most ambitious machine yet which helps him get dressed, including ironing his clothes, shining his shoes and putting on a tie. He hopes to take it on tour as a live performance piece later this year.
• Joseph Herscher is on Sesame Street, 2pm today, on Four.