Local police, who did not think the men's stunt was nearly as funny as they thought it was, detained the men and fined them 22,500 tenge, or $100, each for minor hooliganism.
Borat, the socially inept, racist, Pamela Anderson-obsessed newsreader portrayed by Cohen in the film, did not go down well in Kazakhstan upon its release.
The film, which had the extended title of Borat: Cultural Learnings of America for Make Benefit Glorious Nation of Kazakhstan, caused a huge amount of offence, with Kazakh people furious their country had been portrayed as backward and degenerate.
But the country's Foreign Minister Yerzhan Kazykhanov later conceded the controversial film did wonders to boost tourism to the little-known Central Asian nation.
"With the release of this film, the number of visas issued by Kazakhstan grew tenfold," local news agencies quoted Mr Kazykhanov as telling a session of Parliament in 2012.
"I am grateful to Borat for helping attract tourists to Kazakhstan."