France has always had a martial ambience, celebrating its great wartime leaders and victories through monuments.
So Mr Key pulled out that arsenal, sneakily bringing up the looming centenary celebrations for World War I.
That brought with it a reminder of New Zealand's war effort on French soil and the roots of the historic relationship between New Zealand and France, despite the warts that have popped up from time to time.
In terms of the Security Council bid, despite saying that New Zealand would not be influenced by the bid in its approach to Syria, Mr Key clearly decided a bit of flattery goes a long way.
So he congratulated Mr Hollande for his strong stance on Syria.
France and the United States were in favour of a missile strike even without a UN mandate, which could still be on the cards if Syria does not go through with a proposal to hand over its chemical weapons. Mr Key also came out with the right words when the issue of New Caledonia's referendum on independence was raised, saying it was up to France to decide what to do although the Pacific Islands Forum was considering whether to admit it as a member state.
As for the wine, one of President Hollande's austerity measures after he was elected in 2012 was to hock off the contents of the wine cellar in the Elysee Palace. He may be regretting it now. The French papers this week carried polls showing Mr Hollande was the least popular of any French president since polling began.
Mr Key was as diplomatic about that as he was about the gift - saying it would be inappropriate for him to give advice to Mr Hollande on popularity, and pointing to the difficulties most European leaders faced in implementing potentially unpopular austerity measures.
All that bad news for Mr Hollande, and nothing to drown his sorrows with.