If Phil's Gift begins that quickly again today, and tries for another all-the-way win, it would dent Irish Whisper's chances.
Irish Whisper has had only six starts but looked the real deal when he led and trotted a sensational time at Addington back in March.
"If my fella could lead then he would be hard to beat because he is very fast. He is a top horse in the making.
"But Phil's Gift is quick off the gate and if we both go hard that first 400m then it could set the race up for a swooper."
That wouldn't be a disaster for Williamson as Springbank Sam could be sitting just off the pace. But the prospect of an early burn concerns him with race favourite Thanesan stalking the leaders.
"So a lot is going to depend on the start, it's crucial."
Irish Whisper has been one of the best backed horses at the Jewels, with a $7500 bet on him last Sunday at $4.50.
Others who have been smashed in fixed odds betting include Escapee, which attracted a $10,000 bet pre-draw while Border Control has been backed in from $13 to $5.50 in the 2-year-old Emerald.