But Amla exhibited superb technique and temperament against both spinners and fast bowlers after he arrived at the crease in only the third over of the day at Sheikh Zayed Stadium and showed why he is rated as the No. 1 test batsman.
"We would definitely be taking 245-3 or 4 at the end of the day, (but) stats show we tend to lose wickets up front and at the end of day's play, unfortunately we fell to that," Duminy said. "All we can do is to make sure we come tomorrow with a positive frame of mind and try to get as many runs as we can."
Amla raised his half century off 95 balls shortly after lunch with a pulled boundary to square leg off fast bowler Junaid Khan and brought up his 20th test century off 201 balls by driving Babar to long off in the last session.
"Just to see the power of concentration he (Amla) has, it's phenomenal," Duminy said. "The key now is for him to try and push on for us."
Duminy and Amla looked to have resurrected the innings with nearly a century stand before he swept Babar in the deep to trigger the collapse. Duminy hit six fours and a six and should have been caught behind on 56 but Adnan Akmal dropped a sitter off Saeed Ajmal.
Faf du Plessis was also beaten by the turn of Babar and got an edge to gully while Robin Petersen was bowled through the gap between bat and pad off the left-arm spinner's delivery that spun sharply into the left-hander.
"We've got quality spinners," Irfan said. "Although it's not turning, our spinners are getting some turn out of it and hopefully we will get more in the second innings."
Amla and A.B. de Villiers also batted cautiously in the second session for a 61-run stand after Pakistan had reduced the Proteas to 66-3 at lunch.
Pakistan struck through an unusual run out in their only success of the session when de Villiers played a defensive stroke and the ball rolled to Younis Khan in the first slip. Khan threw the ball to alert wicketkeeper Adnan Akmal, who whipped the bails off in a flash with de Villiers not dragging his backfoot fully back into the crease.
South Africa made sure they didn't allow Ajmal (1-57) much success as the offspinner's solitary wicket came late in the day when he had Vernon Philander leg before wicket.
Earlier, Irfan dismissed Alviro Petersen (3) and Smith (15) to have the South Africans reeling at 19-2. Petersen was caught at short leg and Smith returning to international cricket after ankle surgery in May was adjudged caught behind after Pakistan successfully called for a television referral against the South African captain to reverse onfield umpire Rod Tucker's original decision.
Wicketkeeper Akmal grabbed a well-judged catch when Kallis also returning to international cricket for the first time since playing in IPL in May got an inside edge off another left-arm fast bowler, Junaid Khan.
Pakistan also awarded a test cap to opening batsman Shan Masood on his 24th birthday and Babar replaced injured spinner Abdul Rehman.
South Africa, which has not lost an away test series since a defeat to Sri Lanka in 2006, thrashed Pakistan 3-0 in a test series at home in February.