The answer is there are better sources of fat. "There is ample evidence that fat from nuts, seeds, oily fish, avocado and olive oil are cardioprotective, heart-healthy fats" says Dave Monro, the Heart Foundation's Food and Nutrition Manager.
So when they are compared with dairy fat and dairy foods, the heart-healthy sources of fat are a better choice, particularly if you consume a lot of dairy.
"However if you're following a really heart-healthy way of eating, and your diet is relatively low in saturated fat, or dairy only makes up a small part of your diet, then the type of milk, cheese or yoghurt - whether it's full fat or low fat - is probably of less importance," says Monro.
It's this bigger picture the foundation prefers to emphasise. Healthy ways of eating are more important than one particular food. The best way of eating for heart health emphasises vegetables and fruit, with unrefined grains, legumes and, if eaten, non-processed lean meats, poultry and oily fish, as well as reduced-fat dairy.
"Milk, cheese and yoghurt are great nutrient-dense foods," says Monro. "But for most people, there are far more important areas to focus on for a healthy diet, rather than focusing specifically on dairy.
"Things like increasing their intake of vegetables and fruit and cutting down on processed foods, rather than worrying too much about whether they are having trim milk or full-fat milk."
In other words: when we concentrate on good healthy foods, the nutrients tend to take care of themselves.
Niki Bezzant is editor-at-large of Healthy Food Guide