It was only recently claimed that the pair's relationship was on the rocks.
An insider shared: "Tom wants their relationship to be public, even asking Taylor to go to the Emmys with him, but Taylor wants to keep her private life private.
"Tom's need for their relationship to be so public so quickly makes her uncomfortable.
She tried to be OK with it in the beginning but fears he is in love with the idea of her and not falling in love with her for the right reasons. Taylor is an independent young woman and doesn't feel like she needs a boyfriend to make her complete."
Meanwhile, the 35-year-old actor was previously forced to deny his relationship with the 26-year-old singer was a publicity stunt.
When asked if he is annoyed by the focus on his personal life, he said: "I don't know, it comes down to being authentic. Everything you do you have to make sure you truly believe in it and as long as you know that, it doesn't matter what anyone else says about it because the nature of being a public figure is that everyone will have an opinion about anything you do, and as long as you know why you've done something and you've committed to it with authenticity then you're OK."
Hiddleston, 35, and Swift, 26, were first seen together in the middle of June, when pictures of them together on Rhode Island hit the internet.
Their relationship came just weeks after Swift broke up with her boyfriend of a year, Calvin Harris.
- Bang! Showbiz