Now that the popular period drama has reached its third series, the stars have had plenty of time to consider who is the biggest heartthrob on set.
Matt Milne and Ed Speleers are two of the youngest stars making their mark as Alfred Nugent and Jimmy Kent respectively.
They have told us that there is only one man on set who could be crowned "heartthrob".
Ed said: "Jim Carter wins. He's the only pin up in Downton Abbey.
"Every person you speak to it's Jim Carter, Jim Carter, Jim Carter. It's fair enough he is a god."
(We think he is having us on!)
Jim Carter carries on playing butler Charles Carson in the third series which has the background of the Irish Troubles and focuses on the financial difficulties of the Crawleys.