Last night X Factor saw Freddy Parker voted out of the competition, but that wasn't what got everyone talking this weekend, it was a joke made by Simon Cowell to Xtra Factor host Rylan Clark-Neal after Saturday night's main show.

The judges were taking part in the usual Q&A on the after-show, with the joke coming about when Rylan said; "I love a front door."

To which Simon replied: "I thought you liked a back door."

Queue gasps from the audience, but never a man to be without a comeback, Rylan said back; "Oh Simon! Shall I show you how much?"

Cowell immediately apologised after the remark saying; "I shouldn’t have said that – sorry, sorry, sorry. This is why I should never do live TV."

Later, Rylan took to Twitter to address the backlash Simon was getting, saying "it was a joke between friends."