It's only been back a few weeks but already it seems that X Factor is in trouble ratings wise despite the rake of changes Simon Cowell brought to the show this year, including new hosts and two new judges.

The show is down one million viewers compared to what it was this time last year, with the weekend's ratings showing the show hit 7.55 million. This is a slight increase from previous weeks this year but it's thought that is because Strictly Come Dancing hasn't kicked off properly yet.

The slump in ratings could be due to fans reactions to new judges Rita Ora and Nick Grimshaw, with social media users labeling the former Voice UK mentor Rita Sn-ora while the hashtag #bringbackLouis was trending last week.

Cowell is said to have called Louis Walsh recently too to seek his help with the series which has only added fuel to the rumours that Walsh may return. Cowell did after all axe Cheryl just a few weeks into the The X Factor USA series, could Grimshaw meet a similar fate?

A source has told The Mirror that Cowell has given the judges and presenters two weeks to shape up saying; "Strictly has so far trounced The X Factor in the war for viewers. While it’s off air for a two week break, bosses know this is their chance to boost popularity for X Factor. So they’re keen to ensure all eyes are on the X Factor when Strictly returns. It’s a total image haul, they all want to impress."

Nick has trimmed that big hair of his while Cheryl is planning to get her sexiest frocks out, even Caroline Flack is on a seven day detox. So it seems they are all doing what they can to look absolutely spiffing for the live shows, although don't think anyone's looks were ever the problem.... just bring back Louis already Simon.

You can catch The X Factor exclusively on TV3.