The radio star, who took Louis Walsh’s spot on the judging panel last year, received much criticism from viewers and critics for his part in the show.
The announcement has now set tongues wagging on whether the Mayo man his will return to the ITV reality stalwart.
Speaking on his BBC Radio 1 breakfast show, the presenter opened up about who would possibly take his spot.
“I think it’s Louis [Tomlinson] versus Louis [Walsh],” he said.
As his band enjoys a hiatus, One Direction star Louis Tomlinson is favourite to take over the chair after appearing on the show alongside mentor Simon Cowell at Judges Houses.
However sources have insisted Simon missed the Hometown manager on last year’s X Factor.
“Louis Tomlinson is very likely to replace Grimmy. He agreed in principle to the job while assisting Simon Cowell during the Judges’ Houses round last year,” an insider told the Sun.
“But Simon remains very fond of Louis Walsh and came very close to bringing him back during last year’s live shows.
“He felt a certain something was missing on the show without him.