Similar to Jones' departure, Scherzinger's exit also isn't a surprise given her judging performance had been heavily criticized during The X Factor's first season -- particularly following her decision to avoid her judging responsibility and deliberately force a judging deadlock that resulted in the unintended elimination of 13-year-old contestant Rachel Crow during the competition's Top 5 results show.
However, Scherzinger -- who was originally brought on board to serve as The X Factor's co-host alongside Jones but became a judge following Cowell's decision to drop original judge Cheryl Cole midway through the first season's open auditions -- was the one who "decided not to come back," according to E! News.
"She wants to focus on her music career. She's spoken to Simon [Cowell] and he's given her his blessing," a source told E! News.
"X Factor took a lot more of her time than she ever expected," the source said. "She didn't have any time really to work on her music. She was doing X Factor six days a week."