Simon Cowell reportedly may soon have to move his focus from career to family.

The 53-year-old The X Factor creator and judge is expecting a baby with Lauren Silverman, a 36-year-old New York socialite who's still technically married to Cowell's close friend Andrew Silverman, Us Weekly reported.

"She's around 10 weeks along," a source told Us.

Lauren and Andrew's marriage has reportedly been on the rocks for awhile now, and Lauren is planning to leave her estranged husband for Cowell especially in light of the alleged pregnancy news.

"Lauren and Andrew have been unhappy in their marriage for some time, and their divorce has been in the works for a while," another source told Us. "As their marriage deteriorated, she and Simon became close."

When contacted for a comment, an assistant to Cowell's U.K. representative told People, "This is a very sensitive issue and all media enquiries are being dealt with by his U.S. attorney."

Cowell previously insisted he wasn't interested in ever having kids.

"God, no. I couldn't have children. If I had them here drawing on the walls I'd go nuts," the former American Idol judge reportedly said in 2009. "With kids, you've got a routine you can't escape from. You've got to be up at a certain time. Got to listen. When all you want to do is sit in a corner thinking."

However, as of recently, Cowell seemed to open up to the idea although he mentioned it was probably too late for him to become a dad because of his age.

"Well...yes and no," the Britain's Got Talent creator and judge reportedly said when asked if he's had a change of heart regarding children.

"I do really, really like kids, because I can talk to them and listen to them. The problem has always been how much time you need to devote to bringing up kids. I've always dedicated all my life to work, and at 52, I've probably missed the opportunity."