The country music star was seated between Minaj and Carey when Minaj was taped screaming expletives at Carey and calling the Grammy Award winner "your highness."
Urban joked to "Extra" he tried to be "Switzerland" during the highly publicized incident, adding the dust-up didn't make him sorry he had joined the judges' panel, which also includes "Idol" veteran Randy Jackson.
"I love it, I gotta say," Urban said. "I love working with passionate people. I love artists. Everyone just sort of expressing themselves. It's a very alive and very invigorating work environment. A lot of passion."