It looks like Khloe Kardashian is out on "X Factor." The New York Post is claiming that she will not be invited back, but partner Mario Lopez will return as the show's main host.