The doctor who law enforcement is targeting in the Prince investigation abruptly left the facility where he practiced ... and no one will say why.