Libyan Prime Minister Ali Zeidan has returned to his office after being held for several hours by militiamen loosely allied to the government.