Floyd Mayweather Jnr has refused to agree to a $5million (£3.4m) fine should either he or Manny Pacquiao fail a drug test, according to the Filipino star's adviser.