US President Donald Trump has said his younger brother is having a "tough time" as he visited him in a New York City hospital.