Factual error: When Richard Collier follows Elise into the restaurant all the men are wearing hats. Their hats would have been checked at the door.
Character mistake: According to her biography found in the library, Elise was born November 11, 1885, but William Robinson tells Richard that he met Elise when she was 16 years old, in March, 1903, at which time she would have been 17.
Answer: He was no longer able to put everything out of his mind, which was a requirement to successfully time-travel. He was distraught and unable to focus enough mentally. He stopped eating, and as time went on he became weaker and weaker.