Minor Thoughts from me to you

For years I've repeated the following story about Thomas Jefferson. Now I've finally seen the source. I see that I had a few of the details wrong, but had the basic gist right.

"In a few moments after our arrival, a tall, high-boned man came into the room. He was dressed, or rather undressed, in an old brown coat, red waistcoat, old corduroy small-clothes [breeches] much soiled, woollen hose, and slippers without heels. I thought him a servant, when General Varnum surprised me by announcing that it was the President." --Thomas Jefferson receiving guests at the White House, from the Life of William Plumer.