Not really. He could be a miserable bastard at times but all the sources agree he was very open minded and willing to accept the evidence of his eyes and honest arguments, condemning colonist atrocities against natives despite have quite a lot prejudice against them himself, freeing his own slaves, petitioning for abolition in Congress, etc.

He'd look around, say, "Well it seems to have worked out, where's the whorehouses?"

No. His great failing was championing the concept of time-based workdays instead of task-based. Ie, most people left work when everything was done before he got involved.