“And this is the whole shabby secret: to some men, the sight of an achievement is a reproach, a reminder that their own lives are irrational, and that there is no loophole - no escape from reason and reality. Their resentment is the cornered Dionysian element baring its teeth.”

Sometimes paraphrased as "You can ignore reality, but you cannot ignore the consequences of ignoring reality."
The Virtue of Selfishness (1964)

Source: The Red Badge of Courage

Apollo and Dionysus (1969)

Source: Adventures of a Mathematician - Third Edition (1991), Chapter 6, Transition And Crisis, p. 120

Beware of Pity (1939)

Pg. 155.
Against Method (1975)

Context: A man's first care should be to avoid the reproaches of his own heart; his next to escape the censures of the world: if the last interferes with the former, it ought to be entirely neglected; but otherwise there cannot be a greater satisfaction to an honest mind, than to see those approbations which it gives itself seconded by the applauses of the public: a man is more sure of his conduct, when the verdict which he passes upon his own behaviour is thus warranted and confirmed by the opinion of all that know him.

On "Sir Roger", in The Spectator No. 122 (20 July 1711).

Walking Proud
Lyrics, My Story

pg 52.
Science in a Free Society (1978)