“There is nothing truly beautiful but that which can never be of any use whatsoever; everything useful is ugly.”

Time is an Artist (1978) Epilogue : Old is Beautiful http://taimur.sarangi.info/text/kaufmann_time.htm
Context: Of course, not everything old is beautiful, any more than everything black, or everything white, or everything young. But the notion that old means ugly is every bit as harmful as the prejudice that black is ugly. In one way it is even more pernicious.
The notion that only what is new and young is beautiful poisons our relationship to the past and to our own future. It keeps us from understanding our roots and the greatest works of our culture and other cultures. It also makes us dread what lies ahead of us and leads many to shirk reality.

Variant translations:
What we possess and what gives us strength is our joy in life, our interest in life in all its amoral facets. This is also the foundation for today's art. We do not even know the aesthetic laws.
We are not disillusioned because we have no illusions; we have never had any. What we have, and what constitutes our strength, is our joy in life, in all of its moral and amoral manifestations.
1940 - 1948, Intimate Banalities' (1941)

Source: Our Christ : The Revolt of the Mystical Genius (1921), pp. 165-166
Context: The difference between Christ and the other prophets is threefold:
1. Unlike the other prophets, he has no connection with politics and is not a people's tribune. In the Gospels, we find temporal circumstances only as background, Christ having no relationship to them at all. He kept his thoughts unmuddled by the world — "Get thee behind me, Satan!" — he was and remained truly free of the world.
2. He preaches no religious superficialities whatsoever, nothing at all of worship, nothing of God; he is truly godless.
3. Neither for earth nor heaven does he preach any coming kingdom. "But seek ye first the kingdom of God, and his righteousness; and all these things shall be added unto you" ( Mt. 6:33 http://bible.cc/matthew/6-33.htm). The kingdom, however, is nothing that is to come; it is here, it is within you ( Lk. 17:21 http://bible.cc/luke/17-21.htm). It is the Spirit of innerness as it is alive in him, the truly blessed man; it is the essence, ever being and never changing. It is also the essence of this our life, not merely an appendix granted it by some other essence, for which we would have to fulfill certain conditions.

Quoted in C.R. Leslie, Memoirs of the Life of John Constable, Composed Chiefly of His Letters (1843), (Phaidon, London, 1951), p. 280
Reply "to a lady who, looking at an engraving of a house, called it an ugly thing"
posthumous, undated

Yoga For People Who Can't Be Bothered To Do It (1993)
Context: Dave was committed to making it a truly memorable weekend in the sense that he would remember nothing whatsoever about it. “It’s all about moderation,” he said, “Everything in moderation. Even moderation itself. From this it follows that you must from time to time, have excess. And this is going to be one of those occasions.” (p. 152).

11 November
Without Dogma (1891)
Context: I love her now beyond all words; she sees it, — she reads it in my eyes, and in my whole manner towards her. When I succeed in cheering her up, or call forth her smiles, I am beside myself with delight. There is at present in my love something of the attachment of the faithful servant who loves his mistress. I often feel as if I ought to humble myself before her, as if my proper place were at her feet. She never can grow ugly, changed, or old to me. I accept everything, agree to everything, and worship her as she is.

Source: The Other America (1962), Ch. 2