“Only one thing remained reachable, close and secure amid all losses: language. Yes, language. In spite of everything, it remained secure against loss.”

Source: Handle with Care

Lecture X, "Conversion, concluded"
1900s, The Varieties of Religious Experience (1902)
Context: The characteristics of the affective experience which, to avoid ambiguity, should, I think, be called the state of assurance rather than the faith-state, can be easily enumerated, though it is probably difficult to realize their intensity, unless one has been through the experience one's self.
The central one is the loss of all the worry, the sense that all is ultimately well with one, the peace, the harmony, the willingness to be, even though the outer conditions should remain the same. The certainty of God's 'grace,' of 'justification,' 'salvation,' is an objective belief that usually accompanies the change in Christians; but this may be entirely lacking and yet the affective peace remain the same — you will recollect the case of the Oxford graduate: and many might be given where the assurance of personal salvation was only a later result. A passion of willingness, of acquiescence, of admiration, is the glowing centre of this state of mind.
The second feature is the sense of perceiving truths not known before. The mysteries of life become lucid, as Professor Leuba says; and often, nay usually, the solution is more or less unutterable in words. But these more intellectual phenomena may be postponed until we treat of mysticism.
A third peculiarity of the assurance state is the objective change which the world often appears to undergo. 'An appearance of newness beautifies every object,' the precise opposite of that other sort of newness, that dreadful unreality and strangeness in the appearance of the world, which is experienced by melancholy patients, and of which you may recall my relating some examples. This sense of clean and beautiful newness within and without one is one of the commonest entries in conversion records.

Modern Women Poets (2005)

Source: Man’s Search for Himself (1953), p. 56

Authority and persuasion in philosophy (1985)

St. 3.
Ode Recited at the Harvard Commemoration http://www.readbookonline.net/readOnLine/1169/ (July 21, 1865)
Context: The little that we do
Is but half-nobly true;
With our laborious hiving
What men call treasure, and the gods call dross,
Life seems a jest of Fate's contriving,
Only secure in every one's conniving,
A long account of nothings paid with loss.

July 1968, of the Lennebergwald (Lenneberg Forest), Mainz, Germany.
Attributed

Though this has been quoted extensively as if it were a statement of Wittgenstein, it was apparently first published in A Brief History of Time (1988) by Stephen Hawking, p. 175, where it is presented in quotation marks and thus easily interpreted to be a quotation, but could conceivably be Hawking paraphrasing or giving his own particular summation of Wittgenstein's ideas, as there seem to be no published sources of such a statement prior to this one. The full remark by Hawking reads:
: Philosophers reduced the scope of their inquiries so much that Wittgenstein, the most famous philosopher of this century, said, “The sole remaining task for philosophy is the analysis of language.” What a comedown from the great tradition of philosophy from Aristotle to Kant!
Disputed

On the Heights of Despair (1934)