“The fact is, when we are born, we are neither theists nor atheists, but ignoro-theists.”

Source: One Minute Nonsense (1992), p. 21
Context: "Tell me," said the atheist, "Is there a God — really?"
Said the master, "If you want me to be perfectly honest with you, I will not answer."
Later the disciples demanded to know why he had not answered.
"Because the question is unanswerable," said the Master.
"So you are an atheist?"
"Certainly not. The atheist makes the mistake of denying that of which nothing may be said... and the theist makes the mistake of affirming it.

Meaning of Life interview (2008)
Context: Well, God answers of course come in every flavor imaginable these days so God can be process-God can be mind-God … so there are all of these ways that God is now configured as well as the ones that come to us from traditional religions where God has much more power — then there's the whole personal God part which I do talk about in there at some point. So I don't think that even that there is a God framework out there at this point that I am either accepting or rejecting. My response is that I call myself a non-theist as opposed to an atheist because as I see an atheist as having a belief about God, i. e. that there isn't one. And my I've never been actually very interested in the question I guess is one way to put it. I see it as a question That can be summarized in the aphorism "Why is there anything at all rather than nothing." And science doesn't have any answer to That so what I articulated in the book and continued to do is what I call a covenant with mystery where mystery is itself a … noun but I am using it as literally in absence of category. It's not like I have a mystery then I put attributions onto it it just … I don't know the answers.

1880s, Agnosticism (1889)
Context: When I reached intellectual maturity and began to ask myself whether I was an atheist, a theist, or a pantheist; a materialist or an idealist; Christian or a freethinker; I found that the more I learned and reflected, the less ready was the answer; until, at last, I came to the conclusion that I had neither art nor part with any of these denominations, except the last. The one thing in which most of these good people were agreed was the one thing in which I differed from them. They were quite sure they had attained a certain "gnosis," — had, more or less successfully, solved the problem of existence; while I was quite sure I had not, and had a pretty strong conviction that the problem was insoluble.
So I took thought, and invented what I conceived to be the appropriate title of "agnostic." It came into my head as suggestively antithetic to the "gnostic" of Church history, who professed to know so much about the very things of which I was ignorant. To my great satisfaction the term took.

Thoughts and Aphorisms (1913), Jnana

Preface (p. xv; the quote is from Alice in Wonderland)
Irreligion: A Mathematician Explains Why the Arguments for God Just Don’t Add Up (2008)

Letter http://www.darwinproject.ac.uk/letter/entry-12041 to John Fordyce, 7 May 1879
Other letters, notebooks, journal articles, recollected statements

Mont Saint Michel and Chartres (1904)
Context: p>Where, then,— in what mysterious cave outside of creation — could Man, and his free-will, and his private world of responsibilities and duties, lie hidden? Unless Man was a free agent in a world of his own beyond constraint, the Church was a fraud, and it helped little to add that the State was another. If God was the sole and immediate cause and support of everything in his creation, God was also the cause of its defects, and could not,— being Justice and Goodness in essence,—hold Man responsible for his own omissions. Still less could the State or Church do it in his name.Whatever truth lies in the charge that the schools discussed futile questions by faulty methods, one cannot decently deny that in this case the question was practical and the method vital. Theist or atheist, monist or anarchist must all admit that society and science are equally interested with theology in deciding whether the Universe is one or many, a harmony or a discord. The Church and State asserted that it was a harmony, and that they were its representatives. They say so still. Their claim led to singular but unavoidable conclusions, with which society has struggled for seven hundred years, and is still struggling.</p