“Education is what survives when what has been learned has been forgotten.”

Context: I don't think the issue's about being against gay marriage. It's about being for traditional marriage and articulating the reason that's important. You have to have a basic family structure. There's never been a civilization that has rewritten what marriage and family means and survived. So there is a sense in which, you know, it's one thing to say if people want to live a different way, that's their business. But when you want to redefine what family means or what marriage means, then that's an issue that should require some serious and significant debate in the public square.

Einstein did write this quote in "On Education" from 1936, which appeared in Out of My Later Years, but it was not his own original quip, he attributed it to an unnamed "wit".
Very popular in French: "La culture est ce qui reste lorsque l’on a tout oublié" (Culture is that which remains, if one has forgotten everything). Attributed in French to Édouard Herriot (1872-1957) and, in English, sometimes to Ortega y Gasset. Another French variant is "la culture est ce qui reste lorsqu'on a oublié toutes les choses apprises" (Culture is that which remains if one has forgotten everything one has learned), which appears in the 1912 book Propos Critiques by Georges Duhamel, p. 14 http://books.google.com/books?id=Xpk_AAAAIAAJ&q=%22la+culture+est+ce+qui+reste+lorsqu%27on+a+oubli%C3%A9+toutes+les+choses+apprises%22#search_anchor. And another English variant is "Culture is that which remains with a man when he has forgotten all he has learned" which appears in The Living Age: Volume 335 from 1929, p. 159 http://books.google.com/books?id=tHFRAAAAYAAJ&q=%22Culture+is+that+which+remains+with+a+man+when+he+has+forgotten+all+he+has+learned%22#search_anchor, where it is attributed to "Edouard Herriot, French Minister of Education". Another English variant is "Education is that which remains behind when all we have learned at school is forgotten", which appears in The Education Outlook, vol. 60 p. 532 http://books.google.com/books?id=dNcgAQAAMAAJ&pg=RA1-PA532#v=onepage&q=%22education%20is%20that%20which%20remains%22&f=false (from an issue dated 2 December 1907), where it is attributed to Ralph Waldo Emerson.
The saying is found in an 1891 article by Swedish writer Ellen Key https://en.wikipedia.org/wiki/Ellen_Key, "Själamorden i skolorna", which was published in the journal "Verdandi", no. 2, pages 86-98 (the saying is on p. 97). The same article was republished later as a chapter in her 1900 book "Barnets Århundrade". Here is the quote in Swedish ( p. 160 https://archive.org/stream/barnetsrhundrade02ellenkey#page/n167/mode/2up): Men bildning är lyckligtvis icke blott kunskap om fakta, utan enligt en ypperlig paradox: »det, som är kvar, sedan vi glömt allt, vad vi lärt». Here it is from the 1909 English translation of the book ( p. 231 https://archive.org/stream/centurychild00frangoog#page/n246/mode/2up): "But education happily is not simply the knowledge of facts, it is, as an admirable paradox has put it, what is left over after we have forgotten all we have learnt." From the way Ellen Key puts it, she doesn’t take credit for the saying, but rather refers to it as an already known “paradox” that she explicitly puts between quotation marks.
Misattributed

Source: Sceptical Essays

2007

Source: On Writing Well (Fifth Edition, orig. pub. 1976), Chapter 6, Words, p. 36.

Tragedy and the Common Man (1949)
Context: Only the passive, only those who accept their lot without active retaliation, are "flawless." Most of us are in that category.
But there are among us today, as there always have been, those who act against the scheme of things that degrades them, and in the process of action everything we have accepted out of fear of insensitivity or ignorance is shaken before us and examined, and from this total onslaught by an individual against the seemingly stable cosmos surrounding us — from this total examination of the "unchangeable" environment — comes the terror and the fear that is classically associated with tragedy. More important, from this total questioning of what has previously been unquestioned, we learn.

Source: Media Control: The Spectacular Achievements of Propaganda

Speaking at the Oxford Union, December 2, 1920; quoted in Beverley Nichols 25: Being a Young Man's Candid Recollections of his Elders and Betters (London, 1926), ch. 7, p. 69.
Sometimes said to have been the first usage of this now ubiquitous cliché, though in fact the phrase university of life had been in use for many years. Some early instances:
"The disciplined minds that go from [their university's] walls will be its jewels…It will worthily introduce them to the University of Life." ~ The New Englander and Yale Review (February 1853), p. 70.
"The late Professor Greenleaf…who, not born to affluence, and not bred up to scholarly studies, achieved an honorable scholarship in the university of life". ~ Cornelius Conway Felton An Address Delivered before the Association of the Alumni of Harvard College, July 20, 1854 (Cambridge, Mass., 1854), p. 7.
"But God be thanked…for the university of life where we may acquire, at the same time that we put in practice, the rules which are to fit us for, and conduct us through the eternities." Elizabeth D. Livermore Zoë (Cincinnati, 1855), p. 14.
"When our men go into the great university of life…there are few, indeed, who have practical reason to regret that so many years were spent in the severe but salutary discipline imposed by the University of Dublin." ~ The Dublin University Magazine (April 1858), p. 419.

Source: Memory: A contribution to experimental psychology, 1885, p. 8