Stanislaw Ulam (1909–1984) Polish-American mathematician
Attributed in Paul Hoffman, The Man Who Loved Only Numbers: The Story of Paul Erdős and the Search for Mathematical Truth (1998)
This has also been attributed, with variants, to Paul Erdős, who repeated the remark.