The future of data analysis. Annals of Mathematical Statistics 33 (1), (1962), page 13.
Variant: "An approximate answer to the right question is worth a great deal more than a precise answer to the wrong question." "as the renowned statistician John Tukey once reportedly said," according to Super Freakonomics page 224.
“Progress in science is often built on wrong theories that are later corrected. It is better to be wrong than to be vague.”
The Scientist As Rebel (2006)
Help us to complete the source, original and additional information
Freeman Dyson 90
theoretical physicist and mathematician 1923Related quotes

“It is surely better to be wronged than to do wrong.”
In Memory Yet Green (1979), p. 175
General sources
Herman E. Daly and Joshua Farley, in Ecological Economics: Principles and Applications. (2003), page 234. quoted in Beyond GDP Measuring progress, true wealth, and the well-being of nations http://ec.europa.eu/environment/beyond_gdp/key_quotes_en.html, European Commission:Environment

“Better to assume the worst and be wrong than assume the best and be wrong.”
Source: Obsidian Butterfly

33 min 20 sec
Source: Cosmos: A Personal Voyage (1990 Update), Heaven and Hell [Episode 4]
Context: There are many hypotheses in science that are wrong. That's perfectly alright; it's the aperture to finding out what's right. Science is a self-correcting process. To be accepted, new ideas must survive the most rigorous standards of evidence and scrutiny.
Context: There are many hypotheses in science that are wrong. That's perfectly alright; it's the aperture to finding out what's right. Science is a self-correcting process. To be accepted, new ideas must survive the most rigorous standards of evidence and scrutiny. The worst aspect of the Velikovsky affair is not that many of his ideas were wrong or silly or in gross contradiction to the facts; rather, the worst aspect is that some scientists attempted to suppress Velikovsky's ideas. The suppression of uncomfortable ideas may be common in religion or in politics, but it is not the path to knowledge and there is no place for it in the endeavor of science. We do not know beforehand where fundamental insights will arise from about our mysterious and lovely solar system, and the history of our study of the solar system shows clearly that accepted and conventional ideas are often wrong and that fundamental insights can arise from the most unexpected sources.

“It is better to suffer, than to do, wrong.”
The Sayings of the Wise (1555), p. 164

"The Nearest Star" (1989) (reprinted in The Secret of the Universe (1992), p. 82)
General sources

“There are few people who are more often wrong than those who cannot suffer being wrong.”
Il n'y a point de gens qui aient plus souvent tort que ceux qui ne peuvent souffrir d'en avoir.
Maxim 386.
Reflections; or Sentences and Moral Maxims (1665–1678)