“This is not what I thought physics was about when I started out: I learned that the idea is to explain nature in terms of clearly understood mathematical laws; but perhaps comparisons are the best we can hope for.”

The Evolution of the Physicist's Picture of Nature (1963)
Context: It seems to be one of the fundamental features of nature that fundamental physical laws are described in terms of a mathematical theory of great beauty and power, needing quite a high standard of mathematics for one to understand it. You may wonder: Why is nature constructed along these lines? One can only answer that our present knowledge seems to show that nature is so constructed. We simply have to accept it. One could perhaps describe the situation by saying that God is a mathematician of a very high order, and He used very advanced mathematics in constructing the universe. Our feeble attempts at mathematics enable us to understand a bit of the universe, and as we proceed to develop higher and higher mathematics we can hope to understand the universe better.

"Epistemology as information theory: From Leibniz to Omega." https://arxiv.org/abs/math/0506552 arXiv preprint math/0506552 (2005). p. 3

The Evolution of the Physicist's Picture of Nature (1963)
Context: Just by studying mathematics we can hope to make a guess at the kind of mathematics that will come into the physics of the future. A good many people are working on the mathematical basis of quantum theory, trying to understand the theory better and to make it more powerful and more beautiful. If someone can hit on the right lines along which to make this development, it may lead to a future advance in which people will first discover the equations and then, after examining them, gradually learn how to apply them.

Elements de la géométrie de l'infini (1727) as quoted by Amir R. Alexander, Geometrical Landscapes: The Voyages of Discovery and the Transformation of Mathematical Practice (2002) citing Michael S. Mahoney, "Infinitesimals and Transcendent Relations: The Mathematics of Motion in the Late Seventeenth Century" in Reappraisals of the Scientific Revolution, ed. David C. Lindberg, Robert S. Westman (1990)

The earliest published source found on google books that attributes this to Euclid is A Mathematical Journey by Stanley Gudder (1994), p. xv http://books.google.com/books?id=UiOxd2-lfGsC&q=%22mathematical+thoughts%22+euclid#search_anchor. However, many earlier works attribute it to Johannes Kepler, the earliest located being in the piece "The Mathematics of Elementary Chemistry" by Principal J. McIntosh of Fowler Union High School in California, which appeared in School Science and Mathematics, Volume VII ( 1907 http://books.google.com/books?id=kAEUAAAAIAAJ&pg=PR3#v=onepage&q&f=false), p. 383 http://books.google.com/books?id=kAEUAAAAIAAJ&pg=PA383#v=onepage&q&f=false. Neither this nor any other source located gives a source in Kepler's writings, however, and in an earlier source, the 1888 Notes and Queries, Vol V., it is attributed on p. 165 http://books.google.com/books?id=0qYXAQAAMAAJ&pg=PA165#v=onepage&q&f=false to Plato. It could possibly be a paraphrase of either or both of the following to comments in Kepler's 1618 book Harmonices Mundi (The Harmony of the World)': "Geometry is one and eternal shining in the mind of God" and "Since geometry is co-eternal with the divine mind before the birth of things, God himself served as his own model in creating the world".
Misattributed

Attributed to Kepler in some sources (though more recent sources often attribute it to Euclid), such as Mathematically Speaking: A Dictionary of Quotations edited by Carl C. Gaither and Alma E. Cavazos-Gaither (1998), p. 214 http://books.google.com/books?id=4abygoxLdwQC&lpg=PP1&pg=PA214#v=onepage&q&f=false. The earliest publication located that attributes the quote to Kepler is the piece "The Mathematics of Elementary Chemistry" by Principal J. McIntosh of Fowler Union High School in California, which appeared in School Science and Mathematics, Volume VII ( 1907 http://books.google.com/books?id=kAEUAAAAIAAJ&pg=PR3#v=onepage&q&f=false), p. 383 http://books.google.com/books?id=kAEUAAAAIAAJ&pg=PA383#v=onepage&q&f=false. Neither this nor any other source located gives a source in Kepler's writings, however, and in an earlier source, the 1888 Notes and Queries, Vol V., it is attributed on p. 165 http://books.google.com/books?id=0qYXAQAAMAAJ&pg=PA165#v=onepage&q&f=false to Plato. Expressions that relate geometry to the divine "mind of God" include comments in the Harmonices Mundi, e.g., "Geometry is one and eternal shining in the mind of God", and "Since geometry is co-eternal with the divine mind before the birth of things, God himself served as his own model in creating the world".
Disputed quotes

Source: Infinite in All Directions (1988), Ch. 3 : Manchester and Athens
Context: Fifty years ago Kurt Gödel... proved that the world of pure mathematics is inexhaustible. … I hope that the notion of a final statement of the laws of physics will prove as illusory as the notion of a formal decision process for all mathematics. If it should turn out that the whole of physical reality can be described by a finite set of equations, I would be disappointed, I would feel that the Creator had been uncharacteristically lacking in imagination.

Source: Who Is Man? (1965), Ch. 5

as quoted by Claudia Dreyfus in: [January 21, 2021, A Prodigy Who Cracked Open the Cosmos (an interview with Franck Wilczek), Quanta Magazine, https://www.quantamagazine.org/frank-wilczek-cracked-open-the-cosmos-20210112/]