“Peace is the best thing that man may know; peace alone is better than a thousand triumphs”

Patrick Edward Dove, Elements of Political Science. Edinburgh, 1854. p. 402

Source: Orlando: A Biography (1928), Ch. 2
Context: While fame impedes and constricts, obscurity wraps about a man like a mist; obscurity is dark, ample, and free; obscurity lets the mind take its way unimpeded. Over the obscure man is poured the merciful suffusion of darkness. None knows where he goes or comes. He may seek the truth and speak it; he alone is free; he alone is truthful, he alone is at peace.

The Last of the Mohicans (1826), Ch. 8

The Second Coming (1980)

[Swami Tapasyananda, Swami Nikhilananda, Sri Sarada Devi, the Holy Mother; Life and Conversations, 315]

1930s, Quarantine Speech (1937)
Context: Those who cherish their freedom and recognize and respect the equal right of their neighbors to be free and live in peace must work together for the triumph of law and moral principles in order that peace, justice, and confidence may prevail in the world. There must be a return to a belief in the pledged word, in the value of a signed treaty. There must be recognition of the fact that national morality is as vital as private morality.

A paraphrased variant of this seems to have arisen on the internet around 2007: It is ... a settled policy of America, that as peace is better than war, war is better than tribute. The United States, while they wish for war with no nation, will buy peace with none.
1810s
Source: Message delivered to Dey Omar Agha, by Isaac Chauncey and William Shaler , summarizing the Treaty with Algiers (1815) http://avalon.law.yale.edu/19th_century/bar1815t.asp, and U.S attitudes and actions in the Barbary Wars, in refusing to pay ransom or tribute to pirates of the Barbary States, as quoted in History and Present Condition of Tripoli: With Some Accounts of the Other Barbary States http://books.google.com/books?id=YMwRAAAAYAAJ&pg=PA46 (1835) by Robert Greenhow, p. 46