“I am not bound to win, but I am bound to be true. I am not bound to succeed, but I am bound to live up to the light I have. I must stand with anybody that stands right — stand with him while he is right and part with him when he goes wrong.”

"The Monitions of the Unseen", p. 31.
The Monitions of the Unseen (1871)

Redhead alias Yorke's Case (1795), 25 How. St. Tr. 1083.

The last sentence is from the 16 October 1854 Peoria speech, slightly paraphrased. No known contemporary source for the rest. It first appears, attributed to Lincoln, in US religious/inspirational journals in 1907-8, such as p123, Friends Intelligencer: a religious and family journal, Volume 65, Issue 8 (1908)
Misattributed

1910s, Address at Milwaukee, Wisconsin (1912)
Context: I am all right — I am a little sore. Anybody has a right to be sore with a bullet in him. You would find that if I was in battle now I would be leading my men just the same. Just the same way I am going to make this speech.

F 73
Aphorisms (1765-1799), Notebook F (1776-1779)

.
1900s
Context: Everyone is free to write and say whatever he likes, without any restrictions. But every voluntary association (including the party) is also free to expel members who use the name of the party to advocate anti-party views. Freedom of speech and the press must be complete. But then freedom of association must be complete too. I am bound to accord you, in the name of free speech, the full right to shout, lie and write to your heart’s content. But you are bound to grant me, in the name of freedom of association, the right to enter into, or withdraw from, association with people advocating this or that view. The party is a voluntary association, which would inevitably break up, first ideologically and then physically, if it did not cleanse itself of people advocating anti-party views.

A Christmas Sermon (1890)