“I will probably be too much for some people.
Those people are not My People.”
Related quotes

New York Times (2 February 1986).

“My greatest strength is the love for my people, my greatest weakness is that I love them too much.”
Interview with Sir David Frost on the BBC, 1972.
Quote, Other

“I like people too much or not at all.”

“Some people are destined to be deep thinkers. I am not one of those people.”
Source: Such a Pretty Fat: One Narcissist's Quest to Discover If Her Life Makes Her Ass Look Big, or Why Pie Is Not the Answer

Encountering Directors interview (1969)
Context: I think people talk too much; that's the truth of the matter. I do. I don't believe in words. People use too many words and usually wrongly. I am sure that in the distant future people will talk much less and in a more essential way. If people talk a lot less, they will be happier. Don't ask me why.

“Marriage is one of those things that works best when people don’t think about it too much.”
Source: Derb Quotes https://www.nationalreview.com/corner/derb-quotes-john-derbyshire/, National Review, November 20, 2003.