Charlie Brown's Dad, Charles Schulz, saw the problem and recognized the danger 40 years ago.
And back when he was in the Army, he said, "I see nothing."
Only sometimes. Such a sometimes as to place such people in a small minority.
Now then: noting some members of a group are objectionable, and then mistreating the rest of that group on those grounds, is naked prejudice, and practiced only by the slow of mind.
The less justification that you give the Left, the wiser you are. Perhaps less than nice about it, but wiser.