Just because it was used as an excuse does not make it false.
Just because their perception was false does not mean we can excuse it.
"Canard" - because my Missionary nickname in France was the french word for "duck" (the bird) I didn't realise canard in English means: a false or unfounded report or story; especially : a fabricated report / a groundless rumor or belief Apologies if you thought the name was a reflection of my views on Mormon history. Ironically I chose it to remind me of a time of pure faith and testimony.
So, if I were a member of the early church, I suppose that I should leave the church because of the imperfections of James.
I find the idea quite disturbing that God has a chosen people and if weren't lucky enough to be born into it you don't get the blessings of the gospel. Of course if I lived a few thousand years ago when the Bible was written I'd probably think different as it was common for cultures to claim superiority or God's favor based solely on their lineage. While there is some of this thinking that goes on today, most of the educated world has moved past the idea of racial and ethnic superiority.