Voter ID and Challenges

Voter ID at the polling place will be subject to many court challenges.
There is another problem that crops up in certain areas – where self-appointed (usually right-wing) political bluenoses challenge certain voters on their right to vote. This challenge is usually against minorities and is used as a technique to intimidate them and drive them from the polls.
Has anyone ever challenged a voter challenger? If someone is going to question another person’s eligibility to vote, shouldn’t that person have to prove that they have citizenship standing to make the challenge?
The original challenger should have to produce a photo ID with their name and address on it and such information should be duly noted by the person challenged.
After that, let the chips fall where they may.