It's the narrative stance that matters. Characters often do horrible things which the author disapproves of. If critics can't tell the difference between your racist characters and your anti-racist stance, just ignore them. They're dumb.