AI teacher tools display racial bias when generating student behavior plans, study finds
Artificially intelligent teachers assistants have built-in racial bias, a new study found.
Common Sense Media evaluated the quality of numerous teaching tools, giving them a prompt to “generate behavior intervention strategies” for students with white- and Black-coded names.
White-coded students received deescalation-focused strategies, while Black-coded students were recommended “immediate” responses. The AI assistants also generated lesson plans that relied on stereotypes and failed to debunk misinformation around topics such as Haitian immigrants consuming pets.
The technology companies said they were unable to recreate the findings of the study, but that they were constantly improving their models.
Publication: Chalkbeat
Author: Norah Rami