Toxicity detection

An NLP-based content moderation technique that assigns scores to text indicating the likelihood it is rude, disrespectful, or likely to make someone leave a conversation. Research has shown that toxicity detection models encode disability bias, scoring innocuous sentences that mention disability (e.g., "I am a person with mental illness") as significantly more toxic than equivalent sentences without disability references, potentially suppressing legitimate disability-related discourse online.