Fair AI with Harmful Bias Managed
- Jurisdiction
- US-Federal
- Issuer
- NIST
Fair AI with harmful bias managed addresses equality and equity concerns while recognizing that fairness standards are complex, culturally dependent, and context-specific. This characteristic of trustworthy AI goes beyond demographic balance to address systemic inequities.
Key Principles:
- Contextual Fairness: Standards of fairness vary among cultures and applications
- Beyond Demographics: Fairness encompasses more than balanced predictions across demographic groups
- Accessibility: Systems must be accessible to individuals with disabilities and those affected by digital divides
- Systemic Considerations: Address existing disparities rather than perpetuating them
Three Categories of AI Bias (per NIST SP 1270):
1. Systemic Bias: Present in datasets, organizational norms and practices, and broader society
- Reflects historical and structural inequalities
- Embedded in data collection and labeling processes
- Perpetuated through organizational practices
2. Computational and Statistical Bias: Present in datasets and algorithmic processes
- Stems from non-representative samples
- Results from systematic errors in data or algorithms
- Can be introduced through technical design choices
3. Human-Cognitive Bias: Related to how individuals or groups perceive and use AI systems
- Affects decision-making throughout the AI lifecycle
- Influences design, implementation, operation, and maintenance
- Omnipresent in human interpretation of AI outputs
Important Distinctions:
- Bias mitigation does not automatically ensure fairness
- Bias can occur without prejudice, partiality, or discriminatory intent
- AI systems can increase the speed and scale of existing biases
- Bias is associated with both accountable and transparent AI and broader societal fairness
Management Approaches:
- Recognize cultural and contextual differences in fairness perceptions
- Address multiple types of bias simultaneously
- Engage diverse stakeholders in fairness assessments
- Monitor for disparate impacts across different groups
- Consider intersectional effects and compound disadvantages
Effective bias management requires ongoing attention throughout the system lifecycle and engagement with affected communities to understand fairness in specific contexts.