Introduction
Generative artificial intelligence is often heralded as the next frontier of technological innovation. Promising sophisticated automation and increased efficiency, it is embraced by many companies to transform their operations. However, behind this facade of progress lies practices that raise serious human rights concerns.
Generative AI and Data Collection
Generative AI systems rely on learning from vast amounts of data. These data are often collected through web scraping techniques that may be illegal or unethical. Amnesty International has highlighted that such practices frequently violate individuals' privacy rights.
For instance, in 2023, a study revealed that 67% of the data used by certain AI systems had been collected without explicit user consent, raising questions of compliance with international human rights laws.
Discrimination and Embedded Bias
Another major issue is discrimination. Biases present in training data can translate into biased outcomes, reinforcing existing stereotypes and discrimination. A 2024 report showed that AI-based facial recognition systems had a 35% error rate for dark-skinned individuals, compared to only 8% for light-skinned individuals.
Threats to Freedom of Expression
Generative AI systems do not just produce content; they can also influence thought and expression. For instance, text generators can be used to create large-scale disinformation campaigns, swaying public opinion and threatening democracy.
Incompatibility with Human Rights
Amnesty International's analysis concludes that these technologies, by their very design, are incompatible with international human rights standards. In 2026, the organization called for a ban on generative AI systems that rely on illegal data collection practices.
Conclusion
In the face of these challenges, it is crucial that companies and policymakers take steps to protect human rights while embracing technological innovations. Generative AI has the potential to transform our world, but not at the cost of fundamental rights.
Let's discuss your project in 15 minutes.