Public Event
In Person
All Tech is Human and Humane Intelligence:
Hacking Algorithms Around Factuality, Bias, and Misdirection
Jul
9
All Tech Is Human is a non-profit committed to building the world’s largest multistakeholder, multidisciplinary network in Responsible Tech. This allows us to tackle wicked tech & society issues while moving at the speed of tech, leverage the collective intelligence of the community, and diversify the traditional tech pipeline. Together, we work to solve tech & society’s thorniest issues.
For our upcoming gathering, we are collaborating with Humane Intelligence to present Hacking algorithms around factuality, bias, and misdirection.
Humane Intelligence recently launched the first of 10 "algorithmic bias bounty" programs, which will be unfolding over the coming year. With the support of Google.org, they are building themed programs that aim to build community and professionalize the practice of algorithmic assessment.
The first challenge involves creating a probability estimation model that determines whether the prompt provided to a language model will elicit an outcome that demonstrates factuality, bias, or misdirection, inspired by the data from the DEF CON Generative AI Red Teaming Challenge: Transparency Report. We invite participants of all skill levels to enter and we have $10,000 of prizes for beginner, intermediate, and advanced.
Why this challenge? We’re proposing an interesting approach to finding issues in generative AI models before they happen - if we can more accurately predict whether a given prompt is either intentionally or unintentionally designed to lead to a bad outcome, we are better able to stop problems before they happen. We are pleased to meet recent demands for greater AI oversight (including this week's bipartisan Senate report, “Driving U.S. Innovation in Artificial Intelligence”), which specifically advocates for funding bug bounties and grand challenges.
Humane Intelligence is partnering with All Tech is Human to organize a hackathon around this bias bounty challenge. Participants in the hackathon will be supported as they delve into this first bias bounty challenge.
We will also have a panel on AI governance, crowdsourcing, and community-based responses.