We live in a world driven by data. Data is collected and stored on every human interaction, whether commercial, civic or social. Enormous server “farms” across the world save, preserve and serve data on demand. A list of the most in-demand jobs includes data-scientist and statistician. Algorithms determine prison sentences, scan video feeds to identify potential suspects of crimes, and assist in decisions regarding loans, college admissions and employment interviews. But problems lurk. Algorithms trained using data that poorly represent the populations to which they are applied leave members of some groups at greater risk of being mistakenly incarcerated. Data models developed without input from contextual experts exacerbate existing patterns of racism and sexism. Data is stolen, allowing thieves to impersonate others and steal millions. Privacy is threatened, and your local grocery chain may know more about your medical conditions than your closest family members.
We live in a world driven by data. Data is collected and stored on every human interaction, whether commercial, civic or social. Enormous server “farms” across the world save, preserve and serve data on demand. A list of the most in-demand jobs includes data-scientist and statistician. Algorithms determine prison sentences, scan video feeds to identify potential suspects of crimes, and assist in decisions regarding loans, college admissions and employment interviews. But problems lurk. Algorithms trained using data that poorly represent the populations to which they are applied leave members of some groups at greater risk of being mistakenly incarcerated. Data models developed without input from contextual experts exacerbate existing patterns of racism and sexism. Data is stolen, allowing thieves to impersonate others and steal millions. Privacy is threatened, and your local grocery chain may know more about your medical conditions than your closest family members.