In a refrain that feels almost entirely too familiar by now: Generative AI is drawing eroticismrepeating the biases of its makers.
A new investigation from Bloombergfound that OpenAI's generative AI technology, specifically GPT 3.5, displayed preferences for certain racial in questions about hiring. The implication is that recruiting and human resources professionals who are increasingly incorporating generative AI based tools in their automatic hiring workflows — like LinkedIn's new Gen AI assistant for example — may be promulgating racism. Again, sounds familiar.
The publication used a common and fairly simple experiment of feeding fictitious names and resumes into AI recruiting softwares to see just how quickly the system displayed racial bias. Studies like these have been used for years to spot both human and algorithmic bias among professionals and recruiters.
"Reporters used voter and census data to derive names that are demographically distinct — meaning they are associated with Americans of a particular race or ethnicity at least 90 percent of the time — and randomly assigned them to equally-qualified resumes," the investigation explains. "When asked to rank those resumes 1,000 times, GPT 3.5 — the most broadly-used version of the model — favored names from some demographics more often than others, to an extent that would fail benchmarks used to assess job discrimination against protected groups."
The experiment categorized names into four categories (White, Hispanic, Black, and Asian) and two gender categories (male and female), and submitted them for four different job openings. ChatGPT consistently placed "female names" into roles historically aligned with higher numbers of women employees, such as HR roles, and chose Black women candidates 36 performance less frequently for technical roles like software engineer.
ChatGPT also organized equally ranked resumes unequally across the jobs, skewing rankings depending on gender and race. In a statement to Bloomberg, OpenAI said this doesn't reflect how most clients incorporate their software in practice, noting that many businesses fine tune responses to mitigate bias. Bloomberg's investigation also consulted 33 AI researchers, recruiters, computer scientists, lawyers, and other experts to provide context for the results.
The report isn't revolutionary among the years of work by advocates and researchers who warn against the ethical debt of AI reliance, but it's a powerful reminder of the dangers of widespread generative AI adoption without due attention. As just a few major players dominate the market, and thus the software and data building our smart assistants and algorithms, the pathways for diversity narrow. As Mashable's Cecily Mauran reported in an examination of the internet's AI monolith, incestuous AI development (or building models that are no longer trained on human input but other AI models) leads to a decline in quality, reliability, and, most importantly, diversity.
And, as watchdogs like AI Nowargue, "humans in the loop" might not be able to help.
Topics Artificial Intelligence Social Good ChatGPT
How I met my partner on X/Twitter
First live
Your Facebook activity influences what appears in your Instagram feed
Sea ice in the central Arctic should be growing. It's not.
Preorder the new Anker Soundcore Sleep A30 earbuds with ANC for $159
YouTube launches 9 new playlists on taking care of your mental health
Google mocks cryptocurrency as 'not real' in Call Screen ad
A website asks you to pay 99 cents to see who has paid 99 cents
Man City vs. Real Madrid 2025 livestream: Watch Champions League for free
Facebook removes hundreds of pages and accounts that spread fake news
Sinner vs. de Minaur 2025 livestream: Watch Australian Open for free
Google will oppose subpoena for user data in Shitty Media Men lawsuit
Runner seeks help to adopt dog who ran a marathon with him
It's Barack Obama's birthday and Twitter users think he's their dad
CES 2025: Hands
The long journey of America's first Olympian to compete in a hijab
17 miniature gifts that will make you wish everything was tiny
Google will oppose subpoena for user data in Shitty Media Men lawsuit
Golden State Warriors vs. Los Angeles Lakers 2025 livestream: Watch NBA online
Noted feminist Barack Obama challenges men to fight sexism
NYPD to Google: Quit tracking drunkWeRateDogs is releasing a new card game where you can rate all the good pupsCan Republicans dump Trump as their 2016 presidential candidate?Victims reclaim their own narratives at Sundance 2019Donald Trump just crossed a major line during Sunday night's debateAlexandria OcasioNASA's OCOFyre Festival designer Oren Aks says he's proud of the work he did with FuckJerryJeff Bezos says National Enquirer threatened to reveal his nude photosInstagram's new donation sticker will make it easy to give money to charitiesAnd the final Donald Trump 'manterruption' count is ...Samsung Galaxy S10e leaks in new photo and it is all yellowPresident Obama slams Trump for his 'demeaning' comments about womenJeff Bezos says National Enquirer threatened to reveal his nude photosDictionary factPeople are turning the debate into a glorious singIvanka Trump tweets about pizza, remains silent on Donald Trump's leaked audioTrump’s idea of debate prep is a Facebook Live with Bill Clinton’s accusersOnline dating FOMO is ruining my chances of finding a datePancakes in space? No that's just the mysterious MU69 'American Vandal' Season 2 is in the works if you're already obsessed Jemele Hill supporters take up the #NaziBucketChallenge How the tech elite's addiction to fancy coffee turned Blue Bottle into a tech startup Remarkable Tablet: The full review Why Jon Snow will need to kill Daenerys in Game of Thrones So ... what is Jennifer Lawrence's 'mother!' really about? Claire Foy crowned the new 'Girl with the Dragon Tattoo' Cassini's last Saturn photo shows the spot where it was doomed to die Facebook handed over info on those Russia How long can Netflix keep its prices this low? Insane Clown Posse's Juggalo March takes to the D.C. National Mall, and the photos are epic Google goes big in Asia with mobile payment app for hundreds of millions of people Lorde sticks it to school bullies with ultimate revenge: a 'Vogue' cover The future of obnoxiously loud autoplay videos is in doubt All of the Rick and Morty swag you could ever want 'Mother!' first screenings: What audiences thought This app collects women's stories to fight harassment in developing countries From Donald Glover to Spicey, the best and worst moments of the 2017 Emmys Alec Baldwin wins Emmy for 'SNL' Donald Trump impression 'Outlander' says a heartbreaking goodbye to the Highlanders in our Cry of the Week
1.9252s , 8288.15625 kb
Copyright © 2025 Powered by 【drawing eroticism】,Wisdom Convergence Information Network