50 points by gmays 1 day ago | 59 comments
throwup238 1 day ago
I don't know how this problem can be solved automatically without something that looks a lot like AGI and can monitor the whole internet to learn the evolving cultural context. AI moderation feels like self driving cars all over again: the happy path of detecting and censoring a dick pic - or self driving in perfect California weather - is relatively easy but automating the last 20% or so of content seems impossibly out of reach.
The "subtle forms of hate speech" is especially hard and nebulous, as dog whistles in niche communities change adversarialy to get past moderation. In the most subtle of cases, there are a lot of judgement calls to make. Then each instance of these AGIs would have to be run in and tailored to local jurisdictions and cultures because that is its own can of worms. I just don't see tech replacing humans in this unfortunate role, only augmenting their abilities.
> The glossy veneer of the tech industry conceals a raw, human reality that spans the globe. From the outskirts of Nairobi to the crowded apartments of Manila, from Syrian refugee communities in Lebanon to the immigrant communities in Germany and the call centers of Casablanca, a vast network of unseen workers power our digital world.
This part never really changed. Mechanical turk is almost 20 years old at this point and call center outsourcing is hardly new. What's new is just how much human-generated garbage we force them to sift through on our behalf. I wish there was a way to force these training data and moderation companies to provide proper mental health care .
hcurtiss 1 day ago
danans 1 day ago
It may be fuzzy on the far edges, but any speech that calls for the elimination, marginalizes, dehumanizes or denies human or civil rights of a group of people is right in the heart of the meaning of hate speech.
That definition still leaves huge amounts of space for satire, comedy, political and other forms of protected speech, even "offensive speech".
skeeter2020 1 day ago
but you've already lumped together a huge range of behaviours and impacts. Elimination? OK, we can probably broadly define that, but I just heard news reports with quotes of Israelis calling for the elimination of Hamas, and Iran the elimination of Israel. How do we handle that? marginalized? as defined by who? What about marginalizing undesirable behaviours or speech? What does "dehumanize" mean? Who's definition of human or civil rights?
danans 22 hours ago
I'd call both of them hate speech without qualification. But between countries, there's no legal system that would rule on speech (only actions, like the ICJ tries to adjudicate).
> What about marginalizing undesirable behaviours or speech?
What is the example of undesirable behavior being undertaken by a group that would warrant their marginalization as a group? I'm having a hard time finding an example of that. Calling out a group of racists or bigots (based on their words) for what they are isn't marginalization.
> What does "dehumanize" mean?
This has a very straightforward definition:
https://www.merriam-webster.com/dictionary/dehumanize
> Who's definition of human or civil rights?
In the US context, this is also well defined:
https://www.findlaw.com/civilrights/civil-rights-overview/wh...
hcurtiss 4 hours ago
samatman 1 day ago
Yep, that's bad alright.
> marginalizes, dehumanizes
This is the part which means anything that authorities or other powerful groups need it to.
yifanl 1 day ago
That seems extremely wrong, especially in this context, given that LLMs make no attempt to formalize "ideas", they're only interested in syntax.
mewpmewp2 1 day ago
yifanl 1 day ago
o11c 1 day ago
Stating the position "torture is bad" is enough to get you banned from some places (because it's offensive to people who believe that it's okay as long as the victims are less-than-human).
szundi 1 day ago
epicureanideal 1 day ago
This can be done from both sides. Examples:
Not sufficiently (for whoever) enforcing immigration laws? "Trying to eliminate the majority population, gradual ethnic cleansing".
Talking about deporting illegal immigrants? "The first step on the road to murdering people they don't want in the country."
And if the local judiciary or law enforcement is aligned with the interests of one side or the other, they can stretch the anti hate speech laws to use the legal system against their opponents.
skeeter2020 1 day ago
You are seeing this EXACT thing in the middle east right now.
whiplash451 1 day ago
Humans will spend a lot of energy to hide porn content on the internet while self-driving might benefit from a virtuous circle: once enough waymos are out there, people will adapt and learn to drive/bike/walk alongside them. We have a fundamentally good reason to cooperate.
I am not a self-driving fanatic but I do believe that a lot of edge cases might go away as we adapt to them.
nradov 1 day ago
shadowgovt 1 day ago
datadrivenangel 1 day ago
If my GP says that I'm overweight, which is associated with negative health outcomes, that's factual. If someone on twitter calls me a fatso, that's mean/hateful.
HPsquared 1 day ago
sdenton4 1 day ago
kevingadd 1 day ago
You deploy an AI to moderate, and it lets you cut your moderation workforce by 80%. Maybe you're a generous person, so you cut by 50% instead and the remaining moderators aren't as overworked anymore. (Nobody's going to actually do this, but hey, let's be idealistic.)
Costs are down, things are more efficient. Great! But there's a little problem:
Before, 90% of the posts your moderators looked at were mundane stuff. They'd stare at it for a moment, evaluate the context, and go 'yeah this is a death threat, suspend account.'
Now all the moderators see is stuff that got past the AI or is hard to classify. Dead bodies, CSAM, racist dogwhistle screeds, or the kind of mentally unhinged multi-paragraph angry rants that get an account shadowbanned on places like HN. Efficiency turns the moderator's job from 'fairly easy with occasional moments of true horror' into 'a nonstop parade of humanity's worst impulses, in front of my face, 40 hours a week'.
xtreme 1 day ago
AIorNot 1 day ago
instead its about being empathetic of the human suffering this work entails and finding ways to treat their contractors as humans instead of 'far off resources'
outsourcing this dirty and dingy work to African countries in this way without caring for the 'contractors' is a recipe for de-humanization of people..
their team page is funny reminder of classism and racial disparity in the world white people at the top and black people at the bottom.. lol I know they aren't racially driven and there is real economic value for the contractors as jobs but our current hyper-capitalistic global system is mostly setup to exploit offshore people instead of elevate them
the world is what it is..
Animats 1 day ago
shadowgovt 1 day ago
So we will forever be bearing that cost as long as people are allowed to use the Internet generally, and how to minimize the harm to those who bear it is a good question.
klabb3 1 day ago
There are a million things to criticize AI for, but this take is domain-illiterate – they’re simply drawing a connection between the hyped and fancy (currently AI) and poor working conditions in one part of the tech sector (content moderation).
Look, I’m sure the “data industry” has massive labor issues, heck these companies treat their warehouse workers like crap. Maybe there are companies who exploit workers more in order to train AI models. But the article is clearly about human-created content moderation for social media.
Of all the things AI does, it is pretty good at determining what’s in an image or video. Personally I think sifting through troves of garbage for abusive photos and videos (the most traumatizing for workers) is one of the better applications for AI. (Then you’ll see another sob story article about these people losing their jobs.)
shadowgovt 1 day ago
Issue 1, the direct trauma, is tragically endemic to providing fora for people to communicate online. Someone will be the front-line of dealing with the fringe of those communications. If it isn't people training AIs to do some of the 90%-work, it's instead human moderators having to review every complaint, which is strictly more trauma.
klabb3 1 day ago