Stanford researchers find Mastodon has a massive child abuse material problem
Mastodon, an alternative social network to Twitter, has a serious problem with child sexual abuse material according to researchers from Stanford University. In just two days, researchers found over 100 instances of known CSAM across over 325,000 posts on Mastodon. The researchers found hundreds of posts containing CSAM related hashtags and links pointing to CSAM trading and grooming of minors. One Mastodon server was even taken down for a period of time due to CSAM being posted. The researchers suggest that decentralized networks like Mastodon need to implement more robust moderation tools and reporting mechanisms to address the prevalence of CSAM.
Stanford researchers find Mastodon has a massive child abuse material problem
Researchers at Stanford’s Internet Observatory found that child sexual abuse material (CSAM) has become widespread on the Twitter alternative Mastodon.Emma Roth (The Verge)
like this
FIash Mob #5678
in reply to trashhalo • • •Mastodon.art doesn't.
And the beauty of Mastodon is you can block an entire instance, as can your admin, when something awful is posted. Mastodon even has a hashtag they use as an alert for this kind of thing. (#Fediblock)
like this
Sonori, ᴇᴍᴘᴇʀᴏʀ 帝, Xerø, user68k, texelot, outdated_belated, The_Terrible_Humbaba, Sir Gareth, gabe [he/him], InattentiveRaccoon, Rin and Jimbo like this.
while1malloc0
in reply to trashhalo • • •While the study itself is a good read and I agree with the conclusions—Mastodon, and decentralized social media need better moderation tools—it’s hard to not read the Verge headline as misleading. One of the study authors gives more context here https://hachyderm.io/@det/110769470058276368. Basically most of the hits came from a large Japanese instance that no one federates with; the author even calls out that the blunt instrument most Mastodon admins use is to blanket defederate with instances hosted in Japan due to their more lax (than the US) laws around CSAM. But the headline seems to imply that there’s a giant seedy underbelly to places like mastodon.social[1] that are rife with abuse material. I suppose that’s a marketing problem of federated software in general.
like this
0x0F, J.B. Pinkle, wholemilk, TerryTPlatypus, trashhalo, TheOPtimal, MentalEdge, farcaster, Blake (he/him), outdated_belated, ZippoHippo, Fizz, Paralda, not_amm, PetroGuy, sin_free_for_00_days, eratosthenes, AndreTelevise, tvbusy, Albbi, The_Terrible_Humbaba, rooster_butt, TiNTIVUS, Micah, caio, glorbo, Claidheamh, stravanasu, cavemeat, superflippy, luciole, _taher_, baconbrand, MountingSuspicion, ag_roberston_author, Slappula, swnt, wizardbeard, ZoeyBear, hastati, sunflower_scribe, SeekingFreedom, Sir Gareth, MangoKangaroo, supercriticalcheese, atomWood, Gsus4, God_Is_Love, XPost3000, gabe [he/him], pastatheturtle, sabreW4K3, CalcProgrammer1, MewBlue, MountainTurkey, zero_gravitas, TheOakTree, HumbleFlamingo, entropicdrift, JohnEff, emma, zygo_histo_morpheus, thesociallions, Ryan, maxso216, zephyrvs, das, Rin, napkin101, spiderlilies, Verbose2812, Ibis, axsyse, jherazob and 73 other people like this.
jherazob
in reply to while1malloc0 • • •The person outright rejects defederation as a solution when it IS the solution, if an instance is in favor of this kind of thing you don't want to federate with them, period.
I also find worrying the amount of calls for a "Fediverse police" in that thread, scanning every image that gets uploaded to your instance with a 3rd party tool is an issue too, on one side you definitely don't want this kinda shit to even touch your servers and on the other you don't want anybody dictating that, say, anti-union or similar memes are marked, denounced and the person who made them marked, targeted and receiving a nice Pinkerton visit.
This is a complicated problem.
Edit: I see somebody suggested checking the observations against the common and well used Mastodon blocklists, to see if the shit is contained on defederated instances, and the author said this was something they wanted to check, so i hope there's a followup
like this
Confetti Camouflage, keltaris, linoor, zagaberoo, germy, The Doctor, kbyanyname, luciole, ParsnipWitch, flora_explora, Tiptopit, Luvon, Jimbo, droobey, VinceUnderReview, Paranoid Factoid, Ricky, tackykcat, Workerbee, tdgoodman, pitl, jarfil and Synergeist like this.
Pseu
in reply to jherazob • • •It's the solution in the sense that it removes it from view of users of the mainstream instances. It is not a solution to the overall problem of CSAM and the child abuse that creates such material. There is an argument to be made that is the only responsibility of instance admins, and that past that is the responsibility of law enforcement. This is sensible, but it invites law enforcement to start overtly trawling the Fediverse for offending content, and create an uncomfortable situation for admins and users, as they will go after admins who simply do not have the tools to effectively monitor for CSAM.
Defederation also obviously does not prevent users of the instance from posting CSAM. Admins even unknowingly having CSAM on their instance can easily lead to the admins being prosecuted and the instance taken down. Section 230 does not apply to material illegal on a federal level, and SESTA requires removal of material that violates even state level sex trafficking laws.
Sonori likes this.
stravanasu
in reply to trashhalo • • •like this
Fizz, i_am_not_a_robot, PetroGuy, Shiri Bailem, tvbusy, Albbi, eskimofry, nzodd, Claidheamh, cavemeat, SpamCamel, Sina, X3I, MountainTurkey, madkarlsson, Altima NEO, Delegate0039, emma, zygo_histo_morpheus, zephyrvs, Verbose2812, CaptainAniki, Supermuff, exu, Neshura, raoul, pollen, linoor, zagaberoo, Rentlar, yessikg, epicspongee [they/them or he/him], ascense, Infynis, catcarlson, Schtefanz, Gamma, fades, 𝒍𝒆𝒎𝒂𝒏𝒏, saluer_lorque, Sonori, ArtikBanana, Jimbo, Dau, Workerbee, MaungaHikoi and Unbeelievable like this.
mudeth
in reply to stravanasu • • •It doesn't help to bring whataboutism into this discussion. This is a known problem with the open nature of federation. So is bigotry and hate speech. To address these problems, it's important to first acknowledge that they exist.
Also, since fed is still in the early stages, now is the time to experiment with mechanisms to control them. Saying that the problem is innate to networks is only sweeping it under the rug. At some point there will be a watershed event that'll force these conversations anyway.
The challenge is in moderating such content without being ham-fisted. I must admit I have absolutely no idea how, this is just my read of the situation.
like this
audaxdreik, tvbusy, Micah, cavemeat, Steve, luciole, nice, blip, ColdCreasent, mokpo, Gaywallet (they/it), Gurfaild, IronKrill, Square, martoon, gaael, gressen, keltaris, Linnce, epicspongee [they/them or he/him], catcarlson, Schtefanz, forestG, Rin, 𝒍𝒆𝒎𝒂𝒏𝒏, Sonori, FelineForward, Dau, interolivary and MaungaHikoi like this.
Shiri Bailem
in reply to mudeth • •@mudeth @pglpm you really don't beyond our current tools and reporting to authorities.
This is not a single monolithic platform, it's like attributing the bad behavior of some websites to HTTP.
Our existing moderation tools are already remarkably robust and defederating is absolutely how this is approached. If a server shares content that's illegal in your country (or otherwise just objectionable) and they have no interest in self-moderating, you stop federating with them.
Moderation is not about stamping out the existence of these things, it's about protecting your users from them.
If they're not willing to take action against this material on their servers, then the only thing further that can be done is reporting it to the authorities or the court of public opinion.
like this
Micah, nzodd, stravanasu, Ithi, luciole, mudeth, MountainTurkey, BlueBockser, ctr1, CaptainAniki, crocat, jherazob, incogtino, raoul, Confetti Camouflage, zagaberoo, epicspongee [they/them or he/him], Schtefanz, Rin, saluer_lorque, Tingly3771, Workerbee, MaungaHikoi and Sonori like this.
stravanasu
in reply to mudeth • • •Maybe my comment wasn't clear or you misread it. It wasn't meant to be sarcastic. Obviously there's a problem and we want (not just need) to do something about it. But it's also important to be careful about how the problem is presented - and manipulated - and about how fingers are pointed. One can't point a finger at "Mastodon" the same way one could point it at "Twitter". Doing so has some similarities to pointing a finger at the http protocol.
Edit: see for instance the comment by @while1malloc0@beehaw.org to this post.
like this
cavemeat, MountainTurkey, vanquesse, Rikudou_Sage, incogtino, pollen, keltaris, zagaberoo, Schtefanz, saluer_lorque, Bjaldr, Workerbee and Sonori like this.
mudeth
in reply to stravanasu • • •Understood, thanks. Yes I did misread it as sarcasm. Thanks for clearing that up :)
However I disagree with @shiri@foggyminds.com in that Lemmy, and the Fediverse, are interfaced with as monolithic entities. Not just by people from the outside, but even by its own users. There are people here saying how they love the community on Lemmy for example. It's just the way people group things, and no amount of technical explanation will prevent this semantic grouping.
For example, the person who was arrested for CSAM recently was running a Tor exit node, but that didn't help his case. As shiri pointed out, defederation works for black-and-white cases. But what about in cases like disagreement, where things are a bit more gray? Like hard political viewpoints? We've already seen the open internet devolve into bubbles with no productive discourse. Federation has a unique opportunity to solve that problem starting from scratch, and learning from previous mistakes. Defed is not the solution, it isn't granular enough for one.
Another problem defederation is that it is after-the-fact and depends on moderators and admins. There will inevitably be a backlog (pointed out in the article). With enough community reports, could there be a holding-cell style mechanism in federated networks? I think there is space to explore this deeper, and the study does the useful job of pointing out liabilities in the current state-of-the-art.
like this
stravanasu, martoon, vanquesse, keltaris, catcarlson, interolivary, Workerbee and Sonori like this.
stravanasu
in reply to mudeth • • •I share and promote this attitude. If I must be honest it feels a little hopeless: it seems that since the 1970s or 1980s humanity has been going down the drain. I fear "fediverse wars". It's 2023 and we basically have a World War III going on, illiteracy and misinformation steadily increase, corporations play the role of governments, science and scientific truth have become anti-Galilean based on "authorities" and majority votes, and natural stupidity is used to train artificial intelligence. I just feel sad.
But I don't mean to be defeatist. No matter the chances we can fight for what's right.
mudeth likes this.
Shiri Bailem
in reply to mudeth • •@mudeth @pglpm The grey area is all down to personal choices and how "fascist" your admin is (which goes on to which instance is best for you?)
Defederation is a double-edged sword, because if you defederate constantly for frivolous reasons all you do is isolate your node. This is also why it's the *final* step in moderation.
The reality is that it's a whole bunch of entirely separate environments and we've walked this path well with email (the granddaddy of federated social networks). The only moderation we can perform outside of our own instance is to defederate, everything else is just typical blocking you can do yourself.
The process here on Mastodon is to decide for yourself what is worth taking action on. If it's not your instance, you report it to the admin of that instance and they decide if they want to take action and what action to take. And if they decide it's acceptable, you decide whether or not this is a personal problem (just block the user or domain on in your user account but leave it federating) or if it's a problem for your whole server (in which case you defederate to protect your users).
Automated action is bad because there's no automated identity verification here and it's an open door to denial of service attacks (harasser generates a bunch of different accounts, uses them all the report a user until that user is auto-suspended).
The backlog problem however is an intrinsic problem to moderation that every platform struggles with. You can automate moderation, but then that gets abused and has countless cases of it taking action on harmless content, and you can farm out moderation but then you get sloppiness.
The fediverse actually helps in moderation because each admin is responsible for a group of users and the rest of the fediverse basically decides whether they're doing their job acceptably via federation and defederation (ie. if you show that you have no issue with open Nazis on your platform, then most other instances aren't going to want to connect to you)
interolivary likes this.
mudeth
in reply to Shiri Bailem • • •Agreed. It's not the solution.
On this I disagree. There are many fundamental differences. Email is private, while federated social media is public. Email is one-to-one primarily, or one-to-few. Soc media is broadcast style. The law would see it differently, and the abuse potential is also different. @faeranne@lemmy.blahaj.zone also used e-mail as a parallel and I don't think that model works well.
I agree for myself, but that wouldn't shield a lay user. I can recommend that a parent sign up for reddit, because I know what they'll see on the frontpage. Asking them to moderate for themselves can be tricky. As an example, if people could moderate content themselves we wouldn't have climate skeptics and holocaust deniers. There is an element of housekeeping to be done top-down for a platform to function as a public service, which is what I assume Lemmy wants to be.
Otherwise there's always the danger of it becoming an wild-west platform that'll attract extremists more than casual users looking for information.
Good point.
The way I see it this will inevitably lead to concentration of users, defeating the purpose of federation. One or two servers will be seen as 'safe' and people will recommend that to their friends and family. What stops those two instances from becoming the reddit of 20 years from now? We've seen what concentration of power in a few internet companies has done to the Internet itself, why retread the same steps?
Again I may be very naive, but I think with the big idea that is federation, what is sorely lacking is a robust federated moderation protocol.
Shiri Bailem
in reply to mudeth • •@mudeth I 110% agree faeranne, especially in that this is much like the topic of encryption and how people (especially politicians) keep arguing that we just need to magically come up with a solution that allows governments to access all encrypted communication somehow without impacting security and preventing people from using existing encryption to completely bypass it. It's much like trying to legislate math into functioning differently.
The closest you can get to a federated moderation protocol is basically just a standard way to report posts/users to admins.
You could absolutely build blocklists that are shared around, but that's already a thing and will never be universal.
Basically what you're describing is that someone should come up with a way to *force* me to apply moderation actions to my server that I disagree with. That somehow such a system would be immune to abuse (ie. because it's external to my server, it would magically avoid hackers and trolls manipulating it) and that I would have no choice in whether or not to allow that access despite running a server based on open source software in which I can edit the code myself if I wish (but somehow in this case wouldn't be able to edit it to prevent the external moderation from working).
You largely miss the point entirely of my other arguments: email is a perfect reference point because, despite private vs public, it faces all the same technical, social, and legal challenges. It's just an older system with a slightly different purpose (that doesn't change it's technical foundations, only just how it's interacted with), but the closest relative to activitypub with much much larger scale adoption. These issues and topics have already been discussed ad nauseum there.
And I didn't say users would moderate themselves, we decide what is worth taking action on. If you're not an admin, you choose whether or not something is worth reporting and whether or not you find the server you're on acceptable to your wants/needs. If you take issue with anti-vaxxers, climate change deniers, and nazis and your server allows all of that (either on the server itself, or has no issue with other servers that allow it)... then you move to a server that doesn't.
Finally, this doesn't end in centralization because of all the aforementioned gray areas. There are many things that I don't consider acceptable on my server but aren't grounds for defederation.
For example: I won't tolerate the ignoring of minority voices on topics of cultural appropriation and microaggressions... but I don't consider it a good idea to defederate other servers for it because the admins themselves often barely understand it and I would be defederation 90% of the fediverse at that point. If I see such from my users I will talk to them and take action as appropriate, but from other servers I'll report if the server looks remotely receptive to it.
zygo_histo_morpheus
in reply to trashhalo • • •like this
Rin, BlueBockser, Rozaŭtuno, gressen, Verbose2812, Ibis, Supermuff, exu, Ascyron, Provider, Neshura, remer, trashhalo, vin, HobbitFoot, Confetti Camouflage, Applejuicy, keltaris, linoor, AutomaticJack, Shiri Bailem, zagaberoo, ThaNookLmao, Rentlar, yessikg, Jediotty, jeseus, Enfield [he/him], Jimbo, Dau and Workerbee like this.
ParsnipWitch
in reply to zygo_histo_morpheus • • •It's how drug dealers online sometimes work or extremist groups.
zephyrvs
in reply to trashhalo • • •Stanford are definitely the good guys, just looking out for the wellbeing of kids worldwide.
Oh: https://nypost.com/2019/09/14/stanford-is-latest-elite-university-linked-to-jeffrey-epstein/
Stanford is latest elite university linked to Jeffrey Epstein
Sara Dorn (New York Post)like this
Rozaŭtuno, Verbose2812, Ibis, CaptainAniki, Amju Wolf, Ascyron, DrZepto, Luan, Neshura, remer, skepticalifornia, tshannon, spiderman, Shiri Bailem, ThaNookLmao and Rentlar like this.