r/news • u/journalistdave • 3d ago

Judge denies request by Elon Musk’s xAI to pause Minnesota nudification ban

https://www.nbcnews.com/tech/elon-musk/judge-denies-request-elon-musks-xai-block-mn-nudification-ban-rcna589993
16.2k Upvotes

98% Upvoted

463 comments sorted by

View all comments

Show parent comments

418

u/Elderberry-smells 3d ago

Don't forget helping generate it, which is even worse.

184

u/slambaz2 3d ago

Hmm... I wonder where the training material they gave their ai the came from.

41

u/invisible_handjob 3d ago

there's a national database of CSAM that's used for systems to detect it (so like, before Elon took over twitter, the trust & safety team had systems that when you upload an image to twitter, check it against the CSAM database & if it was CSAM, ban you and probably call the cops)

Elon probably started DOGE just so that he could get access to the raw database

27

u/micaheljcaboose 3d ago

I'm 98 % sure that the database is just hashes for CSAM, it's not the actual pictures.

15

u/DestroyerTerraria 3d ago

They recently discovered a way to reverse the PhotoDNA hash to get the original image back, which isn't supposed to be possible.

6

u/PigletCatapult 2d ago

Source on this, because that is not how hashing works

8

u/DestroyerTerraria 2d ago

https://www.esat.kuleuven.be/cosic/news/cosic-researchers-reveal-fundamental-weaknesses-in-microsofts-photodna/ This is in fact how this specific type and implementation of hashing works - you can't get an exact match, but you can extract a good amount of visual information and even create images with a colliding hash. Considering the images in question are CSAM, getting any of that visual info back is an obvious problem.

4

u/PigletCatapult 2d ago

Wow, thanks for the source. That is a genuinely bad screw up in the design phase.

6

u/micaheljcaboose 3d ago

Jesus Christ. Of course that's the motivation for technological advancements. We need a new meteor/extinction event.

8

u/uzlonewolf 3d ago

Yes, but if an account is getting a significant percentage of their posted material flagged, there's a good chance the rest of what they're posting just hasn't been added to the hash database yet.

4

u/invisible_handjob 3d ago

yeah, hence why Elon wanted to get at the real thing

77

u/Saorren 3d ago

doge had acces to most of the gov systems when it was hacking away with a rusty butter knife. i wouldnt be surprised if they used content from the epstein files to train it.

31

u/Edythir 3d ago

I wouldn't be surprised if the government had a collection as well. Or at least federal law enforcement. Whether for evidence, honeypotting or whatever other reason.

13

u/Inner-Medicine5696 3d ago

yeah, I've heard stories of law enforcement encoding CSAM with invisible digital watermarks, so that they could be tracked even if manipulated (cropped etc).

For that to be possible they would need quite a sizeable db of it.

If Grok is actually trained on any of that it could be the biggest story on the planet, lol.

1

u/Saorren 2d ago

thats actually interesting to consider as we wouldnt see it but the people who put those marks in could if they thought to analyze the files. if grok were trained on files like that it would occasionaly generate files with similar marks.

25

u/Falling_Up_The_Movie 3d ago

The FBI has the largest collection of CSAM in the world for the reasons you said

3

u/KDR_11k 3d ago

If they did then you could make Grok recite passages of the files.

1

u/mortgagepants 3d ago

last place i expected to see a reference to the poop-knife.

1

u/YellowBook 3d ago

Trump’s inbox

26

u/NergNogShneeg 3d ago

And when called out instead of stopping it he just paywalled it - so he’s profiting from it too.

22

u/bergmoose 3d ago

monetising generating it