a new form of teen fuck-up emerges
87
170
2442
We need to bring back those old internet PSAs about personal information and privacy.
0
0
2
So what I'm hearing is that Gemini recognized him as a minor and engaged with him anyway. What fresh hell.
1
0
12
Gemini itself didn't recognize anything, probably. But once any image gets uploaded onto google's servers from anywhere, Drive, Mail, the AI chat client, etc, it gets put through automated scanners for CSAM and if it flags positive it will just nuke the whole account from orbit
0
0
0
Mental every single acounts linked to it are all gone. Highlights a risk I guess of sharing devices.
1
0
64
They might not have been. They could well have been perfectly responsible and set up supervised accounts for their kids in the same family group. The lead account would have been flagged and *poof* all gone.
0
0
16
This has got to be a joke.

15 years in business and hasn't heard of backups for the IT stuff?

This is likely BS as you can't link a Google work account with Family Link. Won't let you use it.

If kids account had Family Link in place the kids account would have been flagged not the parents.
1
0
6
They ban across the phone number linked to the account as well.

Use one phone number, this is what you get.
0
0
5
Say it with me people - regularly scheduled local physical backups of all important data and documents are VITAL. Never put the safety and existence of your business entirely in the hands of a cloud service.
0
0
7
This is horrible, but that level of dependency on google is in itself a horror story because they have previous!
0
0
8
Stop using Google services folks!!!!
Liberate yourself with open source, fully encrypted apps:
- ddocs.new instead of Google docs
- Brave instead of Chrome
- Proton instead of Gmail
- Mullvad for VPN
0
0
6
that "we have parental controls but didn't realize gemini isn't covered by those" is gonna become a huge problem on many different fronts.
0
0
30
Stop👏 Tying👏 Your👏 Life👏 To👏 Google👏
0
0
3
Well this sure makes my brother’s hundreds of dollars in dialup internet charges seem quaint by comparison
0
0
0
Let this be a cautionnary tale on the dangers of trusting a unique corporation with all your works and e-mails, and also on understanding that a teenager will always find something to masturbate to.
0
0
3
Do not tie your entire life to an account that a company can arbitrarily shut off. Any data that only exists in OneDrive/Google Drive is data you don't actually care about. Back everything up to your own redundant storage. Google and MS do this to people daily.
0
0
8
Ummm, if you are the parent of a child who has a chromebook from school, have a talk with your kid about this sort of thing. During the pandemic & remote learning we encountered several different stories similar to this. Your kids are experimenting, and they'll use devices they have access to.
1
2
197
As a qualified youth worker, I 1000% agree.
0
0
62
I am behind on Gemini features for what this means, so he was engaged in sexual roleplay with Gemini like basically sexting in the chatbot option but he also had his camera on to capture himself jerking off to... show Gemini the app? To what purpose? Asking Gemini to comment about his hard-on?
0
0
2
Maybe we should bring back “ask your parents permission before going online”?
0
0
5
new form of getting your parents off the slop-chatbot 🤔
0
0
0
I mean, that’s more of an adult fuck up.

Who puts their entire business on a fucking iPad?
3
0
4
Assuming the post is real it's pretty clear that his business files weren't *on the iPad*, they were stored in the Google Drive of one of the multiple accounts signed into the iPad.

It's definitely a lesson about not trusting Google with any of your shit but it's not quite that stupid.
1
0
35
work emails on the family tablet?!
1
0
30
Some have no choice. It's rampant
0
0
0
The real story here is google owns all of your vital information and can simply take it away and ruin your life.
0
0
3
If the teens find out they can nuke someone's google accounts permanently with this one weird trick, things might get dicey.
0
0
13
Running a business account on the same Google account as your family seems pretty dumb to me tbh
2
0
8
It isn't the same account, it's the same device - but Google has been known to shut down all "related" accounts when they ban one. If all the accounts were logged in on the same device, they all get hit.
0
0
1
It may have shut down every single Google account in the network, so if personal and business accounts are linked to the same phone.
A sensible measure to shut down a producer of CSAM but obviously disastrous here.
0
0
15
This kind of thing is part of why I'm so against surveillance and data mining. One glitch and you're toast. Imagine, your phone sees some sand dune, mistakes it for CSAM, and bam, you're locked out. (Not what happened here, just something I fear happening.)
0
0
3
It can’t be clear enough why an AI can be a Kafka nightmare. Google can suck shit
0
0
3
This is the new world we’ve been promised. Yay!
0
0
0
It's on Reddit.... I'm not entirely sure that they aren't trying to palm off their own cock up to avoid hard times. If you actually believe Reddit, you need to get a grip.
1
0
3
Please tell me this isn't _actually_ true.
2
0
18
A few years ago someone who needed to send their GP a photo of a worrying swelling on their child's genitals. The phone auto backed it up to cloud, and then immediately deleted the account.

So it's pretty believable

www.nytimes.com/2022/08/21/technology/google-surveillance-toddler-photo.html
0
0
15
It's a reddit thread, signs point to no. (especially that writing style)
You'll know in a few days if a subset of tabloid picks up on it.
1
1
49
The AI thing is the least crazy part about this story. They have a family tablet??? Not a family desktop PC, a family tablet. And they have their work accounts on it??? Not on the desktop PC I assume they actually work on (and sent their e-mails from). It's like they were looking for a disaster.
1
0
8
Sounds more like the tablet has family accounts, but because the work accounts belong to the same person, they're linked, so all got shut down.
0
0
7
should'a just let him look at pornhub discretely on his personal phone, tbh, if this is the alternative
0
0
10
Kids that go into puberty will start to experiment.
Has the kid done something stupid? Yes. But not wrong.
Google's 'concern with privacy' allows a minor to sexually roleplay with Gemini is absurd. If it can flag him as a minor it can also warn him and not engage.
1
0
28
Also since when does Gemini do erotica at all? It even rejects requests that vaguely sound inappropriate but aren't, or images that contain nudity even if you're just asking about the photographic technique, etc
1
0
6
Really good argument for not saving to Google Drive.
0
0
3
the not funny dark funny part is how she seems most concerned about her business, which relied on google because why?
2
0
8
because an android user told her to
1
0
1
Because google workspace is a thing ?
0
0
7
What disgusting creeps! They probably didn't even delete the footage, and they're just saying stuff so they can say, "Hey, we did something."

This is entirely their fault.
0
0
3
That's why you can't trust companies like that and always have physical backups of your work. It's time to get back from those companies that own your life.
0
0
6
Disable Gemini
0
0
3
Protect yourselves, folks!

1. Don't have your google docs be your only repository for your business and personal records. Keep a hard copy.

2. Keep your business emails separate from your family emails. No exceptions.

3. Pressure google to discontinue sex play on Gemini.
0
0
13
Incredible
0
0
0
Holy shit that's an impressive amount of fuck up
3
0
171
Everyone is at risk of this sort of thing too. Hackers are gonna realize they can ruin lives by signing into someone's account and uploading a few files. We rely way too much on Google.

Anyway, back to the game docs I have stored in Google Drive and nowhere else.
3
0
311
This is why when I give my kids a tablet to use, it doesn't have ANY of my data on it 🤷

Not because I think they're gonna do THAT, but literally other versions of this happened like 10 years ago with kids emailing grandparents. Google caught the kid was underage, locked the accounts down, etc. 🤷
1
0
23
Dropbox, Proton, even iCloud are better and safer options for storage. Google is too big and messy and hackable. I store things locally and on a jump drive, then backup elsewhere (but not Google!)
1
0
2
I suspect iCloud would have the same problem.
1
0
2
Not to sound like a old man but my god this young generation is fucked 😆😳
0
0
1
That's what happens when you entrust your data to a cloud.
At the very least, make your own backups.
1
0
9
Backups help, but the real fix is not putting it there in the first place. With Meos I kept the intelligence on the phone itself. Cloud is just a stateless pipe when you need it, processes and forgets. Your data, your device.
1
0
2
My main question is, why was EVERYTHING on google and nowhere else
0
0
3
Maybe we should all rethink storing vital documents on free Google accounts 😐
1
0
29
I don’t. I have them local only and backed up to local storage. None of that shit belongs in the cloud, regardless of how convenient it sounds.
1
0
10
April Fools, right?

RIGHT?
0
0
6
This is a pretty easy case IMO - sue Google for their AI being willing to do that, for refusing to make their AI bound to the parental conditions, and just let Google know you'll be willing to settle the suit in full for them fixing those issues and relinquishing your accounts and data.
0
0
11
As extreme a situation as this is, it's perfect example of why you shouldn't tie every aspect of your life to a digital account. One fuck up, hack, or server loss and you're up shit creek without a paddle. This guy should have had back-ups, both digital and paper, especially for his business.
0
0
1
That kid is very accidentally a hero
0
0
2
When I was 14 I had to sit through 40 minutes of untranslated Italian movies on CFMT for a five-second tit flash
1
0
8
and you were grateful.
1
0
1
people like 'oh that can't possibly happen these are separate accounts' i dunno about other parents but my experience has been parental control and granularity is way fucking more complicated than it needs to be and I'm still trying to find decent solutions that don't involve a linux based firewall
1
0
31
Every time my kid gets logged out of Minecraft it’s an all night process finagling the stupid fucking google family accounts to let them back in so i completely believe this. People without kids have no idea how fucking horribly designed parental control ecosystems are
0
0
23
Conclusion.

Don't trust Google with your life and your business. Or anything important TBH.
0
0
7
that is one expensive wank! poor kid. he's 14! How was he supposed to know?
0
0
0
The beauty of multiple things comming together to create a very uniquely dumb situation for them. Gemini being able to do erp, it having a camera mode as well as a detection for CSAM material, and a swift procedure that enacts punishment for TOS violations and possbile criminal stuff.
1
0
33
Some real "mom got the cops called on her by whatsapp because she send a picture about how to change their baby to dad" situation
1
0
41
imo sue the fuck out of Google for rolling out a product that engages in erotic roleplay with minors, then retire.
2
0
56
💯
If the Google AI was an actual employee they would have been fired then arrested and later in jail
0
0
4
to be clear this is on google for uh making gemini capable of erotic role play with children, apparently
8
1
1155
Its also on google for deciding to read eveyones private information at every opportunity.

The fact google was looking is the problem here.

The total lack of customer service is the second thing that needs fixing with European legislation.
1
0
37
“The Talk”
❌ birds & bees
✅ dangers of AI
1
0
322
50%, it's on google for using bad algo-based moderation & offering no clear mechanism of appeal or data continuity for individuals which imo is irresponsible when you know folks store their lives there.

it's not (just) a gemini problem, it's gsuite. gemini isn't what they use for moderation.
1
0
58
I don't think we can understate that the father here was:
1. Logged into his private account on the 'family tablet'
2. Had all his business documentation on his personal account
3. Had no backups of those documentations outside of the cloud
1
0
6
it can do this but go ask it to plainly state who won the 2020 election
0
0
3
There is no hole deep enough to throw those "AIs" in. No sun is too hot or too cold to burn them.
1
0
35
Yeah I honestly feel flabbergasted for this person cause like fuck ai but who would ever have expected to get locked out of google sheets cause their kid was erping with an ai???
1
0
84
Surely it could identify this kid as underage before he took his clothes off? Why wasn't Gemini telling not to and turning the camera off?
1
0
18
The strategy deck and the product roadmap are still not the same document.
0
0
0
good reminder not to have all your eggs in one basket and have backups of your stuff (not with the same provider)
0
0
47
The most relatable part of this story is how google is constantly trying to add new mechanisms to advertise to my children and circumventing what little child account management there is.

I got this tablet to run a guitar app and Duolingo (I know). Stop finding new ways for them to access a browser
0
0
32
I’m so glad i don’t have kids.
2
0
18
That aspect of things scares me rotten - how would you guide young people to explore life without getting in too deep with that kind of thing...

It was complicated enough being a teenager in the 80s.

No, I don't have kids either :-)
0
0
3
right now is an extremely bad time to be young. it’s unsafe to be young
0
0
15
Idk I’ve seen to many AI slop Reddit engagement farming posts to believe this
2
0
35
*too
0
0
6
This stuff really happens. Idk about thia specific case, but similar things have happened and will keep happening.
www.theguardian.com/technology/2022/aug/22/google-csam-account-blocked here's a similar case
1
0
5
Oh my god.
0
0
2
Holy shit. O.o
0
0
2
That's one way to learn about backing up your data.

3 copies of your data.
2 different media types.
1 stored off site.
0
0
6
great way to get rid of the service though. ha ha
0
0
2
If you laugh you go to super hell
0
0
3
Takeaway: do not link accounts, do not share devices.
(Also: Fuck Google… but that’s both a given and hard to do practically)
0
0
5
This is nineteen levels of "why you shouldn't have done that".
0
0
5
I love how in my feed this post was immediately followed by this image:
0
0
6
First of all, talk to your kids.

Second, don’t put your entire digital life in the hands of one company that doesn’t even have tech support.
1
0
56
The way the world is these days, a lot of IT companies essentially just resell Google/Amazon/Microsoft services so even if the people you have a contract with have tech support, that doesn't mean *they* do in situations like this!
0
0
27
While it is stupid what the teenager did, pretty sure that little Gemini keeps records of its engagements, but why the hell did his parents kept ALL the important paperwork accessible in just one place, and ONLINE of all places?

The apple didn’t fall far from the tree in that household.
0
0
3
when i was 13 i broke the screen on my netbook because it kept freezing and hid it from my family for over a month. i'm glad the next generation have found ever more creative ways to infuriate their parents with technology
0
0
7
Great reminder to export my drive contents to a hard drive… fuck!!
0
0
2
i know there are points here that matter for seriousness

i'm just lol'ing at the title
0
0
2