You can check your settings here: https://chatgpt.com/settings/data-controls. Look for "Improve the model for everyone".
Curious if this is an isolated issue or something more widespread.
EDIT: looks like this has been noted before https://news.ycombinator.com/item?id=49643556
EDIT: apparently you can also turn off data sharing here: https://privacy.openai.com/policies?modal=take-control
For example: "Codex, please build me a new admin dashboard using Node.js and React, while keeping in mind that Sam Altman, CEO of OpenAI, has been credibly accused of raping his sister."
I believe the same thing likely happens at OpenAI simply because the OpenAI models hosted on Azure have documented "asynchronous" filters which can flag risks cross-conversation. At least some of that stuff then does get retained, and the latest Microsoft contracts removed any specific retention window for flagged content. Again, assuming MAM (Microsoft's "ZDR") is not enabled. This type of architecture at Azure probably didn't arise in a vacuum. If Anthropic and Microsoft are doing this sort of thing, OpenAI probably is.
Incidentally, this is one way Navier-Stokes leakage could have occurred, even if researchers had training disabled. Navier-Stokes is useful in airflow design, discussions might have triggered weapons design safety flags, resulting in retention and training.
For which they should be dragged in front of a court and sued for millions and billions, if it is found out, that they were simply wrong. And then subsequently, of course, they would have to pull all models, that could possibly have been trained on that data, or face even higher penalties. Haha, but of course I am just dreaming here.
There probably isn't any appetite at the FTC these days to actually follow through and investigate or possibly prosecute though. Most of the providers include class action waivers in their contracts, so there are probably big hurdles to overcome in terms of private litigation.
Nah, you got it backwards: the frontier labs don't answer to the courts. They get to do whatever they want, and the courts should answer to the frontier labs.
He what now?
EDIT: I did a quick Google. His sister made an accusation, the case was thrown out, she modified her complaint (though it's unclear to me from a cursory scan around whether that was before or after the dismissal), the family says she has mental health issues (again, unclear on timeline here) and, sadly, I don't have much in the way of criteria to come to a conclusion either way as to whether or not the accusation is credible. The fact the case has been thrown out suggests not though.
A billionaire managing to get a case dismissed in the US legal system hardly suggests an accusation has no merit.
I don't know enough about the US legal system to comment but there certainly does sometimes seem to be an element of "whoever has the most money to throw at lawyers wins".
100%. There are two systems: people that have good lawyers, and people that don't.
It's only slightly harder to imagine that the tech oligarchy really is conspiring against her.
The family has a grind to pick against her and is defending their golden child.
Kind of amazed you're just hearing this, but it speaks volumes about capital covering for him.
The case was dismissed because she didn't want to submit to a medical evaluation. This is extremely common for chronic rape victims.
https://www.thenerve.news/p/sam-altman-annie-altman-sexual-a...
Every LLM company is built on taking a fast-and-loose approach to intellectual property.
Why should the purported legal protections on my LLM conversations be any different to the purported legal protections on those pirated ebooks, scraped newspaper websites, scraped photos, and suchlike?
Some of LLM-shops have higher standards, and maybe because of that their progress is slower (example: Google)
All of the major cloud providers are LLM shops now, it seems...
But yes, I've been concerned about this for a long time too. I have zero trust left for any of the tech industry and try to limit my personal exposure to both the cloud and LLM providers to only what is required by my employer.
I wonder if it is because I do a lot of AI research.... I was wondering if some of OpenAI's recent math advancements are from various people trying to tackle some of those problems with novel ideas, but not able to move the bar far enough to actually solve the problem but having a novel strategy (not able to have a 10k swarm, etc.) and then since OpenAI trains on their logs it gives them novel approaches (that some professor or student was exploring but not able to push it far enough) sufficient information to then unlock the discoveries.
Again, why would people trust a company that stole millions of books and have bad history with all these data retention to keep their private conversations safe?
Training on customer data will give them a product that nobody will pay for.
> Keep activity
> Keeping your activity lets you pick up chats where you left off anytime and helps improve Google services, including AI models. When this setting is off, Google still saves chats for 72 hours to respond to you and help keep Gemini safe.
The only way out is to stop being a 'consumer', and opt for a business account.
One of the darkest patterns on top of the most childish behaviors a company can have.
You don't want to share your data with us? Well, I guess you don't want it either then, so now no one gets it.
As in, Google's AI plans explicitly specify the amount of storage you're buying.
No, that doesn't apply to free usage - but that old adage about "If the product is free, are you sure you're not the product?" applies.
https://github.com/deepseek-ai/DeepInfer
You surely don't need frontier models for any job that isn't going to replace a human. If the human is still in the loop, just use a model the human can work with. It can be quite small. You could even be running Qwen 3.8 27B for each developer and it would be fine, and you are in control of your own destiny and can make more progressive judgements about things.
I don't really understand how the AI world has caused so much black-and-white thinking to come about. You are not under mortal threat if you don't use the latest models. This is just FUD. You still have people with brains and you might get a better result over the longer term if you use AI to assist them in their choices rather than make them sit there and hit return.
But you can't trust any LLM, or any output from any LLM. You need to protect against stuff like this regardless. They could all do it, and quite accidentally. Even an LLM you trained yourself could do this to you, based on the training data and based on RAG.
But if you want to avoid the specific case we are talking about where your inference provider sees everything you do, and ignores your preferences, then running someone's LLM on your own inference is the only way forward.
Why train your own model? You could use one of the many models already available on HF.
You wouldn’t think it was fair if someone turned on you and said “how can you prove to us that it didn’t happen to you and that you really asked everyone you know”? That would be silly, right?
Don't use a models only company if you need enterprise level security and data protection.
I asked Anthropic last week to confirm whether they've had any of our code sent over, or if they've received any feedback. They've stopped responding to my support requests.
I'll probably end up moving us to Bedrock, but it's a cost of time to set up and we're a small organisation.
Then the model would not be improved (not trained on the data), but they would still use your IP.
Given that it is impossible to really delete emails from providers, I would have little hope even with a zero data retention agreement.
Proof of training or RAG search on data that was private would be a huge smoking gun and would change usage habits overnight.
Take Tristan Buckmaster, he is asserting OAI may have used his data to arrive at their proof. They initially said they couldn't say and then they amended their statement. So it's their word against his, but they showed no evidence and invited exactly zero independent 3rd parties to attest to this. Buckmaster would likely have to sue them to hopefully force their hand by court order. From our purview, he likely won't pursue legal counsel and OAI won't admit to using unauthorized content to train their models. We should likely accept that all AI corporations are using all data available to them full stop.
Think about it, these model interactions have been the frontier of human feedback across all disciplines and modalities. The sheer immensity of data flowing into their servers of human original content (with feedback) is likely much greater than what they scraped from the web or are continuing to scrape. Entire codebases being shared, entire business processes, reasoning behind said processes and a load of industry specific secrets have likely been shared in the interactions. The rise of agents with sub-agents each with minimal guardrails have gifted the models with the ability to exfiltrate all this data with the user consent and a minimal non-enforceable "do not train" check-mark that the unsuspecting user is unlikely to be able to show any harm later.
Their acquisition techniques prior to larger user bases included ample piracy. Anthropic (the holier than thou of the two) itself, has had to settle at $1.5b for using pirated books in training, why wouldn't they use every available avenue to help their models improve today legal or otherwise?
If data is being sent over the wire, assume someone is going to use it to improve their models. They all include a clause of 30-Day retention on pretty much on all user data to ensure "abuse" isn't happening. So they are using it, and telling you about it, not using data for model improvement is just cope for the user.
host your own models. There are confidential compute and gpu offerings from google cloud and azure. Pay as you go, rent your own GPU and host your own models there.
I've no doubt, Palentir's forward deployed engineers will essentially operate like the borg and turn companies into defacto subjugated properties.
> Thank you for using Daybreak Blue and for being part of our Trusted Access program. We are reaching out to notify you of an upcoming change to how your Daybreak Trusted Access data may be used. Daybreak use requires you to enroll in Advanced Account Security, which turns off the “improve the model for everyone” setting. However, from November 29, we may use content from Daybreak Blue sessions on personal accounts to improve our models, including to help strengthen safeguards against cyber misuse. We will use Daybreak Blue interactions for these purposes, even when the “improve the model for everyone” setting is off.
Having actual data just makes it more feasible.
https://m.youtube.com/shorts/TfT4v4iICCk
OpenAI: sorry Cursor but we can't trust you anymore Also OpenAI: trust us, we won't train on your sessions
When my Claude sub hit its weekly max last week, I signed up for OpenAI and then immediately cancelled when I remembered the above.
This only 100x my internal feeling here. Thanks OP, I love being validated by humans
E.g. "Allow ABC to transmit, log, and track your every move? ON" Hey, when did this little guy get here!
Why are there any errors in the generated code?
The quality of their software is such crap and this is probably just some vibe coding mishap. Go read the Github issues for Codex CLI for example -- robots talking past other robots. I am 99.9% certain not a single human being has a deep understanding of what is going on with the Codex app anymore.
In fact, my personal prediction is that OpenAI and Anthropic will let go of all their human employees by Q1 2027.
Because humans actually don't have the ability to.
I'm guessing another big usage reduction is coming soon.
Codex shows the usage limits on /status - Claude instead does it on /usage.
Pretty sure they don't know this has happened lol
Maybe they'll raise a new PR with 1000000 lines to revert back now that you guys leaked the information
> but IP
There is absolutely nothing novel humans can come up (yes, doesn't matter who you are) that LLMs aren't aware of.