Talk:OpenAI o1

This is the talk page for discussing improvements to the OpenAI o1 article.
This is not a forum for general discussion of the article's subject.

Put new text under old text. Click here to start a new topic.
New to Wikipedia? Welcome! Learn to edit; get help.

Article policies

Find sources: Google (books · news · scholar · free images · WP refs) · FENS · JSTOR · TWL

This page is not a forum for general discussion about ChatGPT. Any such comments may be removed or refactored. Please limit discussion to improvement of this article. You may wish to ask factual questions about ChatGPT at the Reference desk.

Technology

This article is within the scope of WikiProject Technology, a collaborative effort to improve the coverage of technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.TechnologyWikipedia:WikiProject TechnologyTemplate:WikiProject TechnologyTechnology

Linguistics: Applied Linguistics Mid‑importance

	Linguistics portal This article is within the scope of WikiProject Linguistics, a collaborative effort to improve the coverage of linguistics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.LinguisticsWikipedia:WikiProject LinguisticsTemplate:WikiProject LinguisticsLinguistics
Mid	This article has been rated as Mid-importance on the project's importance scale.
	This article is supported by Applied Linguistics Task Force.

Robotics Mid‑importance

	This article is within the scope of WikiProject Robotics, a collaborative effort to improve the coverage of Robotics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.RoboticsWikipedia:WikiProject RoboticsTemplate:WikiProject RoboticsRobotics
Mid	This article has been rated as Mid-importance on the project's importance scale.

Computing: Software / CompSci Mid‑importance

This article is within the scope of WikiProject Computing, a collaborative effort to improve the coverage of computers, computing, and information technology on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.ComputingWikipedia:WikiProject ComputingTemplate:WikiProject ComputingComputing

Mid

This article has been rated as Mid-importance on the project's importance scale.

This article is supported by WikiProject Software (assessed as Mid-importance).

This article is supported by WikiProject Computer science (assessed as Mid-importance).

An editor has requested that an image or photograph be added to this article.

Things you can help WikiProject Computer science with:

Here are some tasks awaiting attention:

Article requests :
- Requested articles/Applied arts and sciences/Computer science, computing, and Internet
Cleanup :
- Computer science articles needing attention
- Computer science articles needing expert attention
Copyedit :
- Computing
Expand :
- Computer science
Infobox :
- Computer science articles without infoboxes
Maintain :
- Timeline of computing 2020–present
Photo :
- Find pictures for the biographies of computer scientists (see List of computer scientists)
- Computing articles needing images
Stubs :
- Computer science stubs
Unreferenced :
- WikiProject Computer science/Unreferenced BLPs
Project-related :
- Tag all relevant articles in Category:Computer science and sub-categories with {{WikiProject Computer science}}

Artificial Intelligence

This article is within the scope of WikiProject Artificial Intelligence, a collaborative effort to improve the coverage of Artificial intelligence on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.Artificial IntelligenceWikipedia:WikiProject Artificial IntelligenceTemplate:WikiProject Artificial IntelligenceArtificial Intelligence

Requested move 14 September 2024

The following is a closed discussion of a requested move. Please do not modify it. Subsequent comments should be made in a new section on the talk page. Editors desiring to contest the closing decision should consider a move review after discussing it on the closer's talk page. No further edits should be made to this discussion.

The result of the move request was: Page moved (everyone support). (non-admin closure) 1250metersdeep (talk) 17:20, 20 September 2024 (UTC)[reply]

O1 (generative pre-trained transformer) → OpenAI o1 – The official name, as announced by OpenAI on their website, is "OpenAI o1", and it's also shorter than the current title Alenoach (talk) 23:19, 14 September 2024 (UTC)[reply]

Support per WP:CONCISE and WP:NATDAB. Arnav Bhate (talk • contribs) 13:48, 15 September 2024 (UTC)[reply]

It's like they actively tried to come up with the worst name possible.

People will get it confused with OpenAI the company so I think OpenAI o1 (GPT) maybe? Or Orion-1? The Mining Pickaxe (talk) 16:02, 15 September 2024 (UTC)[reply]

The name "Orion" isn't widely used, so I would avoid that. The title "OpenAI o1 (GPT)" is a bit more explicit, but it doesn't look very clean. By the way, I guess we can continue to use "o1" instead of "OpenAI o1" in the rest of the article, newspapers seem to do that also. Alenoach (talk) 23:17, 15 September 2024 (UTC)[reply]

You right. As much as it pisses me off to say this, OpenAI o1 is really the only reasonable name for this article. :argh: The Mining Pickaxe (talk) 01:03, 16 September 2024 (UTC)[reply]

Support per above. PuppyMonkey (talk) 18:44, 16 September 2024 (UTC)[reply]

Support, this is the name everyone calls it, and it would be the best name for this article. 1250metersdeep (talk) 01:17, 18 September 2024 (UTC)[reply]

Support per WP:CONCISE. RodRabelo7 (talk) 00:42, 20 September 2024 (UTC)[reply]

The discussion above is closed. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.

Isn't Strawberry the name of the training algorithm?

Thought Strawberry is the name of the new training algorithm that is precisely not normal reinforcement learning, because RL tends to make the model answers converge on certain path, while Strawberry generates a model with a property they call diverse in the sense, that it generates a hole spectrum of path instead of converging onto one only. This spectrum, multi-angle thinking then makes models trained with Strawberry much better suitable for Chain of Thought / Autonomous agent kinds of prompting techniques.

Of course all of this is just rumors, bits&pieces because we are at a point where market dominance and monopoly desires lead to a situation where the research itself is not published to benefit humanity, like in basically all science before. A tragedy 2A00:20:6045:EA22:1068:4F19:6E53:4C33 (talk) 21:02, 26 September 2024 (UTC)[reply]

Hi, I think that strawberry is the name of the model o1 itself rather than the training algorithm, as said for example here.[1] OpenAI gives limited details about how it works. We know that reinforcement learning is being used (possibly among other techniques), OpenAI said it itself.[2]

If I understand correctly: It was notably trained on many problems that have a known correct answer. It generates long chain of thoughts with a high "temperature" (i.e. creativity), and the chain-of-thoughts that get to the good result (and that are estimated by another model to follow good reasoning steps) are rewarded. But if no reliable source precisely explains how it works, I would avoid speculating inside the article. Alenoach (talk) 22:20, 26 September 2024 (UTC)[reply]