OpenAI’s Codex, as obvious by means of the identify, is a device that is basically constructed for… builders. It is designed to jot down code, repair insects, overview pull requests, can help you construct gear and automations, and deal with the type of repetitive engineering paintings that eats into deep focal point time. It competes with gear like anti, Google’s AI Studio and Antigravity, OpenCode, and others.
And whilst vibe coding is not one thing that is restricted simply to the area of interest developer group and those that would’ve in the past by no means touched a line of code were development truly spectacular gear, those gear have all the time been one thing you open with a particular purpose: to construct one thing. Whether or not you are a seasoned developer or anyone who simply found out vibe coding ultimate week, you open Codex, Claude Code, or Cursor as a result of you will have a venture in thoughts. The start line is all the time code. However OpenAI’s newest updates to Codex really feel like a departure from that.
Codex can do extra than simply write code
And OpenAI needs you to realize it
A couple of days in the past, I wrote a piece of writing about a couple of techniques I have been the use of Claude Code for non-coding use circumstances. With Claude Code regardless that, it felt extra like I used to be discovering ingenious workarounds: pushing a coding instrument into territory it wasn’t in reality designed for. Codex, alternatively, appears to be natively development that territory in. For those who do a handy guide a rough look on the fresh options the group has added to Codex (and even undergo their posts on X), you’ll be able to see that the frenzy past coding is not in reality unintended.
For example, considered one of their most up-to-date weblog posts was once titled Codex for nearly the whole lot. This text goes to concentrate on what was once introduced in that weblog, however the identify by myself tells you the whole lot you want to find out about the place OpenAI is taking this. So, it is transparent from the best way they are speaking about Codex that OpenAI does not see it as only a coding instrument anymore.
Codex can now see and regulate your display screen
It now has its personal cursor
The primary primary replace Codex were given is background pc use. Codex can now perform graphical person interfaces on macOS and carry out duties like clicking buttons, typing into fields, navigating apps, and interacting with gear. Codex does this the use of its personal cursor that runs independently from yours. This selection is lately to be had simplest on macOS, and is not to be had in the UK, Switzerland, or the Ecu Financial Space. OpenAI says this turns out to be useful for iterating on frontend adjustments, trying out apps, or operating in gear that do not disclose an API, however it is simple to peer how this extends way past developer workflows.
If Codex can navigate any app for your Mac, there may be not anything preventing it from managing spreadsheets, organizing recordsdata, or dealing with admin paintings that has not anything to do with code. You’ll be able to ask it to do a couple of issues without delay, too. A couple of brokers can run in parallel for your Mac, every dealing with a unique job, with out interfering with no matter you are doing. If truth be told, Sam Altman explicitly suggested other people on X to take a look at out pc use for non-coding duties. You’ll be able to use it for extremely easy issues too, like skipping to the following music on Spotify, or migrating data from a document to a spreadsheet proper in entrance of you. Principally, you’ll get Codex to do anything else for your pc that you would in most cases do your self with a mouse and keyboard.
Inside the similar submit, OpenAI additionally introduced that Codex now has a integrated browser the place you’ll open pages, remark at once on what you are seeing, and ask Codex to make adjustments in keeping with your comments. It is restricted to native and public pages for now, regardless that. That mentioned, this option is extra developer-focused, so I would possibly not get into it an excessive amount of right here. On the other hand, it is value noting that OpenAI has mentioned they plan to extend it past localhost over the years, which might make it much more fascinating for normal use.
Codex now has 90+ plugins and will time table its personal paintings
A tip I am continuously giving other people is to start connecting AI gear to the apps and services and products they already use. AI labs are leaning into this concept beautiful closely, and OpenAI isn’t any exception. The corporate launched over 90 new plugins with the replace above, together with gear like Jira, GitLab, CircleCI, Microsoft Suite, and extra. A extra fascinating replace the instrument has gotten is the facility to time table its personal paintings.
Codex can now set long run duties for itself, get up mechanically, and proceed operating on one thing throughout days or even weeks. It could actually additionally proactively counsel what you must paintings on subsequent by means of pulling context out of your codebase, Google Medical doctors, Slack, Perception, and any hooked up plugins. So as a substitute of you opening Codex and telling it what to do, Codex can open up and inform you what wishes doing. That is a beautiful vital shift.
Codex could also be trying out a characteristic that recollects what you are doing
And it does not want you to inform it anything else
Each the options above are already out, however what in reality stuck my eye is one thing OpenAI is lately trying out inside of Codex known as Chronicle. This selection is lately in opt-in analysis preview, and is simplest to be had for ChatGPT Professional subscribers on macOS. I am at the $20 Plus tier, so I have not been ready to take a look at it myself, however from what OpenAI has shared about it to this point, it feels like probably the most fascinating (but suspicious) additions to Codex but. Chronicle necessarily watches your display screen within the background, takes periodic screenshots, and turns what it sees into structured reminiscences saved as native Markdown recordsdata.
The screenshots themselves are deleted after six hours, however the reminiscences stick round. So the following time you instructed Codex, it already has context about what you’ve gotten been operating on with out you having to provide an explanation for anything else. Now, the privateness issues this option comes with is one thing we’re going to dive into every other day. However once more, it indicators that OpenAI is popping Codex into one thing that understands your workflow as a substitute of simply doing duties for you.
OpenAI explains that Chronicle has been designed to cut back the volume of context you must restate while you start the use of Codex. The characteristic works by means of working sandboxed brokers within the background to generate reminiscences from the display screen photographs, and the corporate stocks that the brokers lately eat charge limits temporarily.
The course Codex is heading in could not be clearer
If all the above does not make the course Codex and OpenAI are heading in transparent, the corporate’s personal phrases must. OpenAI’s remaining line within the weblog submit talks about narrowing the space between what other people can believe and what they are able to construct.
