Skip to content

Computer & browser use in Codex (5 real examples)

How I AI

27m
Transcript

Original podcast

Where to listen

Summary

Written by a model from the transcript; not yet reviewed.

The host explores the practical applications of AI-driven browser and computer use within the Codex desktop app and GPT-5.6 models. Moving past simple chat interfaces, the episode demonstrates how AI can directly control a mouse, keyboard, and browser to perform complex multi-step workflows. Real examples range from technical software development tasks, such as automated usability QA and mobile responsiveness testing, to persona-based product critiques and personal tasks like filtering unread LinkedIn messages and curating clothing sales online.

Listeners get a detailed look at how to leverage browser automation tools like @Browser and @Chrome to reduce personal and professional digital toil. The host shares valuable tips, including the benefit of under-prompting frontier models to let their internal intelligence build testing or shopping plans. By walking through five distinct use cases—including an advanced setup involving iPhone screen mirroring to fix network settings remotely—the episode highlights how letting AI operate software autonomously can save hours of manual effort.

  • Install the ChatGPT or Claude desktop apps along with their official Chrome extensions to enable AI browser and computer control. 3:13
  • Under-prompt frontier AI models when running QA or testing tasks so they can independently create comprehensive plans and edge-case checks. 8:01
  • Combine browser automation with persona prompts to test user experiences from the perspective of different roles like product managers or engineers. 14:05
  • Use the Chrome browser skill to curate shopping carts by specifying size, style, and personal constraints like breastfeeding-friendly clothing. 21:04

Chapters

  1. 0:00
    Intro and Sponsorship

    The host introduces the episode and promotes Runway as a creative AI platform.

  2. 0:49
    What is Browser and Computer Use?

    Explanation of how LLMs can control browsers and computers, and the tools needed.

  3. 1:26
    Setting Up Codex for Browser Use

    Instructions for installing desktop apps and Chrome extensions to enable AI control.

  4. 3:09
    QA Use Case: Onboarding Flow Testing

    Using Codex to automatically test a web app’s onboarding flow for usability and responsiveness.

  5. 4:20
    Persona‑Based Testing Example

    Codex impersonates product manager, engineer, and team leader to critique a product demo.

  6. 5:58
    Automated QA Results and Tracking

    Codex generates a Google Sheet of issues, screenshots, and severity for follow‑up.

  7. 20:47
    Personal Shopping Assistant

    Codex acts as a personal shopper, selecting and adding items to a cart based on user preferences.

  8. 23:47
    LinkedIn Message Automation

    Using browser use to read and reply to unread LinkedIn messages automatically.

  9. 26:50
    Wrap‑Up and Call to Action

    The host summarizes the episode, invites feedback, and provides final thanks and links.

Highlights

Quotes

  • “browser use in this instance is all of that can happen automatically. I can just sit back and watch it go.”
    Unnamed speaker · 6:25
  • “I can definitely write tasks for the frontend. But what I really want to know is, is it usable? Can we use it?”
    Unnamed speaker · 4:56
  • “It actually bubble up edge case bugs that you might not have thought of.”
    Unnamed speaker · 9:58
  • “I just had a baby six months ago. So pick things that are comfortable, that are breastfeeding friendly, and that would be great for the weather in Hawaii in late July.”
    Unnamed speaker · 21:20
  • “Everything is computer, and I really think that this is going to change how we interface with our digital lives.”
    Unnamed speaker · 26:34
  • Runway 0:48–1:43
  • Hyperagent 15:11–16:24

About this episode

Today I’m walking you through one of my absolute favorite AI features right now: browser and computer use via Codex (the ChatGPT desktop app). I use this every single day, personally and professionally, and I wanted to share the specific workflows I’ve built, the moments that surprised me, and the mental model that makes it actually click. What you’ll learn: How browser use and computer use work, and why the Codex desktop app plus Chrome extension is the combo I rely onHow I use Codex to QA my onboarding flow, including exhaustive mobile testing I would never do manuallyWhy under-prompting frontier models gets better results than detailed step-by-step instructionsHow my husband EJ Lawless’s persona-impersonation trick surfaces friction points I can’t see as the builderHow I use browser use to get through my LinkedIn inbox without touching it myselfHow I had Codex shop Free People’s sale and add 10 medium items to my cart (breastfeeding-friendly and Hawaii-ready)How computer use can control iPhone mirroring so your Mac can technically operate your phoneThree more computer-use shortcuts: filling annoying forms, creating Google Sheets mid-workflow, and managing router— Brought to you by: Runway https://runwayml.com/howIAI—The creative AI platform for images, video and more Hyperagent https://hyperagent.com/howiai—Deploy fleets of agents that handle real work — In this episode, we cover: (00:00) Intro (01:46) What browser use and computer use actually are (03:08) Why I use Codex specifically and how the desktop app plus Chrome extension works (04:15) Use case 1: QA testing my onboarding flow (10:41) Results: 11 issues, one high-severity blocker, one Google Sheet with screenshots (12:10) Use case 2: persona testing (18:20) Use case 3: LinkedIn inbox, hands-free (20:37) Use case 4: AI personal shopper (23:47) Rapid-fire uses: forms, iPhone mirroring, router access from out of state, Google Docs (26:50) Wrap-up — Tools referenced: • Codex (ChatGPT desktop app): https://openai.com/codex • Claude desktop app: https://claude.ai/download • Monologue (voice dictation for AI): https://monologue.app https://monologue.app/ • iPhone mirroring (Apple): https://support.apple.com/en-us/111775 • Google Sheets: https://sheets.google.com https://sheets.google.com/ — Other references: • Jesse Genet episode (How I AI): https://www.lennysnewsletter.com/p/5-openclaw-agents-run-my-home-finances?utm_source=publication-search — Where to find Claire Vo: ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo — Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

Transcript

0:00
27:40

4,827 words · 1 speaker

Topics

  • Codex
  • LinkedIn
  • Wi-Fi
  • ChatGPT
  • Claude
  • GPT-5.6
  • Free People
  • iPhone mirroring
  • Mac
  • ChatPRD

Page updated · transcript and summary are machine-generated