OpenAI Now Thinks With Images

In partnership with

In today’s Newsletter

1. OpenAI Thinks with Images

2. 9 AI tools you must use in 2025

3. AI & Tech News
   

OpenAI's new models, o3 and o4-mini, can now think using images (Source)

Earlier models just recognized images. o3 and o4-mini can now reason with them—meaning they:

• Zoom, crop, rotate, or enhance images automatically.

• Use these transformations as part of their internal thought process.

• Perform this without using any external tools or separate models.

 What Can It Do?

These models can:

• Read handwritten notes (even if they’re upside down).

• Solve complex math or physics problems from photos.

• Analyze signs, diagrams, schedules, or charts with multiple elements.

• Spot issues in code or images you upload (like bugs or errors).

Real-World Examples

• Handwriting Recognition: If you take a photo of a notebook, it can rotate and read the note

•  Physics Diagram: It can analyze a QED Feynman diagram, identify particles, zoom in, and give a complete explanation of what’s happening.

• Messy Screenshots: It can still reason clearly, even if there are multiple objects, poor lighting, or things are out of place.

Presented by The Rundown AI

Learn AI in 5 minutes a day

This is the easiest way for a busy person wanting to learn AI in as little time as possible:

1. Sign up for The Rundown AI newsletter

2. They send you 5-minute email updates on the latest AI news and how to use it

3. You learn how to become 2x more productive by leveraging AI

Sign up to start learning.