WELCOMEWELCOME

GPT-5: Lessons in Designerly Experimentation

When GPT-5 stumbled out of the gate a week ago, many said it was a failure. I saw a case study in experimentation at scale.

→ System 1 and System 2 thinking models, automatically selected. But it broke, making GPT-5 look dumber than GPT-4o.

→ Old models made a comeback. Users wanted the option to switch. And their older familiar models that worked.

→ The interface is changing to show which model is answering you: fast bot or the deep thinker.

You can’t innovate without a little public trial and error.

The takeaway for designers?

  • Ship the thing.
  • Watch how it behaves in the wild.
  • Learn faster than you break.

Experimentation isn’t about being 100% right the first time, but it’s about iterating so you’re less wrong the next time.

That’s how GPT-5 (and our own projects) get better.

 

PROMPTPROMPT

Experimentation Prompts

Here are three designerly experimentation prompts: one to try by yourself, one with others and the third with AI:

By Yourself: Stop polishing. Start learning.

Pick one idea you’ve been overthinking. In 24 hrs, make the smallest version possible.

Capture:

  • What you made
  • What surprised you
  • One takeaway

With Others: See your problem from someone else's perspective.

Choose a stuck problem. For 90 mins, swap roles: designers → PMs, PMs → users, etc. Prototype fast, then share:

  • New questions?
  • New perspectives?

With AI: Let the machine plan your mess.

“I’m exploring [describe idea, audience, and goal]. My main assumption is: [state it clearly, e.g., ‘small business owners want AI-generated social media posts’]. List 5 quick experiments (max 2 hrs, <$20) to validate or challenge this assumption. Format: Name (catchy), Steps (3–4 bullets), Expected learning (clear insight) Include at least 1 experiment that would disprove my assumption if the results are negative.”

 

PEOPLE FIRSTPEOPLE FIRST

CURIOSITYCURIOSITY

EMPATHYEMPATHY

VISUAL COMMUNICATIONVISUAL COMMUNICATION


UXUX

UNTIL NEXT TIMEUNTIL NEXT TIME

Did you enjoy this issue of Being Designerly? Will you share it with a friend or co-worker? It’s a simple yet helpful way to support this labor of love.

I love your thoughts, suggestions and feedback, positive or negative—just reply or email me at lycerejo (at) gmail.com - thank you!