Grok

CoPilot

Gemini

ChatGPT 3.5

Claude 3 Sonnet

Prompt

What is it?

The idea of first principals is a powerful problem-solving approach that involves breaking down complex issues into its most basic and fundamental parts.

I’ll use this thought exercise as a first step to challenge assumptions and to unlock a creative solution to our problem. This experiment should demonstrate how capable current LLM is at human style reasoning and problem solving.

Findings

While I think LLMs can be used to generate ideas or compile a list of potential features or technologies, the models aren’t sophisticated enough to understand the context of the problem and how to maximize user value.

This leaves a lot of gaps that humans inevitably need to fill. That’s to be expected. Anyone who has built an app from scratch will tell you that gathering feedback early and often is the best way to create the most useful app.

Novel concepts might be inspired by humans interacting with LLMs, but it’s doubtful it could come up with anything compelling on its own. Could you use LLM as a brainstorming tool, absolutely!