Category: Maestro

Maestro: Design Solution - Honorable Mention

Two honorable mentions were Naming & Branding and UI Design. None of the LLM or generative models are great at this. Figma did attempt to create flow charts so it’s possible a different tool set may need to be field tested.

Continue Reading…
Category: Maestro

Maestro: Design Solution - Results (Meta AI Lama 3)

Meta AI Lama 3

Design Report Card

Technical Report Card

Continue Reading…
Category: Maestro

Maestro: Design Solution - Results (CoPilot)

CoPilot

Design Report Card

Technical Report Card

Continue Reading…
Category: Maestro

Maestro: Design Solution - Results (Gemini)

Gemini

Design Report Card

Technical Report Card

Continue Reading…
Category: Maestro

Maestro: Design Solution - Results (ChatGPT 3.5)

ChatGPT 3.5

Design Report Card

Technical Report Card

Continue Reading…
Category: Maestro

Maestro: Design Solution - Results (Claude 3 Sonnet)

Claude 3 Sonnet

Design Report Card

Technical Report Card

Continue Reading…
Category: Maestro

Maestro: Design Solution - Human Baseline

I ran through a human powered excercise in both product and technical design. Here are my brief notes.

Continue Reading…
Category: Maestro

Maestro: Design Solution

Findings

Much like my prior experiment with first principles reasoning, LLMs aren’t sophisticated enough to provide granular enough product and architectural design to be immediately actionable by a development team.

While I anticipate that eventually LLM tools could be useful enough to assist in product and engineering tasks, it still requires a human to design something that is ubiquitous, intuitive, scalable, and secure.

Bottom line: don’t spend a lot of time bouncing ideas off the major models, and certainly don’t believe the hype that these tools can magically produce GOOD software with a few AI prompts.

Continue Reading…