Content hallucination limits redesign agents

Diving deeper into

UX lead at real estate firm on running a website redesign with Claude Cowork

Interview
The bigger issue was content hallucination.
Analyzed 3 sources

Content hallucination is the real limit on using agents for production redesign work, because the failure is not ugly output, it is polished output that quietly invents facts, copy, or assets. In this workflow, the designer could get usable layouts and code quickly, but every public facing section still needed line by line checking against the live site, especially on investor, governance, legal, and executive pages where one wrong sentence or missing image creates real review risk.

  • The concrete problem was not just wording drift. The system generated numbers and text that looked company approved but did not exist in any internal source, and it also swapped some executive photos for generic initial placeholders until each image was manually mapped.
  • This matches a broader agent pattern. In multi tool workflows, wrong or missing information often gets passed forward instead of being flagged, so teams add stricter specs, review gates, and explicit source of truth documents before trusting the output.
  • The practical fix is to turn creativity off at the content layer while keeping it on for structure and styling. Teams are moving toward context packets, canonical docs, proof links, and rubric style checks so the agent can redesign presentation without rewriting facts.

The next step in these workflows is not better mockups, it is better provenance. The winning tools will show exactly which sentence, number, image, or claim came from which approved source, so teams can let agents handle more of the build while keeping brand, legal, and factual control intact.