AI SIGNAL · COMPLETE DAILY EDITION

Work + societyAugust 28, 2026

AI can improve the answer you grade while leaving other qualities unmeasured

A randomized student experiment suggests that AI-assisted work can score better on a conventional rubric while reasoning, originality, and retained skill stay outside that measurement.

TODAY'S SIGNAL

In a randomized experiment with 1,053 first-year Bocconi students, GPT-4o access improved scores on a short marketing recommendation. A separate causal-reasoning exercise produced more diverse ideas. The study's own summary says final-answer-only evaluation reveals less about actual understanding.

The useful business signal is about measurement, not whether AI is “good” or “bad” for thinking. If a review process rewards polish, completeness, and similarity to an expected answer, AI-assisted work can look better on that rubric while originality, reasoning, and retained skill remain largely invisible.

For teams using AI, the practical question is: what evidence should accompany the output? Depending on the work, that might include assumptions, alternatives considered, failure conditions, or a brief explanation of why the answer should hold. The goal is not to add paperwork everywhere. It is to make the evaluation reflect the quality the organization actually needs.

The boundary matters: this is an August 2026 working paper, affiliated with OpenAI, using one university and one 180-word merchandising task. It does not show that ChatGPT improves workplace performance, weakens thinking, or changes long-term learning.

Weekly article lead: If AI makes the answer look better, how will we know whether the work got better too?

Deep Listening: No selection this week.

The honest limit

This working paper studies one university and one short task; it does not show workplace performance, weakened thinking, or long-term learning effects.

WHAT TO WATCH

Replications in professional settings, delayed learning measures, and evaluation systems that separately score answer quality, reasoning, and originality.

Pilot boundary: Public prototype review copy only. It is not professional advice or an approved service offering.