Users Keep Creating Thought Assets
AI can produce content, but thought must come from people. Good AI products should help thought happen—not manufacture the appearance that thinking is already done.
AI can produce content, but thought must come from people.
I increasingly believe that AI should have values.
By values, I do not mean that AI should carry its own set of absolute truths above the product and the user. I mean something more direct: AI should always help the user gain a real benefit.
That sounds obvious. It is not.
Eight kilometers in a database are not eight kilometers the user ran
Suppose a user plans to run eight kilometers today.
AI can open the database and enter “eight kilometers” under Today's Exercise. The data has been entered. The task has been completed. From the system's point of view, everything is a success.
But the user did not run.
What benefits the user is not the addition of “eight kilometers” to a database. It is going outside, actually running those eight kilometers, and putting the body through the exercise.
If AI merely enters the number, it has not helped the user reach the goal. It has fabricated the result of reaching it.
This sounds absurd, yet many AI products are doing something similar.
They help users generate something that looks finished without making the thing that ought to happen actually happen. A completed report does not mean the problem was understood. Generated study notes do not mean the knowledge was learned. Organized opinions do not mean the user actually formed a thought.
Completing a task is not the same as benefiting the user.
A good AI should not care only whether the result exists in the database. It should care whether the user received the value behind that result.
The product must ultimately control the AI's values
AI does not need to decide for itself what is absolutely right in life.
The product is what should express values.
A running product should be clear that the real value is the user completing the exercise, not an attractive workout record.
A learning product should be clear that the real value is the user understanding the knowledge, not the generation of a perfectly structured set of notes.
A tool for reading and thought should also be clear: what matters is that the user forms thoughts, not that the system produces great quantities of text that appear thoughtful.
A product must answer one question:
What should the user truly gain here?
The answer determines what AI should do. It also determines what AI should not do.
Without this value judgment, AI will readily mistake whatever can be measured, entered, or generated for the final goal. It will treat metrics as results, records as experiences, and content as thought.
So when I say that “AI should have values,” what I mean more precisely is that AI products must have values.
The product should direct the AI toward helping things that genuinely benefit the user happen—not toward manufacturing the appearance that they have already happened.
Producing content and producing thought are not the same thing
Start with that larger premise, then consider thought.
AI can, of course, produce content.
It can generate a paragraph, a summary, an article, or a point of view. It can even deliver judgments that seem remarkably deep. It can bring material from different fields together and find relationships people had not noticed before.
But producing content and producing thought are not the same thing.
A thought is not a piece of language or a neatly formatted conclusion.
Thought comes from a person's experience, questions, circumstances, choices, and judgment. It means that someone has truly noticed something, truly believes or opposes something, and is willing to take responsibility for that judgment.
If the user never goes through this process and merely accepts the view AI has already written, then however beautiful the words may be, they remain content delivered by AI—not a thought formed by the user.
I want to reserve the word “thought” for people.
AI can supply material, propose possible answers, and help work through an argument. But thought must actually happen inside a person.
Just as eight kilometers in a database cannot replace the eight kilometers a user runs, a profound paragraph generated by AI cannot replace the act of thinking.
Reading is where thought happens naturally
The value of reading has never been merely the transfer of an author's knowledge into a reader's brain.
Reading is a collision between thoughts.
The author brings a body of thought already formed. The reader enters the book carrying personal experience, questions, professional knowledge, and present circumstances. When the two meet, the reader may receive or criticize, agree or doubt, make a connection within a field or carry an idea across fields.
Every one of these interactions can produce new thought.
We often speak of standing on the shoulders of giants. This does not mean that the reader is necessarily greater than the author. It means that an existing thought has entered a new situation. The reader sees it again from a new position, giving it the chance to grow another layer higher.
A book may be finished, but its thought has not stopped.
When a new reader enters it with new questions, thought continues to happen.
Reading is therefore, by nature, a process of creating thought assets.
An excerpt is only raw material. What matters is why the reader marked that sentence, what it brought to mind, where the reader agrees or objects, and how it connects with past experience, present work, and other books.
Those are the thought assets that truly belong to the user.
A good AI tool should first help thought happen
If thought should come from people, then the goal of an AI tool should not be to produce a seemingly complete thought for the user as quickly as possible.
It should first help thought happen.
It can ask a question:
“Why did you stop here?”
“Do you agree with the author's judgment?”
“How does this conflict with the book you read before?”
“What would happen if you applied this idea to your work today?”
AI can offer another point of view, expose a contradiction, or draw attention to an overlooked assumption. It can even deliberately resist summarizing too soon and let the user think a little longer.
Then it must catch the thoughts that are still incomplete, perhaps even confused.
When people form thoughts, they rarely produce a perfectly structured essay on the first try. More often there is only a sentence, a question, a small discomfort, or a connection that appeared without warning.
The tool should not reject these things for being incomplete.
It should preserve them first and help organize them afterward.
I believe AI has five roles in the process of thought:
Provoke, catch, organize, examine, and deliver.
First, provoke thought in the user.
Then catch the thoughts as they happen.
Help organize those fragments into excerpts, reflections, questions, judgments, and subjects worth further investigation.
Examine the evidence, logic, omissions, and conflicts among the thoughts.
Finally, carry those thoughts into articles, research, decisions, tasks, and real action.
But this order cannot be reversed.
Human thought must happen first. AI's processing comes afterward.
A second brain must not replace the first
People often call AI a “second brain.”
I have no problem with the phrase, on one condition: the second brain must not cause the first to stop working.
If a tool makes its users less and less likely to think, it is not a good tool for thought—however much content it stores, however many articles it generates, and however many tasks it completes.
The real purpose of a second brain is to help the first brain work better.
It can take on memory, organization, examination, and repetitive processing. It cannot quietly take over the user's judgment. It should distinguish the author's words from the user's thoughts and both from explanations AI has merely proposed.
It should also return the organized result to the user to be read, reviewed, and revised again.
Thought is not completed in a single generation.
It needs to come back repeatedly—to collide, change, and grow.
We do not want users merely to look thoughtful
We are not building a product that manufactures great quantities of text to make users look thoughtful.
Nor do we want users to open a knowledge base and find it full of AI-generated content to which they have no real connection.
That would be like a database recording countless eight-kilometer runs that the user never actually ran.
We want to help users truly form thoughts.
While a user reads, Coreader stays alongside them, provokes questions, catches ideas, and preserves the book, passage, and context in which a thought began.
AI can then continue to organize, examine, and process those thoughts. According to goals set by the user, an Agent can keep comparing books, track a question, carry out scheduled tasks, and return new results to the user.
But no matter how much AI does, thought still begins in a person.
The Agent maintains and processes thought assets. It does not own them.
What we ultimately want to create is this process:
Users keep creating thought assets. Guided by goals they set, Agents continuously examine, process, and deliver them, allowing knowledge to keep growing and enter real use.
The most important word here is not Agent. It is not automation.
It is users continuously creating thought assets.
A good running tool should not make users look as if they ran eight kilometers. It should help them actually run eight kilometers.
In the same way, a good tool for thought should not make users look as if they have many thoughts. It should help them truly think.
Continue reading
Recommended next
The Nature of Reading Has Not Changed in the Age of AI
AI does not make reading obsolete. It makes deep reading more necessary.
Read next essayMemory, Knowledge, Logic: What AI Really Changes
AI matters because it scales three powers at once: memory, knowledge, and logic.
Read next essay