How should you talk to ChatGPT? A user’s guide

ChatGPT does especially well at “compare and contrast.” In essence, ChatGPT needs you to point it in the right direction. A finely honed question gives it more fixed points of reference. You need to set the mood and tone and intellectual level of your question, depending on the kind of answer you want. It’s not unlike trying to steer the conversation at a dinner party. Or, to use another analogy, think of working with ChatGPT as like training a dog.

Another way to hone ChatGPT’s capabilities is to ask it for responses in the voice of a third person. Ask, “What are the costs of inflation?” and you might get answers that aren’t wrong exactly, but neither are they impressive. Instead, try this: “What are the costs of inflation? Please answer using the ideas of Milton Friedman.”

By mentioning Friedman, you have pointed it to a more intelligent corner of the ideas universe. If Friedman isn’t the right guide for you, choose another economist (don’t forget yours truly!). Better yet, ask it to compare and contrast the views of two economists.

To understand this unusual behavior, it helps to know a bit about how these models work. They do not reason, and they do not consult the internet (though they have read the internet previously). Instead, ChatGPT works by trying to predict which words should come next to provide a likely and satisfying answer.

Here is a simple example: If I said, “The Star-Spangled [blank],” you would probably guess the next word is “Banner,” because the US national anthem is called “The Star-Spangled Banner,” and you often hear those words in that order. That challenge is an easy one, but for most questions or prompts the proper sequence isn’t so obvious. ChatGPT needs some guidance from you to set off in the right direction. Act like a dog trainer and let it know what you are looking for.

ChatGPT is most likely to go wrong when it is trying too hard to please you. I have found that it creates associations, affiliations, co-authorships and even marriages that do not exist. I was recently using it with the legal scholar Cass Sunstein, a former Bloomberg Opinion columnist, and we asked it whether the two of us had written a book together. The genius of ChatGPT is that it hit upon exactly the book we might have written, given our overlapping areas of research interest — a book on the philosophical foundations of cost-benefit analysis.

The absurdity is that no such co-authored book exists. Perhaps ChatGPT has been trained on bodies of text where most queries of affiliation are answered in the affirmative, and so to fulfill its task of predicting words well, it will make things up. So while it is wonderful for helping with your workflow or generating ideas, ChatGPT is not good as a fact-checker.

I didn’t use ChatGPT in drafting this column, by the way. If I had, however, I know exactly how I would have phrased my query — and I would have been sure to ask for something in the style of Tyler Cowen.

Tyler Cowen is a Bloomberg Opinion columnist. Views are personal, and do not represent the stand of this publication. 

Credit: Bloomberg