Probably!
Just kidding.
Imagine sitting down to your favorite newspaper and reading a new column with a must-have reading list for summer 2025. Of course, you are excited because you love to read; I mean, that’s why you’re holding a newspaper in this digital era. You pull out your phone to save the books to your Amazon wishlist, only to discover that many of them don’t seem to be available yet. Some of these well-known authors have written titles with similar names, or the author appears to be associated with the wrong book, and even then, the title isn’t quite right. What gives? Does the article’s author have the inside scoop on these forthcoming books?
It turns out that no, it isn’t secret intel; it is made up and created by Artificial Intelligence. (Source)
When AI generates something completely false, it is referred to as a hallucination. It is an apt word. Much like a human seeing something that isn’t real but thinks it is, the generative computer model confidently creates new realities. Ultimately, these hallucinations threaten to warp the actual reality when they are not vetted, cross-referenced, or otherwise edited. Should we avoid the problem and discard the new technology, then? That is what some people think.
One of the issues is that AI can cause a shift in roles. It is just a tool, but it created a situation where an author had to act as an editor. They generated this reading list article, but by having another entity develop a significant portion of the work, their role shifted from just an author to someone who needed to fact-check and refine (aka an editor). AI has the power to transform our roles and open up new possibilities, but if we remain blind to its impact, we will become its servants, not its masters.
All of this got me thinking: how did this happen? Is it more likely for AI to hallucinate these sorts of details than to maintain the truth? I set out to verify if that was accurate, so I loaded up Anthropic’s Claude, OpenAI’s ChatGPT, Google’s Gemini, and xAI’s Grok, all running the latest widely available models.
Sign Up to Get Our Latest Posts Tuesdays and Thursdays
No Spam, Period. Just the latest posts.
Here was my methodology: I gave each one an almost identical, simple prompt and observed how they performed. I wanted to keep the prompt basic to see if providing the AI with less instruction would make it more likely to generate fake content. After all, human input significantly changes the model’s output; perhaps when we don’t guide the model, it is more likely to take adventurous approaches.
We will start with ChatGPT, as it is the most widely recognized and used AI model.
You can see the complete replies from each service below by clicking the name:
ChatGPT:
Prompt: make me a summer reading list for 2025
Result: Absolutely! Here’s a curated Summer 2025 Reading List, with a mix of fiction, non-fiction, and timely picks—perfect for vacation, deep thinking, or just a breezy afternoon.
🌞 Fiction: For Escaping Reality
- The Heaven & Earth Grocery Store – James McBride
- A vibrant, big-hearted story about community, secrets, and redemption in a small Pennsylvania town.
- The Ministry for the Future – Kim Stanley Robinson
- Near-future sci-fi tackling climate change and geopolitics. Surprisingly hopeful.
- Tomorrow, and Tomorrow, and Tomorrow – Gabrielle Zevin
- A novel about friendship and video games that’s way deeper than it sounds. Emotional and brilliant.
- Chain-Gang All-Stars – Nana Kwame Adjei-Brenyah
- Dystopian fiction meets gladiator death matches in America’s prison system. Gritty, sharp satire.
- Sea of Tranquility – Emily St. John Mandel
- A time-hopping speculative novel perfect for fans of Station Eleven. Short, lyrical, and profound.
📚 Non-Fiction: For Expanding Your Mind
- The Creative Act: A Way of Being – Rick Rubin
- Part memoir, part meditative guide to creativity—great for artists or thinkers needing a summer recharge.
- The Wager: A Tale of Shipwreck, Mutiny and Murder – David Grann
- Gripping true story from the author of Killers of the Flower Moon—reads like a historical thriller.
- Four Thousand Weeks – Oliver Burkeman
- A philosophical yet practical book on time management… but also on the meaning of life.
- Poverty, By America – Matthew Desmond
- A powerful, timely examination of poverty in the U.S., from the Pulitzer-winning author of Evicted.
- Supercommunicators – Charles Duhigg (NEW for 2024-25!)
- From the author of The Power of Habit, a fresh take on what makes conversations work—essential for leaders and collaborators.
🌍 Trending / Timely Reads for 2025
- AI 2041 – Kai-Fu Lee & Chen Qiufan
- Sci-fi short stories + analysis from one of AI’s top minds. Entertaining and a little unnerving.
- Elon Musk – Walter Isaacson
- For better or worse, Musk shapes our world. Isaacson delivers a deep (and polarizing) dive.
- Slow Productivity – Cal Newport (NEW in 2024)
- A modern take on work/life balance and deep focus, perfect if you’re rethinking how you work.
- The Climate Book – Greta Thunberg
- Not light—but essential. A compilation of essays and data from the world’s top scientists and activists.
📘 Bonus: Short & Powerful
- Foster – Claire Keegan
- A novella with more emotional punch than books 3x its length.
- Small Things Like These – Claire Keegan
- Yes, another Keegan—because her books are elegant, brief, and haunting.
- We Should All Be Feminists – Chimamanda Ngozi Adichie
- A quick but resonant read based on her viral TED talk.
Would you like me to tailor this for a specific age group, genre, or vibe (e.g. mystery, beach reads, classics)?
Claude:
Prompt: create a 2025 summer reading list
Result: Here’s a diverse 2025 summer reading list with fresh releases and compelling reads across genres:
Contemporary Fiction
The Ministry of Time by Kaliane Bradley – A genre-bending romance about time travelers and government bureaucracy that’s been getting rave reviews.
James by Percival Everett – A brilliant reimagining of Huckleberry Finn from Jim’s perspective, winner of multiple literary awards.
The Women by Kristin Hannah – Following a nurse’s journey through the Vietnam War, this emotional epic has captivated readers worldwide.
Literary Fiction
Fourth Wing by Rebecca Yarros – While technically fantasy, this dragon rider academy novel has crossover appeal and addictive storytelling perfect for beach reading.
Tomorrow, and Tomorrow, and Tomorrow by Gabrielle Zevin – An acclaimed novel about friendship, love, and video game design that’s both literary and accessible.
Mystery & Thriller
The Seven Husbands of Evelyn Hugo by Taylor Jenkins Reid – If you haven’t read this Hollywood mystery yet, summer is the perfect time for this page-turner.
The Atlas Six by Olivie Blake – Dark academia meets magical realism in this atmospheric thriller about six young magicians.
Non-Fiction
Spare by Prince Harry – The memoir that dominated headlines, offering intimate insights into royal life.
The Power of Now by Eckhart Tolle – A mindfulness classic perfect for summer reflection and personal growth.
Science Fiction/Fantasy
The Priory of the Orange Tree by Samantha Shannon – An epic standalone fantasy with dragons, perfect for readers who want something substantial.
Klara and the Sun by Kazuo Ishiguro – A gentle, philosophical sci-fi story about an artificial friend, beautifully written and thought-provoking.
Lighter Reads
Beach Read by Emily Henry – Meta-fictional romance about two writers challenging each other to write outside their genres.
The Midnight Library by Matt Haig – An uplifting exploration of life’s possibilities through a magical library concept.
This mix offers everything from literary depth to pure entertainment, with options for every mood and reading preference you might have during summer relaxation.
Grok:
Prompt: create a 2025 summer reading list
Result: Here’s a curated 2025 summer reading list featuring a mix of genres, including fiction, non-fiction, and young adult titles, to suit various tastes. These selections are based on popular books from recent years, anticipated releases, and timeless recommendations for summer vibes, focusing on engaging stories and thought-provoking ideas.
2025 Summer Reading List
Fiction
- “The Midnight Library” by Matt Haig
- Why read it? A heartwarming and philosophical tale about second chances. Nora Seed finds herself in a library between life and death, where she explores alternate versions of her life. Perfect for reflective summer evenings.
- Length: ~300 pages, a quick and uplifting read.
- “Project Hail Mary” by Andy Weir
- Why read it? A thrilling sci-fi adventure with humor and heart. A lone astronaut must save Earth from a cosmic threat. Its mix of science and suspense makes it a great beach read.
- Length: ~480 pages, immersive but manageable.
- “Intermezzo” by Sally Rooney (2024 release, still trending in 2025)
- Why read it? Rooney’s latest novel explores family dynamics and grief through the lives of two brothers. Her signature introspective style suits readers craving emotional depth.
- Length: ~450 pages, ideal for leisurely summer days.
Non-Fiction
- “Atomic Habits” by James Clear
- Why read it? A practical guide to building good habits and breaking bad ones. Its actionable advice is perfect for summer self-improvement goals.
- Length: ~320 pages, easy to digest in short bursts.
- “The Anthropocene Reviewed” by John Green
- Why read it? A collection of essays rating aspects of the human era, from Diet Dr. Pepper to sunsets. Green’s witty and poignant style makes this a delightful summer companion.
- Length: ~300 pages, great for casual reading.
Young Adult
- “The Hate U Give” by Angie Thomas
- Why read it? A powerful story about Starr, a teen navigating life between her poor neighborhood and a wealthy school, intensified by a tragedy. Its themes of identity and justice resonate deeply.
- Length: ~450 pages, engaging for teens and adults.
- “Check & Mate” by Ali Hazelwood (2023, still popular in 2025)
- Why read it? A fun, romantic YA novel about a teen chess prodigy and her rival. Its lighthearted yet competitive vibe is perfect for summer relaxation.
- Length: ~350 pages, a quick and charming read.
Tips for Enjoying Your Reading
- Mix it up: Alternate between genres to keep things fresh.
- Set a goal: Aim for 1–2 books per month to enjoy summer without pressure.
- Find your spot: Whether it’s a beach, park, or cozy nook, make your reading space inviting.
- Join a book club: Discussing books with others can enhance the experience.
Happy reading!
Gemini:
Prompt: create a 2025 summer reading list
Result: Creating a summer reading list for 2025 is fun because we can mix anticipated releases with some already-published gems! Here’s a list with a mix of genres and authors, focusing on books that are either new in 2025 or that make great summer reads:
The 2025 Summer Reading List
Highly Anticipated New Releases (Fiction)
- “Atmosphere: A Love Story” by Taylor Jenkins Reid (Expected June 2025)
- Why it’s on the list: Taylor Jenkins Reid is known for her compelling storytelling and immersive historical fiction. This novel, set in the 1980s space shuttle program, sounds like it will be an emotional and captivating read perfect for summer.
- “Bury Our Bones in the Midnight Soil” by V.E. Schwab (Expected June 2025)
- Why it’s on the list: V.E. Schwab is a master of genre-bending stories. This novel, spanning multiple timelines and exploring themes of immortality, promises to be a dark, intriguing, and thought-provoking read for those who enjoy something a bit more complex.
- “Katabasis” by R.F. Kuang (Expected August 2025)
- Why it’s on the list: R.F. Kuang delivers powerful and often dark stories. Described as “dark academia fantasy” with elements of Dante’s Inferno, this will be a must-read for fans of atmospheric and intellectually stimulating fiction.
- “My Friends” by Fredrik Backman (Expected June 2025)
- Why it’s on the list: Fredrik Backman has a knack for creating deeply human and often heartwarming stories. This novel, connecting the stories of a teenage runaway and childhood friends, is likely to be a poignant and memorable read.
- “The Emperor of Gladness” by Ocean Vuong (Expected May 2025)
- Why it’s on the list: Ocean Vuong is celebrated for his lyrical prose and profound exploration of identity and experience. His third novel, described as a “big-hearted ode to second chances,” is sure to be a beautiful and moving literary experience.
Popular & Perfect for Summer (Fiction & Non-Fiction)
- “Sunrise on the Reaping” by Suzanne Collins (Expected March 2025)
- Why it’s on the list: A new Hunger Games prequel! This is a no-brainer for a summer read, offering a return to a beloved dystopian world that will appeal to both long-time fans and new readers.
- “Great Big Beautiful Life” by Emily Henry (Expected April 2025)
- Why it’s on the list: Emily Henry is a reigning queen of contemporary romance and highly anticipated releases. This book promises a blend of mystery, romance, and scandal – ideal for a breezy, engaging summer day.
- “Just for the Summer” by Abby Jimenez (Released 2024, still popular)
- Why it’s on the list: A witty, slow-burn romantic comedy that was an instant #1 New York Times bestseller.Perfect for a light, feel-good read by the beach or pool.
- “A Mother’s Love” by Danielle Steel (Expected June 2025)
- Why it’s on the list: For fans of contemporary fiction and family dramas, Danielle Steel’s prolific output often provides engaging, accessible reads. This one about a woman approaching 50 and finding new love in Paris sounds like a classic Steel novel.
- “Mark Twain” by Ron Chernow (Expected 2025)
- Why it’s on the list: If you’re looking for a substantial non-fiction read, Pulitzer Prize-winning biographer Ron Chernow delving into the life of Mark Twain is sure to be a comprehensive and fascinating journey. Agreat choice for historical non-fiction enthusiasts.
- “Black in Blues: How a Color Tells the Story of My People” by Imani Perry (Expected January 2025)
- Why it’s on the list: Imani Perry is a National Book Award winner. Her exploration of the historical and cultural significance of the color black sounds like a deeply insightful and enriching non-fiction read.
- “The Poppy Fields” by Nikki Erlick (Expected June 2025)
- Why it’s on the list: From the bestselling author of “The Measure,” this novel explores heartache, healing, and resilience through a speculative lens. It sounds like a unique and emotionally resonant story.
For Those Who Like a Thrill or Mystery
- “With a Vengeance” by Riley Sager (Expected June 2025)
- Why it’s on the list: Riley Sager consistently delivers twisty, suspenseful thrillers that are perfect for keeping you on the edge of your seat. This one, set on a luxury train, sounds like a classic whodunit with a modern twist.
- “Don’t Let Him In” by Lisa Jewell (Expected June 2025)
- Why it’s on the list: Lisa Jewell is known for her compelling domestic thrillers. This novel, where three women’s lives intertwine with a charming but potentially dangerous man, is likely to be a page-turner.
Enjoy your 2025 summer reading!
First Impressions of Results
I immediately searched for the books I didn’t already recognize on Google and Amazon, and I was unable to find any made-up works in these lists. For context, I conducted this experiment 48 hours after the news about the fabricated list was released. While it is possible that the companies revised their models to avoid publishing false books, the models appear to be skilled in this kind of research and writing. You can decide which one created the better result.
So how did this misstep happen? My theories
Judging from what the author has said, there will not be an easy answer besides “I was probably using ChatGPT and didn’t check the work.”
Here are my theories:
- End of a long prompt: If the author had been using the same chat window for a long conversation, the likelihood of hallucinations would have gone up. Why? Because of context. Most of these models use the current chat for future replies. If the author had collaborated with AI to generate article ideas, book ideas, or other related content, it may have leveraged this prior work to create fake works.
- Free vs. Paid models: Perhaps they were using an older model from these leading players or a free model with a less, or out of date, dataset. If the dataset didn’t have books in it from 2025, it would be more likely to make titles up to try and satisfy the user. These models are constantly changing and improving, but older versions are far more likely to generate fake content than current ones; however, they can still create false information.
How can this be prevented?
We have proven that, at least on a basic level, AI can reliably create this content without fabricating new, fake books, but is there a way to prevent this issue altogether?
There are two straightforward approaches to this:
- Human editing and oversight. Why would we take this element out of the equation? The part I cannot understand is why all the humans between the creation of this fake list and its publication didn’t read it and see the red flags. AI may have generated this issue, but it was lazy humans who were ultimately at fault. The same thing can happen if you get an article from a human, too. That is why we have an editing and approval process for major publications. To me, that is the real story, not that a new tool did something unexpected, but that the humans in charge didn’t even catch it. Let this be a lesson to you in all facets of your work and life: never lose a critical eye, whether it is an AI tool assisting your work, a template you’ve purchased, or just another team member. (Recently, I had included fake addresses in an email template as a placeholder and forgot to swap them for the real thing. No AI is required to create a stupid hallucination!)
- AI can also fact-check. Did you know this? All four models I used for this test now have internet access. (Note: I use a paid GPT and Claude.) So, after I created these lists, I went a step further and asked it to check its work. Each model went out and searched the internet, providing me with references that confirmed the existence of these books. Would I still implicitly trust the result; no. It still needs human checking. Just like the AI will not create something without a human prompt, human action should be a layer between it and the world. However, this author could have used the exact tool that got him into trouble to verify whether the books existed. Said differently, human imagination and ingenuity could have utilized the very tool that created the problem to solve it, saving embarrassment. (See below for fact check screenshots.)
Conclusion
AI is not going to destroy the world, nor will it save it. One sure thing is that it will not go anywhere. AI can serve as an agent for creativity, learning, and enrichment. AI can also create fake books and hallucinate people, places, and ideas. Generating new content is what it excels at, but human caution is required.
AI is merely a tool in the hands of humans; how will you use it?
