ChatPDF meets Personal Science Guide to the Microbiome
A great idea shows the limitations of current GPT AI systems
Personal Science Guide to the Microbiome is a free eBook that summarizes everything I’ve learned about the microbiome in my years of daily testing, experimenting, reading, and talking with experts. Since the introduction of ChatGPT and the OpenAI API, I’ve been playing with developing a “conversation bot” that will let anyone ask questions about my book, similar to the way you can ask open-ended questions and carry on a conversation with ChatGPT.
The AI World moves extremely fast, so of course before I could finish my own bot, somebody has built a GPT-enabled site that lets you upload any document and then interact with it using the same Large Language Model (LLM) behind ChatGPT. The site, at ChatPDF is ridiculously easy to use: just drag and drop any PDF file and begin asking questions. Register (free) and you can share your results and let others try it too. Any PDF up to 120 pages is free, or pay the measly $5/month and you can upload 2,000 pages from 50 documents per day.
How well does it work?
Judge for yourself: Click Here and chat to your heart’s content.
The rest of this post is the (unedited) transcript of my own attempt to take it for a spin. As you can see, the results are not very promising. I’m pretty proud of my microbiome book recommendations, for example, but ChatPDF seems oblivious of that part of the document. Similarly, some of my examples specifically mention the affects of various foods on the microbiome (yes, including cupcakes) but the bot seems oblivious. The table that summarizes what I learned is completely made up.
I’m confident that these systems will get much better over time, so don’t dismiss the technology just because of this one implementation. For now, you’re still better reading the book yourself, or if you must interact with somebody, just contact me and we’ll chat the old-fashioned way.
ChatPDF Results
PDF: Welcome to the Personal Science Guide to the Microbiome! This comprehensive PDF file will provide you with a general overview of the microbiome, biology basics, and the science behind microbes. You’ll learn about the promise and disappointment of genetic testing, the importance of microbes in our lives, and much more.
Example questions:
What is the microbiome and why is it important?
How can I begin my personal science journey to learn more about my microbiome?
What are some practical ways to quantify and track changes in my microbiome over time?
Me: What are some practical ways to quantify and track changes in my microbiome over time?
PDF: The “Methods” section on page 113 provides some guidance on how to track changes in your microbiome over time. One practical way is to track as much as you can about two people for an entire year: their diet, physical activity, and microbiome; look for correlations. Additionally, there are various methods for collecting and analyzing microbiome samples, such as stool samples or swabs of different body sites. These samples can be analyzed using DNA sequencing technology to identify the types and relative abundance of microbes present. However, it’s important to note that the field of microbiome research is still evolving and there may be new methods available in the future.
Me: what affect do cupcakes have on the microbiome?
PDF: The specific effect of cupcakes on the microbiome is not mentioned in the given pages of the PDF. However, it is known that food can affect the microbiome, and some foods may be more beneficial or harmful to certain types of microbes than others. It’s possible that consuming cupcakes regularly could have an impact on the composition and diversity of your microbiome, but more research would be needed to determine the specifics.
Me: Name three specific foods that impact the microbiome.
PDF: Page 82 of the PDF provides some information on how food affects the microbiome. While it’s difficult to identify specific foods that impact the microbiome, some examples are:
Fiber-rich foods: These foods can promote the growth of beneficial bacteria in the gut, which can help improve digestion and overall health.
Fermented foods: These foods contain live bacteria that can help replenish and diversify the microbiome.
High-fat diets: Consuming a diet high in fat may alter the composition of the microbiome and lead to negative health outcomes.
Me: Are there any foods that can affect sleep?
PDF: Page 76 of the PDF suggests that there may be a link between sleep and the gut microbiome. While it’s not clear which specific foods may affect sleep, some home remedies for insomnia involve consuming foods that are known to affect the microbiome, such as warm milk, apple cider vinegar, and non-caffeinated herbal teas. However, more research would be needed to determine the specific effects of these foods on sleep.
Me: who is the author ?
PDF: I apologize for not mentioning the author’s name earlier. As an AI language model, I do not have access to the specific PDF you are referring to, so I cannot provide the author’s name without additional information. Please let me know which PDF you are referring to, and I will do my best to provide you with the author’s name.
Me: who’s the author of Personal Science Guide to the Microbiome
PDF: The author of “Personal Science Guide to the Microbiome” is Richard Sprague, as mentioned on page 1 of the PDF.