Google Quietly Signals NotebookLM Ignores Robots.txt

Google has quietly updated its list of user-triggered fetchers with new documentation for Google NotebookLM. The importance of this seemingly minor change is that it’s clear that Google NotebookLM will not obey robots.txt.

Google NotebookLM

NotebookLM is an AI research and writing tool that enables users to add a web page URL, which will process the content and then enable them to ask a range of questions and generate summaries based on the content.

Google’s tool can automatically create an interactive mind map that organizes topics from a…