You’re now capable to execute customized JavaScript whilst crawling. What this means is you’re ready to manipulate webpages or extract information, and also communicate with APIs which include OpenAI’s ChatGPT, local LLMs, or other libraries. You are able to do such things as: Web site crawlers, including Screaming Frog Search https://romeotools.com/product/screaming-frog/