Jesse Walden
@jesse
Media sites blocking LLMs from summarizing full articles What’s the best hack for this currently?
7 replies
46 recasts
139 reactions
Just Hodl
@justhodl
They are probably blocking the user agent or serving it a limited version. The simplest way: ask it to write a script to fetch web content using a custom google bot user agent and remove javascript. This will save content to a html or text file that you can link to or upload directly to the ai.
0 reply
0 recast
0 reaction