[NTG-context] Bad PDF to text crawlers

[Kip Warner]

On Wed, 2015-08-19 at 23:35 +0200, Peter Münster wrote:
> Even if you would find a way today, tomorrow there would be other 
> bots, that see the same text, as the humans.

Yes, probably.

> Get the value of HTTP_USER_AGENT and send the replacement text, if 
> the agent is a bot. Or use robots.txt.

I'll give that some thought. Thank you.

-- 
Kip Warner -- Senior Software Engineer
OpenPGP encrypted/signed mail preferred
http://www.thevertigo.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: This is a digitally signed message part
URL: <http://www.ntg.nl/pipermail/ntg-context/attachments/20150820/20423863/attachment.sig>