Cynicus Rex to Privacy@lemmy.mlEnglish • 9 months agoHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizexternal-linkmessage-square60fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizCynicus Rex to Privacy@lemmy.mlEnglish • 9 months agomessage-square60fedilink
minus-square@spookedintownsville@lemmy.worldlinkfedilinkEnglish0•9 months agoHow did you do it? Looking to do this on my own site.
minus-squareɐɥOlinkfedilinkEnglish0•9 months agoMy websites Backend is written in flask so it was pretty easy to add
probably. never used it tho
How did you do it? Looking to do this on my own site.
My websites Backend is written in flask so it was pretty easy to add