molave@reddthat.com to Selfhosted@lemmy.worldEnglish · 8 days agoRunning web sites makes me not want to - Lowkey Partylowkey.partyexternal-linkmessage-square50linkfedilinkarrow-up1170arrow-down14cross-posted to: hackernews@lemmy.bestiver.se
arrow-up1166arrow-down1external-linkRunning web sites makes me not want to - Lowkey Partylowkey.partymolave@reddthat.com to Selfhosted@lemmy.worldEnglish · 8 days agomessage-square50linkfedilinkcross-posted to: hackernews@lemmy.bestiver.se
minus-squareMonkderVierte@lemmy.ziplinkfedilinkEnglisharrow-up19·edit-28 days agoYou can set a trap that isn’t in robots.txt or is forbidden there. Anyone who ignores your robots.txt is not friendly.
You can set a trap that isn’t in robots.txt or is forbidden there. Anyone who ignores your robots.txt is not friendly.