Lordy

Lordy

⬆️RE: Crawler - 514

worked quicker than I thought, thanks for the feedback. Should have passed in both pages as a refererer, this one once (when looking for robots.txt) and then the page of mine that's related to the topic of yours... which site were you then?

⬅️ :: Google API's ➡️
Thu Nov 13 2003

Paul Clarke's weblog - I live in Hythe in Kent. Wed to Clare + dad to 2, I'm a full stack web engineer, + I do js / Node, some ruby, python, php etc. I like pubbing, running, eating, home automation and other diy jiggery-pokery, history, genealogy, Television, squirrels, pirates, lego, and TIME TRAVEL.