Blog2016 ≫ Suspicious scrape of the pages I've just been testing

Saw this in my server log just now, it's some of the pages I submitted to google. They've been hit from the same IP address but from a range of different operating systems, all at once. Guessing this is google scraping these pages but without declaring itself as a scraper. Maybe it's to do with testing the rendering of the pages.

        104.236.19.29 "GET /names/samways/17/fanny-alice-grant HTTP/1.1" 200 7303 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20100101 [Firefox](/wiki/#firefox)/29.0"
        104.236.19.29 "GET /names/rainey/690/mary-ann HTTP/1.1" 200 7490 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:21.0) Gecko/20100101 [Firefox](/wiki/#firefox)/21.0"
        104.236.19.29 "GET /names/lyman/689/eliza HTTP/1.1" 200 7543 "http://www.clarkeology.com" "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)"
        104.236.19.29 "GET /names/lyman/58/james HTTP/1.1" 200 6649 "http://www.clarkeology.com" "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)"
        104.236.19.29 "GET /names/clarke/437/henry-patrick HTTP/1.1" 200 8016 "http://www.clarkeology.com" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_3) AppleWebKit/537.36 ([KHTML](/wiki/#html), like Gecko) Chrome/35.0.1916.114 Safari/537.36"
        104.236.19.29 "GET /names/rainey/57/samuel HTTP/1.1" 200 7350 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 ([KHTML](/wiki/#html), like Gecko) Chrome/34.0.1847.131 Safari/537.36"
        104.236.19.29 "GET /names/grant/46/matilda HTTP/1.1" 200 7791 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; rv:28.0) Gecko/20100101 [Firefox](/wiki/#firefox)/28.0"
        104.236.19.29 "GET /names/tribe/20/sarah HTTP/1.1" 200 8081 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 [Firefox](/wiki/#firefox)/28.0"
        104.236.19.29 "GET /m/424 HTTP/1.1" 200 10271 "http://www.clarkeology.com" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:29.0) Gecko/20100101 [Firefox](/wiki/#firefox)/29.0"
        104.236.19.29 "GET /names/clarke/79/charles-[valentine](/wiki/#valentine) HTTP/1.1" 200 7855 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; rv:28.0) Gecko/20100101 [Firefox](/wiki/#firefox)/28.0"
        104.236.19.29 "GET /names/samways/45/john HTTP/1.1" 200 7330 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 ([KHTML](/wiki/#html), like Gecko) Chrome/34.0.1847.131 Safari/537.36"
        104.236.19.29 "GET /names/clarke/7/paul-leslie HTTP/1.1" 200 7952 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 ([KHTML](/wiki/#html), like Gecko) Chrome/34.0.1847.131 Safari/537.36"
        104.236.19.29 "GET /blog/ HTTP/1.1" 200 25604 "http://www.clarkeology.com" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:29.0) Gecko/20100101 [Firefox](/wiki/#firefox)/29.0"
        104.236.19.29 "GET /names/clarke/14/james-[cole](/wiki/#cole) HTTP/1.1" 200 8385 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 ([KHTML](/wiki/#html), like Gecko) Chrome/34.0.1847.131 Safari/537.36"
        104.236.19.29 "GET /names/clarke/18/james-[cole](/wiki/#cole) HTTP/1.1" 200 9356 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:21.0) Gecko/20100101 [Firefox](/wiki/#firefox)/21.0"
        104.236.19.29 "GET /names/clarke/1/barry-leslie HTTP/1.1" 200 8830 "http://www.clarkeology.com" "Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.1; WOW64; Trident/6.0)"
        104.236.19.29 "GET /blog/14/board.html HTTP/1.1" 200 24341 "http://www.clarkeology.com" "Mozilla/5.0 (Windows NT 6.1; WOW64; rv:28.0) Gecko/20100101 [Firefox](/wiki/#firefox)/28.0"
        104.236.19.29 "GET /blog/14/board.html?mode=index&mboard=14 HTTP/1.1" 200 24341 "http://www.clarkeology.com" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:29.0) Gecko/20100101 [Firefox](/wiki/#firefox)/29.0"
        104.236.19.29 "GET /blog/14/board.html?mode=index&mBoard=14 HTTP/1.1" 200 24341 "http://www.clarkeology.com/board/14/board.html" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:29.0) Gecko/20100101 [Firefox](/wiki/#firefox)/29.0"
⬅️ :: ➡️

Paul Clarke's blog - I live in Hythe in Kent. Wed + father to two, I am a full stack web engineer, + I do js / Node, some ruby, python, php ect ect. I like pubbing, running, eating, home-automation + other diy jiggery-pokery, history, family tree stuff, Television, squirrels, pirates, lego, + TIME TRAVEL.