404 errors due to a subscription service

  • I noticed the following appeared in my 404 logs:

    /feed/b2rss.xml 131 –
    /feed/rss.php 130 –
    /feed/b2rdf.php 128 –
    /feed/rss.xml 127 –
    /feed/scriptingNews2.xml 127 –
    /feed/b2rss.php 126 –
    /feed/index.xml 126 –
    /feed/rss.cfm 126 –
    /feed/atom.xml 125 –
    /feed/index.rdf 124 –
    /feed/index.rss 124 –

    anyone got an idea which subscription service is making those calls (Yahoo, MSN, Bloglines, Newsgator, other)?

Viewing 3 replies - 1 through 3 (of 3 total)

  • I haven’t seen anything like that in mine. Can you download your raw access logs? You should be able to search through those for the IP address and user-agent of the person who made the requests.

    Thread Starter Denis de Bernardy

    (@denis-de-bernardy)

    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /robots.txt HTTP/1.1” 200 165 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /robots.txt HTTP/1.1” 200 165 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/ HTTP/1.1” 412 2597 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/ HTTP/1.1” 412 2597 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/index.xml HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/index.xml HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/rss.xml HTTP/1.1” 404 289 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:09 +0000] “GET /feed/rss.xml HTTP/1.1” 404 289 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:12 +0000] “GET /feed/index.rdf HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:12 +0000] “GET /feed/index.rdf HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:12 +0000] “GET /feed/index.rss HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/index.rss HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rdf.php HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rdf.php HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rss.xml HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rss.xml HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rss.php HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/b2rss.php HTTP/1.1” 404 291 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/atom.xml HTTP/1.1” 404 290 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/atom.xml HTTP/1.1” 404 290 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:13 +0000] “GET /feed/rss.php HTTP/1.1” 404 289 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:14 +0000] “GET /feed/rss.cfm HTTP/1.1” 404 289 “-” “libwww-perl/5.65”
    170.224.8.126 – – [18/May/2005:00:53:14 +0000] “GET /feed/scriptingNews2.xml HTTP/1.1” 404 300 “-” “libwww-perl/5.65”

    sometimes, i get:

    170.224.8.126 – – [18/May/2005:02:19:14 +0000] “GET /wp-rss2.php HTTP/1.1” 200 9505 “-” “Java/1.4.2_06”

    whois record:

    170.224.8.126
    Record Type: IP Address

    OrgName: Sequent Computer Systems, Incorporated
    OrgID: SCS-65
    Address: 1000 River Street
    City: Essex Junction
    StateProv: VT
    PostalCode: 05452
    Country: US

    NetRange: 170.224.0.0 – 170.227.255.255
    CIDR: 170.224.0.0/14
    NetName: SEQUENT-B
    NetHandle: NET-170-224-0-0-1
    Parent: NET-170-0-0-0-0
    NetType: Direct Assignment
    NameServer: NS1.RALEIGH.USF.IBM.COM
    NameServer: NS2.RALEIGH.USF.IBM.COM
    Comment:
    RegDate: 1995-04-21
    Updated: 2001-04-06

    TechHandle: ZI22-ARIN
    TechName: IBM Corporation
    TechPhone: +1-999-999-9999
    TechEmail: [email protected]

    If it is asking for robots.txt, it’s almost certainly a search engine spider of some kind. Beyond that, gee, dunno.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘404 errors due to a subscription service’ is closed to new replies.