RSS Aggregator Referer Problem

I just want to say, right on! The referer field is being abused by just about every RSS aggregator. Instead of Referer, they should be using the User-Agent request-header field to identify themselves. My guess is that they also want to show up in referrer logs for marketing reasons...because they're more likely to be read by site authors. I block them specifically from my referrer reports because they're meaningless. (Has anyone compiled a comprehensive list?) But I shouldn't have to.

Jan 30^th, 2003, 2:34 pm

« Previous post / Next post »

Comments

Hey pb, I posted a followup to Jason's post here: http://www.jayallen.org/journey/2003/01/index#using_and_abusing_the_referrer_field

I also sent an email with both links to Brent Simmon's (at Ranchero, maker of NetNewsWire) to see what he thought.

We'll see what the next version holds...

by Jay Allen on Jan 31st, 2003 at 12:21 am

Thanks Jay! (Though your URL is messing with my design. ;)

by pb on Jan 31st, 2003 at 12:29 pm

I like what Straw (an aggregator for Linux) does - you can set a URL to be included in the referer, which basically lets people know "hey, I'm reading your feed". It is still referer-abuse, but it's at least a bit more informative and useful to the site owner.

by Bill Stilwell on Jan 31st, 2003 at 12:59 pm

Oops. Sorry pb. Guess I should make shorter titles. ;-)

by Jay+Allen on Feb 3rd, 2003 at 1:53 am

hey! progress:

http://inessential.com/?comments=1&postid=2357

by pb on Feb 4th, 2003 at 10:57 am

Hi! You're reading a single post on a weblog by Paul Bausch where I share recommended links, my photos, and occasional thoughts.

onfocus

RSS Aggregator Referer Problem

Comments

Search Results