Search Engine, Wopular | featured news

Relieving High Server Load by Blocking Search Bots

Coding

Over the years, whenever the site was slow to load up, I always went through the same routine. I checked traffic logs to see if it was due to a sudden increase in traffic. If not, I would look at the mysql slow query log to see if there were slow queries bogging up the database. If that wasn’t the culprit, then I would take a look at the access logs to see if there were any irregular activities from search engine bots.

 

Pages Not Indexed by Google Because of Autofresh

Pages Not Indexed by Google Because of Autofresh

About a year ago, I decided to add an autorefresh to pages that contain feeds so that content would always stay fresh. I set it to autofresh every 3 minutes. I could have been done this via ajax, but my ajax kung fu wasn’t good enough then (or now). I went with the easiest method, which is a simple meta tag addition to those pages. I got the idea from Drudge Report.

It was fine for about a year until the week of the Panda Update 2.2, when all pages with the autorefresh would give the Googlebot errors and not get indexed.

 

Google's Panda Update Took a Big Bite Out of My Traffic

Google's Panda Update Took a Big Bite Out of  My Traffic

Google have been tweating their search algorithms this year to battle content farms and scrapers. They named this tweak Panda Update. In February of this year, they released the first version, which was aimed at lowering the rankings of content farms - i.e. eHow, ezinearticles.com, and wisegeek.com. I don’t consider my site a content farm, but I did saw a 40% decrease in traffic as soon as the new algorithm went live.

 

Google's New Search Algorithm Change Took Out 40% of My Google Traffic

Google's New Search Algorithm Change Took Out 40% of My Google Traffic

Last Thursday, Google launched a new tweak to their search algorithm. It was targeted at content farms, which many consider to be spammy sites whose content are created solely to attract search engine traffic for specific keywords.

I do notice more and more of these sites on Google’s search results. For me, the main offender is ezinearticles.com. Most of the articles I get from there are completely useless. They’re just keywords being repeated over and over again with a bunch of fillers. I can see why Google wants to push those sites further down their search rankings.

 

Subscribe to this RSS topic: Syndicate content