For several years, there was a website in Fort Collins that was making a horrendous mistake. This company is an icon in Fort Collins; one of most well known names in town – and no, I’m not going to tell you who.
There’s a very important file at work when it comes to SEO. It’s called your robots file. It tells Google where it can and cannot go in your website. If you say, don’t visit this page, it won’t. This is done by using one line of code. You have to be extra careful though because one simple typo can deindex your entire site. Oops…
Here are the contents of a basic robots file:
User-agent: * Disallow:
This is saying, “Attention all search engines and other web crawlers: You can view everything on my site.”
Here is how you should properly tell Google not to go somewhere in your site:
User-agent: * Disallow: /private/
This is saying, “Attention search engines and other web crawlers: Don’t go in my private directory!”
Here is where some people (like the website I mentioned above) make a serious mistake:
User-agent: * Disallow: /
This is saying, “Attention everyone: stay out of my website altogether.”
This one simple slash told Google not to pay attention to anything in the site at all. This website did not appear in Google for years. Kind of a big deal wouldn’t you say?
In short, if you don’t know what you’re doing with a robots.txt file, don’t mess with it. If you’d like help with setting one up, give us a call!
October 2014
September 2014
August 2014
July 2014
June 2014
May 2014
Advertising
Affiliate Programs
blogging
Branding
Business
business tips
Company or Product Naming
competitive analysis
Conversion Rates
Creativity
Customer Service
Events
fort collins web design company
fort collins website design
Google Analytics
Graphic Design
Help Video Library
How to Increase Traffic
Internet Marketing
internet marketing in denver
keyword research
Local Optimization
Marketing
Marketing in a Bad Economy
Marketing in Northern Colorado
Marketing Tips
Neuromarketing
office management
Package Design
pay-per-call advertising
Places to stay in Estes Park
positive encouragement
Motivational
PR
Press Release Writing
Project Management
public relations
Red Rocket Web Specialists
Research
Reviews
Search Engine Optimization
security
SEO Greeley
social media
Social Media PR
Survey
Testing
Things to do in Estes Park
time management
Twitter
Uncategorized
vacation rentals in ellicottville
video
web design
Web Development
web marketing
web marketing plan
website budget
Website Design
website marketing
website marketing plans
website traffic
Windsor Businesses
WordPress
Writing
Connect with us.
Copyright © 2014 Red Rocket Web Specialists All Rights Reserved Privacy Policy
(970) 674-0079
This is a fairly interesting question, and it's kind of an important one. There is a ton of speculation that...