I have been going back and forth with SEOmoz’s Danny Dover for the past couple weeks regarding a crawling error occurring within the site I am currently doing SEO for. He has been a tremendous help to me, and believes others may be having the same issues as I. So…low and behold, I’m going to discuss it here in hopes of finding others just like me and some further expertise on how to handle the situation.
The site I’m working on currently has three country sites:
- www.mysite.com
- uk.mysite.com
- ca.mysite.com
When a user first visits the site, they are brought to a splash page in which they must choose their appropriate country before entering the site. Cookies are enabled on this particular splash page so that when the user revisits, they are brought back to the country-specific site they last visited, rather than tossing them to the splash page every time. While this is very helpful for the user, it is causing some issues with the search engines. Here is a summary of those issues:
- The site REQUIRES that the user enable cookies to access the rest of the site.
- Since search engines do not enable cookies, they cannot crawl the site’s pages.
- When they try to crawl the site, they are brought back to the splash page.
- Because of this, they are not able to access the rest of the site.
- Without accessing the entire site, search engines are unable to properly index the pages.
What is interesting is that the majority (I’d say 90%) of pages are in fact in Google’s index (as well as Yahoo! and MSN) and show up in the SERPs. The site’s pages also show up in #1 positions and above the fold positions for a great majority of keywords I’ve optimized for.
Danny suggested this is because of links to those pages (in terms of internal linking structure, not links from external sources).
Danny and a monkey I know another SEO I know suggested a few possible solutions to this issue:
- Decide if the cookie feature is really necessary. If so, it might be enough to simply show the proper version of the website based on the TLD or subdomain of the domain the user enters. Include flag links to other countries throughout each site so the user knows they can view other versions.
- Locate users based on their IP. The downside to this one is that you will also identify the search engines by IP and limit the versions of the site that are available to non-US users.
- Make the US site the main priority and include flag links on every page so users know they can view the other versions should it be more useful for them. The downside to this is that every user will first hit the US version, making it not as user-friendly
I am at a loss of what the proper procedure is for handling such a situation. It would be great to get a discussion going on this and collaborate on the proper solution. If anything, I’m hoping to find someone who has also experienced such a problem so I don’t feel so alone here!
If it had been up to me, I would have built separate sites for each country, but what do I know?
