Google Custom Search Engine Issues

9 posts by 4 authors in: Forums > CMS Builder
Last Post: June 10, 2013   (RSS)

Hi Everyone

I have implemented the Google Custom Search Engine on one of my client sites. 90% of the searches work fine.  The only ones that don't are when i use a multiple section editor.  The search engine will find anything on the default page, but will not find any info on the detail pages.  For example, webpage http://qc.aircadetleagueofcanada.ca/en/squadronOperations.php works fine.  The other pages on the dropdown menu are ignored.  Any ideas?

Thanks!

Ragi

--
northernpenguin
Northern Penguin Technologies

"Any sufficiently advanced technology
is indistinguishable from magic."
........Arthur C. Clarke

By mizrahi - June 10, 2013

From what I understand, google generally doesn't follow links within forms. You would need to provide navigation to those pages via regular hyperlinks.

By gregThomas - June 10, 2013

Hi Ragi,

You could add a site map to your site, this will help googles crawlers find your other pages. This site map generator will find some of your pages, then you can add the other entries to the xml feed manually:

http://www.sitemapdoc.com/Default.aspx

The Google crawler will still search your site normally, and will add any pages it didn't find from the site map.

There are a few issues with using a site map, which are discussed in this excellent post on stackexchange:

http://webmasters.stackexchange.com/questions/4803/the-sitemap-paradox

Let me know if you have any questions.

Thanks!

Greg

Greg Thomas







PHP Programmer - interactivetools.com

By gregThomas - June 10, 2013

Hi,

Did you add the full URL path to the sitemap? For example:

http://qc.aircadetleagueofcanada.ca/en/squadronOperations.php

Could you show me the code from your sitemap.xml file? 

Thanks!

Greg

Greg Thomas







PHP Programmer - interactivetools.com

Yes, I did use the full url.  I have attached the sitemap.xml

--
northernpenguin
Northern Penguin Technologies

"Any sufficiently advanced technology
is indistinguishable from magic."
........Arthur C. Clarke
Attachments:

sitemap(1).xml 134K

By Dave - June 10, 2013

We need to determine if the problem is related to how the viewer pages work, or related to google custom search.

Can you try adding a plain HTML static page?  For example, if you view-source in your browser on this page http://qc.aircadetleagueofcanada.ca/en/directors.php and save it as directors2.php and add it to the menu, does it then show up in the search results?  Try to put it in the same folder as the other file and keep everything identical so the only difference is that one page is static content and the other is generated by CMSB.

Let me know what you find out.

Dave Edis - Senior Developer
interactivetools.com

Dave:  I added the file directors2.php (removed the dynamic portion and replaced it with the words "static test"), added the reference in site map.xml, the tried a search for "static test".  I received a nil return.

i then resubmitted the site map to Google Webmaster tools and ran the search again.  No difference.

ragi

--
northernpenguin
Northern Penguin Technologies

"Any sufficiently advanced technology
is indistinguishable from magic."
........Arthur C. Clarke

By Dave - June 10, 2013

Hi Ragi,

Ok, well if non-cmsb pages aren't showing up in the search either then it's likely a problem to do with how google is indexing the pages.  

The next couple things I can think of to try are to add a link to the footer of the website and see if that gets indexed, or if not to check and see how often Google Custom Search updates it's index.  Failing that you could do some general searches on google custom search not indexing some pages.

Here's some search results I found that may be related:
http://support.google.com/customsearch/bin/answer.py?hl=en&answer=115963
https://developers.google.com/custom-search/docs/indexing
http://support.google.com/customsearch/bin/answer.py?hl=en&answer=115958

Do you have a link to the specific google product or service you are using? 

Hope that helps!

Dave Edis - Senior Developer
interactivetools.com