Sitemap generation

TransAmDan

Forum Admin
Staff member
Recently there has been a decline of people landing on the website, this is partly to do with the time of the year. I've been looking into making the website faster as you know, a faster website can mean Google comes back looking for more pages on the website to index them ready for its searches.

We have a plugin on the forum made by Dragon-Byte which write something called DBSEO, it handles some of the search engine optimisation, but also generate something called a Sitemap, this is a list of pages on the website. This is split into about 10 files, as its best not to store more than 20,000 pages in a file.

The sitemaps generation is mainly working. Noticed a few issues in GWT (Google Web Tools), it appears URLs are in going into the sitemaps that don't exist.

Priority URL Response Code Detected Referred from

1 tags/article-page4.html 11/10/14 dbseo_sitemap_tags_12.xml.gz

2 tags/page-page11.html 11/10/14 not found in todays sitemap, so thats good.

3 tags/vehicle-page10.html 11/10/14 dbseo_sitemap_tags_12.xml.gz

4 tags/people-page4.html 11/7/14 dbseo_sitemap_tags_12.xml.gz

There is about 46 of these. So looking into it further.
Solent Renegades, does indeed return page not found. This is refered to in Sitemap http://www.solent-renegades.co.uk/db...tags_12.xml.gz opening that sitemap file it does have that entry listed along with a few of the others.

So why is DBSEO generating pages in the site map for pages that don't exist. Do I have something configured wrong? I haven't noticed this until today, only 46 flagged errors our of 10k pages, do its nothing major, just want to clean things up in GWT as there has been a great drop in pages being indexed and visitors to the site. Although just noticed there are 439 errors under 'Not Found' in GWT. Looks to be a simular issue. eg.
Solent Renegades is in http://www.solent-renegades.co.uk/vb...forum_1.xml.gz but website is returning

vBulletin Message
Invalid Attachment specified. If you followed a valid link, please notify the administrator


for that page.
Nothing has recently changed on the forum, certainly nothing in DBSEO apart from upgrading the version, no settings have been touched.

So looking into getting the correct generation of the Sitemap going, this will certainly help with sorting the decline in web pages being visited by Google. Also many other search engines also use this sitemap.
 
Seems like some of the issues was caused by an old sitemap generator still running. Flushed the system, reconfigured GWT and see what errors return.:)
 
Back
Top