Execution Time: 30 minutes to 4 hours
Goal: To create an XML sitemap for the first time, or to audit your existing XML sitemap.
Ideal Outcome: Your XML sitemap has been properly fetched by Google, contains your core URLs and is properly configured making it perfectly crawlable by Google and other search engines.
Pre-requisites or requirements: You need to have access to your website’s Google Search Console property. If you are using WordPress on your website you will need to have the Yoast SEO Plugin installed and activated on your website.
Why this is important: Creating an XML sitemap allows search engine crawlers to more easily find the content you want them to find, and to understand how important each page is.
Where this is done: In Google Spreadsheets, your WordPress Admin Panel, and Google Search Console.
When this is done: You should generate an XML sitemap from the first moment you launch your site. If your sitemap is manually generated the ideal scenario would be updating your sitemap every time there is a new page that should be indexed.
Who does this: The person responsible for SEO or website management.
Gather a list of all the URLs of your website. If you have already created an XML sitemap and are simply auditing it, you can use that one.
Open the ClickMinded Sitemap Designer Spreadsheet → Click File → Make a copy…
Paste your URLs in the Spreadsheet:
For each URL, select if you would want to include it in the sitemap or not. If you choose not to include it you should select a reason why not. If you have a lot of URLs remember you can use the filters in Google Spreadsheets to speed up the process sometimes.
Mark it as “Yes” as long as it fits these guidelines:
For each URL, that you’ve selected to include in your sitemap assign it a “Priority” and a “Frequency”:
Priority: A value from 0.1 - 1. It is relative to your other website pages:
To define priorities take a look at your URLs and decide which ones are more important for search engines and for your users. The default value is 0.5.
Note: Do not spend a lot of time on this process. If you are unsure you can also set all priorities to 0.5. If you have pages that clearly are higher in importance (e.g: “Homepage”, “Category page”, etc) you can assign the same high value to all of them. There is no gain in setting all priorities to 1. All it will do is signal that all pages are equal in importance.
Frequency: Select the frequency you’d like spiders to crawl your URL.
Generating your sitemap will differ, depending on whether or not you are using WordPress.
Note: If you are using a popular CMS like Drupal or Joomla, you will either have the functionality built-in (Drupal) or an extension available to generate the sitemap (Joomla). This SOP covers the specific process for WordPress, or custom sites, only.
Open the sitemap spreadsheet that you’ve created. Filter all the URLs that you have selected that you want to appear on your sitemap:
Open Google Chrome and head over to http://www.timestampgenerator.com/tools/xml-sitemap-from-list/
Start copying and pasting the URLs from your spreadsheet into the text box of the XML Sitemap generator, according to the “Priorities” and “Frequencies” that are on your Sitemap Design. Click “Add to Queue” until you’ve added all your URLs according to their Priorities and Frequencies.
Step 1: Copying groups of URLs from your spreadsheet.
Step 2: Add your URL group to the queue.
When all your URLs have been added to the queue, scroll down and click “Create Sitemap”:
Your browser will start downloading your XML sitemap. The file will be named “sitemap.xml” if that is not the case, make sure you rename it to “sitemap.xml”.
You will now need to upload that XML file to the root of your domain.
You should also add this line to your “Robots.txt” file:
Note: If you aren't able to upload files to your server yourself, email your develop or IT person. Here is an email template you can use:
I’ve created an XML sitemap so search engines can find all of our pages, which can help increase organic traffic to the site.
You can find the file attached to this email. I need it to be placed in the root of the domain and it should be named “sitemap.xml”.
The “robots.txt” file located at the root of the domain should also be edited and this line should be added to the end of it (no quotation marks):
That’s it! If all went well you now have your sitemap ready to be submitted.
Remember: You should repeat this process frequently whenever you add more URLs to your website. If you add a lot of URLs constantly you might want to ask your developer to create a solution that updates the sitemap automatically.
Install Yoast SEO Plugin.
On your WordPress Admin Panel’s sidebar:
Hover over “SEO” → Click “General” → Click “Features” → Switch XML Sitemaps to "ON" (if it's not already) → Click the "?" Question Mark → Click "See the XML Sitemap".
If you want to make changes to which posts, pages and media content are listed in the XML sitemap:
Hover over “SEO” → Click “Search Appearance”
Scroll through the "Content Types", "Media", "Taxonomies" and "Archives" tabs. If you want that type of content indexed in search engines and listed in the XML sitemap, make sure it's set to "YES". Otherwise, set it to "NO".
Click “Save changes” at the bottom, when you're done.
Log in with your Google Account. If you have more than one website, select your website’s property:
On the sidebar select “Sitemaps”:
Under “Add a new sitemap” enter the name of the file of your sitemap (If you have followed this SOP and generated the Sitemap manually enter ‘sitemap.xml’, If you have generated the Sitemap through WordPress’s plugin Yoast SEO, enter ‘sitemap_index.xml’) after your domain name, and click “Submit”:
Click “Got It”:
That’s it! If everything went well, you will see your sitemap was successfully fetched by Google. Google will return to your sitemap, automatically, usually once a day, to check in on these URLs.