• Resolved chcw

    (@chcw)


    Hi,

    Our website has 5000+ posts and more than 100 languages. Currently we are using https://pro-sitemaps.com/ service to crawl our website and generate a XML site map. However, sometimes, it will cause error, like this:

    We are thinking of using Yoast SEO to generate the site map. I just wonder:

    1. Will it consume a lot of resources to generate a sitemap with 200, 000+ links?
    2. Will your plugin crawl the pages like a bot from time to time to get the sitemap up to date?

    The page I need help with: [log in to see the link]

Viewing 5 replies - 1 through 5 (of 5 total)
  • Plugin Support Maybellyne

    (@maybellyne)

    Hello @chcw

    Thanks for using the Yoast SEO plugin. We have addressed your concerns below:

    1. The guideline is that a single sitemap should be 50MB (uncompressed) or 50,000 URLs. And the Yoast SEO plugin sets a default maximum number of entries per XML sitemap to 1000, but you can change that. You may want to speak with your web hosting provider about the specific resources that will consume on your server. You can read more here and here.
    2. Yoast SEO doesn’t automatically submit your sitemap, but when you edit your post, the plugin automatically updates the sitemap. Whenever an XML sitemap is updated (as a result of a post, page, or URL being created/updated), the plugin pings Google and Bing with the URL of your XML sitemap. By doing this, the search engine can easily find the new URL and index it. But you need to have submitted the sitemap first. So, the plugin doesn’t crawl your sitemap but search engines.

    Thanks.

    • This reply was modified 1 year, 7 months ago by Maybellyne.
    • This reply was modified 1 year, 7 months ago by Maybellyne.
    • This reply was modified 1 year, 7 months ago by Maybellyne.
    Thread Starter chcw

    (@chcw)

    @maybellyne

    I do not ask whether the plugin will crawl the sitemap. Instead, I want to know whether it will crawl the posts & pages, other than detect their changes.

    Also if your plugin does not crawl the posts & pages, how can it generate the first version of the sitemap that contain all existing posts & pages in the site?

    Plugin Support Maybellyne

    (@maybellyne)

    Also if your plugin does not crawl the posts & pages, how can it generate the first version of the sitemap that contain all existing posts & pages in the site?

    I wouldn’t call it crawling since that’s usually used for web crawlers/bots. I’d say it detects any page or post you wish to be discovered and indexed by search engines and creates an initial sitemap based on that criteria.

    I want to know whether it will crawl the posts & pages, other than detect their changes

    After the initial creation of a sitemap, it then detects changes you make to posts and pages and updates the sitemap accordingly.

    • This reply was modified 1 year, 7 months ago by Maybellyne.
    Thread Starter chcw

    (@chcw)

    @maybellyne

    THank you. So it seems your plugin can only include WordPress posts & pages in the sitemap. For those not in WordPress sites, they will NOT be included. Is that correct?

    We are using GTranslate which will produce multilanguage URLs such as https://www.datanumen.com/pl/, in such a case, will your sitmap includes it?

    Plugin Support Maybellyne

    (@maybellyne)

    The plugin includes in the sitemap any content type?you wish to be discovered and indexed by search engines. Also, the plugin does not parse different sitemaps for different languages. We add all the languages to the same sitemap. So all posts (regardless of language) will appear on the post sitemap.?Doing it this way will not hurt the SEO or how Google crawls your site.

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘Will creating XML sitemap consume many resources?’ is closed to new replies.