[NSFW] Woocommerce products not indexed by Google

Hello Martinxun,

Thanks for reaching out regarding the ranking of your products in search engines. If you have done all there is and your content is not indexed, there may be other reasons. You may find some pointers on https://yoast.com/why-doesnt-google-index-my-content-properly/ and https://yoast.com/reasons-optimized-content-doesnt-rank/

@maybellyne thank you for your kind reply. but it checked the above link for every detail, it seems most of them are OK. There are not many errors or warnings in the google webmaster dashboard.

I wonder if you have also received any similar feedback that google doesn’t index wooocommerce product pages? Maybe it’s a problem of the woocommerce system not yoast?

Hey @martinxun03,

Thank you for your reply.

No, we have not heard of any similar experiences. Can you share a URL to your product(s) that are not indexed, so we can check a few things on your domain/site/product pages?

thank you @jeroenrotty
currently, it doesn’t show many errors, only some warnings in products.jpg.
Also by inputting site:yestile.com google shows 1110 results but when you flip the pages, only 2 pages of 68 results are indexed(better than the previous 31 results)

Here are some key screenshots on the google webmaster console.
https://yestile.com/seo/overview.jpg

https://yestile.com/seo/404.jpg
404 link example(this might because i forced www redirected to without www, also vistor can’t select too many options for filtering products)
https://www.yestile.com/catalogsearch/result/index/?color=5447%2C5448%2C5449%2C5459%2C5461&dir=asc&limit=24&order=name&q=Glass+mural+tiles&shape=5433%2C5434%2C5435%2C5438%2C5439%2C5441

https://yestile.com/seo/canonical.jpg
canonical example link: https://www.yestile.com/catalogsearch/result/index/?color=5444%2C5445%2C5446%2C5447%2C5452%2C5454%2C5458%2C5460%2C5461&dir=asc&limit=24&order=name&q=Glass+mural+tiles&shape=5433%2C5436%2C5437%2C5438%2C5440%2C5442

https://yestile.com/seo/canonical-2.jpg
cononical-2 exmple link: https://yestile.com/shop/?filter_chip-shape=square,sectoral,rectangular,round,oval&query_type_chip-shape=or&product_cat=shell-tiles&source_id=38&source_tax=product_cat&filter_color=black,natural&query_type_color=or&showtype=list

https://yestile.com/seo/coverage.jpg
https://yestile.com/seo/not-indexed.jpg
https://yestile.com/seo/products.jpg

Here below are my .htacess content:
# BEGIN WordPress
# The directives (lines) between “BEGIN WordPress” and “END WordPress” are
# dynamically generated, and should only be modified via WordPress filters.
# Any changes to the directives between these markers will be overwritten.
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteRule .* – [E=HTTP_AUTHORIZATION:%{HTTP:Authorization}]
RewriteBase /
RewriteRule ^index\.php$ – [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress

# Wordfence WAF
<Files “.user.ini”>
<IfModule mod_authz_core.c>
Require all denied
</IfModule>
<IfModule !mod_authz_core.c>
Order deny,allow
Deny from all
</IfModule>
</Files>

# END Wordfence WAF

I wonder how to stop the google Bots to use product filters, as I can see my errors caused by this.

Thank you for your help in advance. no index for a half year is killing me.

Hey @martinxun03,

Apologies for the late response.

The 2 images you linked at the beginning of your reply give me 404 errors, as well as some other links.

It looks like your site filter/search feature is being abused – we’ve recently written about it here: https://yoast.com/internal-site-search-spam/ with more tips. Hope this helps.

@jeroenrotty

Thank you for your reply. There’s been no traffic for my website for half a year already because only 29 pages are indexed. It’s a life & death challenge for me. Please help which i really appreciate.

I have re-uploaded the screenshot of google webmaster to show the problems.
Index overview: https://ibb.co/GdvPfqj
Why pages are not indexed:
404(14,721 pages):https://ibb.co/Y2Y1tTb
currently not indexed(16,183 pages):https://ibb.co/rMcY2sF
Alternate page with proper canonical tag(7,015 pages):https://ibb.co/PzjpZCF
Duplicate without user-selected canonical(3,347 pages):https://ibb.co/SxV81y1
Page with redirect(1,655 pages):https://ibb.co/0qZRMJP
Soft 404(544 pages):https://ibb.co/58mq7Tw

Can you give me some advice to solve above problems?

By the way, I want google to index the separate product links, not showing the products all under shop(see:https://ibb.co/TTK7C7c, this could cause the filter problems), do I need to do something in the .htaccess or robots.txt to stop google crawling /shop? as I see most no-index problems have resulted from the shop/?filter_xxx

To prevent google from doing this, I already changed the product permalink structure from https://domain/product/xxx-product-name to the current https://domain/shop/category/second-category/xxx-product-name. Is that a bad idea?

Thank you in advance!
Martin

• This reply was modified 2 years, 1 month ago by martinxun03.
• This reply was modified 2 years, 1 month ago by martinxun03.
• This reply was modified 2 years, 1 month ago by martinxun03.

Hello Martin, I have addressed your concerns below:

404 pages
Can you verify that the links do not exist anymore? Then perform a 410 redirect on those links. And if there are new links for them, consider creating 301 redirects. t, he can do a 302 redirect. It seems you have lots of them, you will find this article helpful.

For the other reasons why your pages are not indexed, please have a look at Index Coverage report

@maybellyne
Thank you for your kind reply. These 404 links really lead to a 404 page because you can’t select all the options to find a product through the product filter. So redirect won’t work out.
I wonder how to stop the bots trying to index all urls like
domain/shop/?xxx
domain/catalogsearch/result/index/?xxx
domain/catalog/product_compare/index/?xxx
domain/category.html?xxx

• This reply was modified 2 years, 1 month ago by martinxun03.
• This reply was modified 2 years, 1 month ago by martinxun03.

Hey, Martin!

In that case, you could use the removal tool in Google Search Console. Please refer here: https://support.google.com/webmasters/answer/9689846?hl=en

Additionally, you could use the 410 redirect. The 410 code tells search engines that they should delete the page from their index. That’s the fastest, most reliable way to remove content from search engines permanently.

This thread was marked resolved due to a lack of activity, but you’re always welcome to re-open the topic. Please read this post before opening a new request.