We're still not indexing this sort of new duplicate page

TG Data Set: A collection for training AI models.
Post Reply
bhasan01854
Posts: 441
Joined: Sat Dec 28, 2024 3:24 am

We're still not indexing this sort of new duplicate page

Post by bhasan01854 »

This isn't a great solution. We've got some compromises that we've had to achieve here to economize on crawl budget. Noindex, follow So a lot of people used to think, oh, well, the solution to that would be to use a noindex follow as a sort of best of both. So you put a noindex follow tag in the head section of one of these pages, and oh, yeah, everyone is a winner because we still get the same sort of crawling benefit.


, which we don't want to index, but the PageRank solution is fixed. Well, a few years ago, Google came out and said, "Oh, we didn't realize this ourselves, but actually as we austria phone number database crawl this page less and less over time, we will stop seeing the link and then it kind of won't count." So they sort of implied that this no longer worked as a way of still passing PageRank, and eventually it would come to be treated as noindex and nofollow.


So again, we have a sort of slightly compromised solution there. Canonical Now the true best of all worlds might then be canonical. With the canonical tag, it's still going to get crawled a bit less over time, the canonicalized version, great. It's still not going to be indexed, the canonicalized version, great, and it still passes PageRank. So that seems great. That seems perfect in a lot of cases. But this only works if the pages are near enough duplicates that Google is willing to consider them a duplicate and respect the canonical.
Post Reply