Loading...
Answers
MenuWhat is the best way to remove URLs from search engines in bulk?
I need to remove 6,000+ URLs from a website which has already been crawled by Google.
What will be the best way to update those URLs? By updating those URLs to 404, noindex no follow and canonical or other?
Please suggest me what will be best from an SEO point of view.
Answers
My first question to you is what are these URLs? It's important to know what these urls role in your overall website (ie do they carry important search signals or not , or by them being crawled they actually diluting these search signals)
so based on your answer above :
if they are important , or duplicated then you need either 301 them and if too much dev time you go with your 2nd choice which is use rel=canonical. (PS canonical is a suggestion/hint to google and dnt active like directive )
if they are not important ( search pages, doorway pages or whatever) then you need to remove them either by a 404 or a 410 then after couple of months (when you see all of these urls has been disappeared from the index) apply robots.txt exclusion to not to crawl these urls anymore.
please note that the url removal works just for 90 days and if you didnt apply a robots.txt to disable bots from crawling them again then they will reappear.
hope this helps
This completely depends on your goals...
Want to retain link juice? 301 redirect.
Want to get rid of poisonous results? Just 404 them today.
Are they all the same exact page? Canonicals
Let's talk for 20 minutes and you'll have everything you need to move forward -
Related Questions
-
If someone misspells my company when Googling, how do I make sure they find my site? Anything besides buying domain names of the misspelled versions?
Google Search is already smart enough to capture those misspellings and shows recommendations for the correct words. Assuming that your website has been around for a while, Google will show users the branded site first in the results pages so the clicks will go there. Google figures out possible misspellings and their likely correct spellings by using words it finds while searching the web and processing searchers queries. So, unlike many spelling correctors, Google can suggest common spellings for proper nouns (names and places), and words that may not appear in a dictionary. I usually use misspellings in my clients Paid Search campaigns to capture all the possible traffic when I see that there's a high number of searches for those variations. I advise against buying domain names for the purpose of capturing that traffic. It will help, though, for people entering the exact domain name directly into the browser. And if you do so, make sure that they all redirect via a permanent 301 redirect to the original one, but do not use them for tricky SEO purposes.WA
-
How Google can index/reindex my page as quickest as possible, as and where there is some change happen in the content?
Hi, Your site is a Q&A so I presume that every time someone create a new Question it will generate a unique URL for that. Indepentend if you have or not an answer you want Google to crawl and index your site as quick as possible to start to analyzing the new page and bring traffic to it. The best way to expedite this "re-crawling" is to use a ping service that you can trigger after your user answer the question. PS: If you site is updated frequently you shouldn't have a problem with crawling, because Google usually identify this type of website really quick. Drop me a call is free for this week. Best,YM
-
What is the best link-building strategy for a travel company selling vacation packages of cruises, weekend trips, city trips, etc?
We work with one of the big cruise sites in the UK and it's all about making the site deserve to rank higher by continually improving the site via design & content. Google wants to rank popular sites so you need to (as Simon points out) figure out ways of getting influential sites to talk about you and link to you. PR is the only real way to build links these days.PA
-
Which domain will have higher SEO chances?
Neither domain name option is a very good idea. I'll explain why in a second, but first I'll answer your actual question. Although there might arguably be some slight advantage in having an exact-match domain of the form Name.TLD as opposed to a domain with additional keywords alongside the name, that advantage is probably negligible. Google algorithm updates, as I understand them, withhold that exact-match-domain advantage until a website has many other reinforcing signals of authority. (Their goal has been to downgrade spammy, low-quality websites.) Whichever domain version you might choose, Google will find the brand name CUJO mentioned all over your actual website and in the referring links. Those signals will be plenty for search engines to pick up on and hence plenty for SEO, and I'd expect them to overshadow the tiny difference between the 2 domains. Your choice shouldn't be based on SEO. Stop trying to please search engines, and start paying attention to your actual human audience. Really, your decision ought to be made based on the memorability and first impression of the domains. Is the extra keyword in .COM better than a name without that extra keyword in .IO? For humans, that is. Either way, you'll run into competition from CUJO.com. And that's a potential problem. Another problem would be pronunciation ambiguity. Spanish and English speakers will see the name very differently, based on that "J". Spelling isn't altogether clear either – Koojo, Kujo, Coojo, Cujo? The main problem I see, however, is that Cujo is a murderous dog in a Stephen King novel. Since most searches for Cujo will aim at that meaning, your site will be perceived by Google as usually irrelevant in comparison with searchers' intentions. And that doesn't help SEO.JP
-
SEO: Subdomain or subdirectory for blog?
Google's official stance is that they are "roughly equivalent" and recommends to do what is technically simpler to implement (source: https://www.youtube.com/watch?v=_MswMYk05tk). With that said, I'd recommend a directory over a subdomain. Doing this consolidates signals to a single domain, which should then theoretically build more authority for all pages off of that single domain. This consolidation of authority results in rank increases, which have been documented here: http://moz.com/community/q/moz-s-official-stance-on-subdomain-vs-subfolder-does-it-need-updating. A subdomain would split signals from the blog and the rest of the root domain content. So while Google "says" they're roughly equivalent, SEOs have seen tangible evidence that sticking to a single domain can be beneficial. If you're able to go with www.iconery.com/editorial/, I'd choose that. Hope this helps!KR
the startups.com platform
Copyright © 2025 Startups.com. All rights reserved.