Why did Google stop indexing my site?
-
Google used to crawl my site every few minutes.
Suddenly it stopped and the last week it indexed 3 pages out of thousands.
What could cause this to happen and how can I solve this problem?
Thanks!
-
It turned out that it was caused by Google Page Speed. They told me that it was fine and nothing to worry about but I just disabled it due to server issues and I guess that is what made the code disappear...
-
Maybe Jill removed it yet at your suggestion
-
it looks like you figured out what that weird code was? I don't see it in the source code anymore.
-
you can fetch google in WMT and googlebot will recrawl
-
I'm sure that you checked yet:
-No important directory is blocked from robots.txt
-The robots.txt detected through Google Webmaster Tools match with the actual file robots.txt (i recently haved a trouble with that)
-New pages are well linked from home
-New pages are in sitemaps.xml with good priority and a dayly update
Share the content imediately with Google plus, it helps!
I cannot be sure, but maybe if Google was much time crawling your site without finding changes, decided to crawl it less frequently
Good Luck!
-
It is indexed but the problem is that most of the indexed pages are outdated and the new ones haven't been crawled.
I would LOVE to know whats up with all of that code. I have been trying to uncover that with no success.... I have no idea where it comes from but also no idea how to find out
-
It's indexed in Google.com
you should geotarget for www.google.co.il
what's up with all of this code that goes on forever in your source
/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ימי הולדת\" href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;small__psa_gt;יום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"בצק סוכר\" href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;בצק סוכר__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"הזמנות ליום הולדת\" href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;הזמנות ליום הולדת__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ברכות ליום הולדת\" href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;small__psa_gt;ברכות ליום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthday-cakes.html\"__psa_gt;__psa_lt;img alt=\"עוגות יום הולדת\" src=\"http://4-ps.googleusercontent.com/x/www.yetzira.com/yetzira.nicole.netdna-cdn.com/xbirthday,P20cake.jpg.pagespeed.ic._Ygk-OCr6B.jpg\" width=\"71\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;img alt=\"יום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/birthday.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;__psa_lt;img title=\"בצק סוכר\" alt=\"בצק סוכר\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/RFM.jpg\" width=\"39\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15858 alignright\" alt=\"הזמנות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/invites.jpg\" width=\"50\" height=\"56\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt; __psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15856 alignright\" alt=\"ברכות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/cards.jpg\" width=\"70\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;/tbody__psa_gt;\n__psa_lt;/table__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;__psa_lt;/h2__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;עיצוב הבית__psa_lt;/h2__psa_gt;\n__psa_lt;table border=\"0\" panel-id=\"panel-id.0\"__psa_gt;\n__psa_lt;tbody__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;small__psa_gt;עיצוב חדרי ילדים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/home.html\"__psa_gt;עיצוב הבית__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/learn-itzuv.html\"__psa_gt;לימודי עיצוב__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/ציורים.html\"__psa_gt;__psa_lt;small__psa_gt;ציורים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;img alt=\"עיצוב חדרי ילדים\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/child-room.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td__psa_gt;__psa
-
My link profile contains natural links only. I have never asked for a link or even exchanged links with anyone.
About 4 years ago my site was hacked and the hackers linked to the content that they inserted in my forum. I have since erased the forum and disavowed the links even though over the years the spammy sites stopped linking to me anyway since their content was removed. This was a long time ago anyway so I don't think it is relevant.
I don't have that many links although the ones I have all linked to me because I have unique content.
My bounce rate has always been around 1%. My users seem to enjoy my content and spend time on my site. My rankings also went down very much since Google stopped crawling. I can't work out why.
-
I have a lot of 404 errors which appear in Google Webmaster Tools but don't appear on my site anymore.
About a month ago I had a problem with Wordpress permalinks and for about 10 hours my posts were crawled under a slightly different URL. During that time many posts were crawled and therefore existed under 2 different URLs. I have since fixed the problem but since Google hasn't really come back to crawl so the errors still appear.
-
Streamline Metrics is correct. Add it to webmaster tools and see what they say. Also, how is your link profile? Any spammy links?
-
Have you claimed the site in Google Webmaster Tools? If not, I suggest doing so at http://www.google.com/webmasters and then you will be able to see if Google has encountered any errors lately and/or you can change the crawl rate if necessary.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Migration + Change of Address Tool used - previous site de-indexed!!
OMG disaster! Recently migrated my site womencycles.com to moonrise.health. Painstakingly went through each URL manually to map out redirects, notified Google via change of address tool. Bam. My old website has disappeared from Google and my new site has thus lost all it's organic (i.e. redirected) traffic. I don't get it. I think I have done everything by the book, but it seems my old site has disappeared and no authority or link juice has been passed to my new site by the 301s, as the new site isn't ranking either. Some examples: https://www.google.com/search?q=women+cycles&oq=women+cycles&aqs=chrome..69i57j69i65j69i61l2j69i60.1834j0j1&sourceid=chrome&ie=UTF-8 'women cycles' previous position 1
Technical SEO | | tikitaka
https://www.google.com/search?q=chaffed+vagina&oq=chaffed+vagina&aqs=chrome..69i57.2370j0j1&sourceid=chrome&ie=UTF-8 - chaffed vagina, previous position 1 https://www.google.com/search?q=how+long+does+it+take+turmeric+to+shrink+fibroids&oq=how+long+does+it+take+turmeric+to+shrink+fibroids&aqs=chrome..69i57.1355j0j1&sourceid=chrome&ie=UTF-8 - how long does it take turmeric to shrink fibroids, previous position 1. Biggest traffic source pages were: https://womencycles.com/blog/top-10-home-remedies-that-claim-to-tighten-vagina-do-they-work/
https://womencycles.com/blog/sore-breasts-after-period-has-finished/
https://womencycles.com/blog/what-is-vaginal-gas-queefing/
https://womencycles.com/blog/tired-during-ovulation/
https://womencycles.com/blog/how-to-get-rid-of-saggy-vag-without-surgery/
https://womencycles.com/blog/vagina-chafing-causes-treatments-to-prevent-it-from-coming-back/
https://womencycles.com/blog/vaginal-dryness-during-pregnancy/ New blog articles on new site, with 301 redirect in place, but not ranking Screenshot shows my search traffic for my new site. Site migrated 13 June. Any ideas anyone??!Screenshot 2022-06-28 at 13.27.41.png0 -
Google tries to index non existing language URLs. Why?
Hi, I am working for a SAAS client. He uses two different language versions by using two different subdomains.
Technical SEO | | TheHecksler
de.domain.com/company for german and en.domain.com for english. Many thousands URLs has been indexed correctly. But Google Search Console tries to index URLs which were never existing before and are still not existing. de.domain.com**/en/company
en.domain.com/de/**company ... and an thousand more using the /en/ or /de/ in between. We never use this variant and calling these URLs will throw up a 404 Page correctly (but with wrong respond code - we`re fixing that 😉 ). But Google tries to index these kind of URLs again and again. And, I couldnt find any source of these URLs. No Website is using this as an out going link, etc.
We do see in our logfiles, that a Screaming Frog Installation and moz.com w opensiteexplorer were trying to access this earlier. My Question: How does Google comes up with that? From where did they get these URLs, that (to our knowledge) never existed? Any ideas? Thanks 🙂0 -
Can Google index the text content in a PDF?
I really really thought the answer was always no. There's plenty of other things you can do to improve search visibility for a PDF, but I thought the nature of the file type made the content itself not-parsable by search engine crawlers... But now, my client's competitor is ranking for my client's brand name with a PDF that contains comparison content. Thing is, my client's brand isn't in the title, the alt-text, the url... it's only in the actual text of the PDF. Did I miss a major update? Did I always have this wrong?
Technical SEO | | LindsayDayton0 -
Webpages & Images Index Graph Gone Down Badly in Google Search Console Why?
Hello All, What is going on with Sitemap Index Status in Google Search Console :- Webpages Submitted - 35000 index showing 21000 whereas previously approx 34500 were index. Images Submitted - 85000 index showing - 11000 whereas previously approx 80000 were index. Whereas when I search in google site:abcd.com is it showing approx 27000 index for webpages. No message from google for penalty or warning etc.Please help.
Technical SEO | | wright3350 -
Google Indexing Desktop & Mobile Versions
We have a relatively new site and I have noticed recently that Google seems to be indexing both the mobile and the desktop version of our site. There are some queries where the mobile version will show up and sometimes both mobile and desktop show up. This can't be good. I would imagine that what is supposed to happen is that the desktop version is the one that should be indexed (always) and browser detection will load the mobile version where appropriate once the user is on the site. Do you have any advice on what we should do to solve this problem as we are a bit stuck?
Technical SEO | | simonukss0 -
Google indexing staging / development site that is redirected...
Hi Moz Fans! - Please help. We had a acme.stagingdomain.com while a site was in development, when it went live it redirected (302) to acmeprofessionalservices.com (real names redacted!!) no known external links to staging site although staging site url has been emailed from Google Apps(!!!) now found that staging site is in the index even though it redirects to the proper public site. and some (but not all) of the pages are in the index too. They all redirect to the proper public site when visited. It is convenient to have a redirect from the staging site to the new one for the team, Chrome etc. remember frequently visited sites. Be a shame to lose that. Yes, these pages can be removed using webmaster tools.
Technical SEO | | mozroadjan
But how did they get in the index to start with? And if we're building a new site, and a customer has an existing site is there a danger of duplicate content etc. penalties caused by the staging site? We had a similar incident recently when a PDF that was not linked anywhere on the site appeared in the index. The link had been emailed through Google Apps, and visited in Chrome, but that was it. So 3 questions. Why is the staging site still in the index despite the redirects? How did they get in the index in the first place? Will the new staging site affect the rank of the existing site, eg. duplicate content penalties?0 -
How does Google find /feed/ at the end of all pages on my site?
Hi! In Google Webmaster Tools I find *.../feed/ as a 404 page in crawl errors. The problem is that none of these pages exist and they have no inbound links (except the start page). FYI, it´s a wordpress site. Example: www.mysite.com/subpage1/feed/ www.mysite.com/subpage2/feed/ www.mysite.com/subpage3/feed/ etc Does Google search for /feed/ by default or why do I keep getting these 404´s every day?
Technical SEO | | Vivamedia0 -
Redirect Flash Site for Google Only - Is this against TOS?
A photographer client has a flash website, purchased as from a (well respected) template company. The main site is at the root domain, and the HTML version is at www.example.com/?load=html If I visit the site on a browser without Flash installed, I am re-directed automatically to the HTML version. I'm concerned as the site has some great links and the HTML version is well optimised, but doesn't appear anywhere in Google for chosen keywords (ranks perfectly for brand related searches). Google is indexing the Flash version of the site, but I would rather it didn't (there's no real content (just Javascript to load the SWF) and all of the pages load under one URL). How can I block the Flash version from Google but still make the incoming links count towards the HTMl version of the site? If I re-direct Google to the HTML version, is this cloaking, and is it frowned upon? Thanks for any advice you can offer.
Technical SEO | | cmaddison0