Tag: Googlebot
Sorted by: Newest Newest Oldest

: Google search results show "Loading, downloading assets" for all site pages because Googlebot is not fully running JavaScript I host maps. Each map has its own unique URL. But all these URLs

: GSC 403 Error - Why have some Web pages dropped out of Google serps whilst others have'nt? I have a site that has been on 1st page of Google for years but suddenly it has dropped right

: Is there a way to get Google search console crawl stats for larger than 90 days? Google search console allows you to see how many pages Google is crawling per day on your site, but it only

: Googlebot flooding server with requests for junk URLs with random data I'm having some trouble with GoogleBot. It keeps requesting a random URL that doesn't exist. It is trying to access:www.example.com/index.php/{TOKEN}

: Website disappeared from Google after redirecting Googlebot to HTML with only the metadata I want indexed I have a website on which I use a redirect only for Googlebot to a HTML file. It only

: Disallow JS scripts in robots.txt for Googlebot To my knowledge, Googlebot is currently fully capable of rendering complex SPA applications, and this is recommended as a rule of thumb. The website

: Does Googlebot execute Google Tag Manager? I wanted to understand how Googlebot (and other crawlers) crawl my site. Specifically whether it passes a document.referrer and if it maintains localStorage

: Angular4 and meta descriptions, google serp SPA or angular4 websites uses a shadow dom, so, how to use or show the correct meta description added to the page? Do I need this: <meta name="googlebot"

: Do having a specific designated DIV attribute name help your organic SEO ranking? Intro I am at a standstill at the moment before I go any further. I will have many much of the same repeated

: AMP pages not getting updated when served from Google's cache I have an amp page at the following UNS and its already cached by Google. When this paged is served from Google's cache, its showing

: Prevent "Fetch as Google" from creating a wishlist in the database of a Woocommerce site Can anybody explain why when I 'Fetch as Google' and ask it to index a new page, Google creates a

: 404 or 302 Redirect - what to use for a url which may be used in the future but not available at the moment My site lists blogs like this example.com/?status=blog&id=number I only have

: Google doesn't recognize a 404 status code There are 404 pages with two kinds of response headers (copypasted in full length from Chrome DevTools, Network tab): Response headers: cache-control:max-age=0,

: Strange usage pattern: UK user accessing 1 page X times every 14hrs – who/what can it be? For about two week I find a strange pattern in my web statistics: approximately every 14 hours a

: Prestashop SEO - Crawl Budget Optimization I am helping a friend to improve his rankings. They have great content, but (according to the logs) GoogleBot seems to get lost in the not-so-important

: Website Home Page URL Not Show On Google Search If i search like site:www.paka.tv my main homepage URL not showing, but categories of my site pages showing on results. How to show my website

: Search Console: Server Connectivity Error - Connect Timeout Over the last 4 days server connectivity errors have started to pop up in my Search Console. Specifically, it is the connection timeout

: Site Disappeared From Google Search I got my site Captain Commandaria listed on Google the other day. Everything was well, for captain commandaria it was the first result on Google across all

: How to find out the referrer of Googlebot's crawling URL? Googlebot crawls 100s of 404 URLs from my website. I want to know from where it gets those links? Is there anything like HTTP Referrer?

: Does google analytics notifies google about my dynamic pages Does google use analytics to notify search engine about existence of a website. Now, I'm not talking about improved ranking, but just

: How to handle the duplicate block of content? Please refer: https://support.google.com/webmasters/answer/66359?hl=en Googlebot don't like duplicate content and also duplicate block of content repeatedly

: Can we have Google crawl but ignore our paginated category pages and prefer our individual post pages in the index? We have a site with a massive content back-end (50.000+) with, lets say,

: If “_escaped_fragment_” shows up in Search Console URL Parameters, should you “Let Googlebot decide”? As far as we know, there should be no links to our site anywhere that include the

: How frequently should I expect Google AdsBot to visit my site? I bought paid advertising for my website through an internet advertising company. I noticed that, among all the visits coming from

: GoogleBot Crawling and Past Event Performance We have an event site and we noticed GoogleBot crawling our old events, say from five years ago, which also includes Teams within the event, which

: Htaccess empty referer deny "google bot" I put this rule into htaccess file to deny empty referers which is returning 403 SetEnvIfNoCase Referer "^$" bad_user Deny from env=bad_user I

: How to show "categories"/decide which "categories" are shown in google search results? When you search for a number of larger websites in google, it shows "subpages"/categories. For example, when

: Reduce total page size for seo and good speed performance (Page size Vs Page speed) currently we developed a website . After we test the website speed in https://developers.google.com/speed/pagespeed/insights/.

: Let Google index my premium content - hide from non-verified users How can I let Google index a webpage with "premium content" (which requires a "normal" user to be logged into his account

: Google crawler 520 error Google Crawler generates 520 errors daily. I will get about 50-100 of these errors in a 60.000 internal links website. The thing is though, that my links don't have

: Seo for hidden anchor tags I have a very simple doubt, does google seo or other seos recursively crawl hidden hyperlink tags. I googled but could not find any solution. Any experience or any

: Should an Allow or Disallow directive be used in robots.txt to allow Googlebot to crawl the whole site? User-agent: * Disallow: / User-agent: Googlebot Allow: / I use this command in my robots.txt

: How to stop Bot generate Traffic in Wordpress? My WordPress website recent facing a big problem. Spamming problem. Using a plugin i detect that every single second here coming huge number of

: Does Googlebot add any parameters to a URL when crawling? I have set up a memory caching system that will use the URL as a key to cache a copy of a HTML page in memory in order to make

: Shutdown a subdomain can affect another subdomain I have two subdomains and I decided to shutdown the br and focus only in pt project. https://pt.example.com https://br.example.com My question is

: How do I get Google to crawl and index a react.js app that uses AJAX and onclick events instead of links? What would be the best way to get Google to index a react app. Google can now

: Does google crawl/follow link on a page with meta robots noindex We have added following meta tag on some of our pages: <meta content="noindex" name="robots"/> Does google crawl the content

: Why is Google not indexing my Sublinks? I am working on a chat website and created a channel directory. But Google is not indexing the linked sites: do you know why? And the Links are built

: How to rank website on google Currently i am working on a project, i am 2nd developer of this website. When this website was launched it was totally or 70% copied from another website. when

: SEO impact of ajax loaded content from external site I am in need of some expert opinions before I put a lot of time into a business decision. I have a website where I write product reviews

: Re-index updated post and update cached AMP version I have a post I just updated on a site. This site gets picked up in google almost instantly but this post that I updated is not getting

: Versioned pages: making sure Google points to the current The open-source Sinon project has some docs that are versioned per-release. That means that when searching for sinon documentation, you

: What is the way to prevent Google from scraping and crawling a URL in plain text on a page? Problem I have a website with documentation that includes examples with plain text URLs. The other

: Remove cached domain / pages from Google The website's domain I work for is https://www.utazzitthon.hu and there is an other company in partnership with us, they have a domain that is directing

: Googlebot and Mediapartners-Google are crawling URLs blocked by robots.txt, why? I have blocked the some of the URLs from robots.txt. I think there is No way to access the blocked URLs from

: Why Google Taking time to index my website I observed some of the web sites, their content indexing immediately whenever they created the data and results are showing in SERP, But why taking

: Does Google crawl AJAX API calls? We have been monitoring our logs for Googlebot and there are many requests to API calls (requests via AJAX) which are used to fetch the page and not the

: For SEO, are pre-rendered previous and next pages required for a single page application site with infinite scroll? In this article It is mentioned that Chunk your infinite-scroll page content

: Are rotating ads harmful for Google SEO? I have a plugin which makes different banner ads to be displayed randomly. It means that every time a page is reloaded, a different code is also reloaded.

: How does Google bot know that my page content has changed? Let's say I've a page which is already indexed in Google Search. If I make a change to the content of that page, how would Google

: Google cache does not have prerendered _escaped_fragment version of page, rather it is showing another page altogether I have read multiple questions around it but still could not find a solution.

: How to block some CSS files from Googlebot using robots.txt while allowing other files in the same directory? Hi in my Drupal website site I have a few directories like: /sites/modules/ Now

: Prevent Googlebot from crawling "access denied" error (403) of private forum that are reported in Google Search Console? I'm running a website base it by vbulletin. Recently I moved one of my

: I've got a problem with google bots fetching my website assets when i try to do fetch as google pages of my website, google bots fetch it partially , (not complete), and when I check the

: Prevent indexing of site search results Users have the ability to search on my site. This function renders a search results page that has occasionally been indexed by google and served in SERPs.

: Internal Search Results: NOINDEX or robots.txt Blocking? We have our own internal search results pages for our download section. These results are currently crawlable but with NOINDEX meta tags

: How to get my # links on my single page site indexed by Google I own a One Page Site. Google is only indexing the home page -> example.com. I tried adding it in Google Webmaster Tools/Search

: Would an online queueing system for a website have an effect on google's ability to crawl the site? If I was to implement a visitor queuing system for my website, where if visitor count is

: How to Crawl a website requires cookies for audit? Situation: My Client's website requires cookies to access it. Users should choose (Language and country) to access the website. The problem is:

: GoogleBot is scanning random link on my website Just take a look at this: my-domain.com:80 66.249.79.18 - - [13/Jun/2017:20:09:26 -0700] "GET /d733421/my-domain.com HTTP/1.1" 404 16729 "-" "Mozilla/5.0

: Disallow, canonical, or noindex for a coupon ID parameter where Google has already found some duplicate content? We've changed our software and domain a week ago. Done the 301 redirction successfully.

: Linked desktop and mobile pages- does SEO rank of mobile website even matter? The question is somewhat similar to this post. The only difference is, we have desktop version as https://www.example.com/

: Link to product detail pages without allowing product list pages with many filter variants to all be indexed I have a website for managing trading card game (TCG) collections which is built

: Google crawler and dynamic websocket website I have a a big problem that I'm only considering after I have finished development of a webpage. My page is written with only a skeleton HTML. All

: Why is Google crawling non-existant URLs? I can see in live traffic of my wordpress website that goggle bot crawl non existing pages. www.example.gr/search/search-results/password-reset%252Fpassword-reset/password-reset%252Fpassword-

: How can I prevent the Googlebot from indexing duplicate URLs? I have duplicate URLs for each ad page. For example: https://example.com/ads/2161/%D9%84%D9%83%D8%B2%D8%B3_GS350.html https://example.com/2161/

: Can i do a 301 redirect for the Googlebot Only? Lets say a have a webpage called example.com, and a have a subdomain called sellingpage.example.com I use sellingpage.example.com as a landing

: Firebase hosting, sitemaps and robots.txt i tried searching on internet about this question and how Firebase handle indexing and how owner of the content running on Firebase hosting can influence

: AdsBot-Google visiting domain which no longer has advertisements During analyzing traffic generated by bots to our website, we found the strange issue. We found that AdsBot-Google crawling domain

: Is changing from HTTPS to HTTP kills my backlinks? I had only my main page in HTTPS to test it out want to change from HTTPS to HTTP. All my backlinks are in HTTPS will i lose all of

: If i redirected my website from "HTTPS" to "HTTP", will i still be getting a ranking boost? Google announced that going HTTPS will give you a ranking boost. So i bought SSL certificate to

: Google Search Console - Scan Request does not work I have a problem with Google's Search Console. When I "Fetch as Google" and status is Complete, I click on "Request Indexing", fill in the

: Rule out third party scraping, but allow Google crawling How to make scraping of own content through wget, httrack etc. impossible, but allow crawling through googlebot? This should be done without

: How to get indexed for particular keyword in google? i have tried so many ways that to rank mobile app development keyword for my website, it is not showing even in last page of google search

: How to Remove URL from Google Cache which is not available in Sitemap? I have a site Hot Deal INDIA. I have added around 1200 Links in my sitemap. Around all the Links are cached by google,

: What is the "google-xrawler" user agent used for? I'm getting over 100 requests per day from user agent google-xrawler. The requests are all for the same page. Some of the IP addresses are

: How to make Google index users posts when there are no direct links and the posts are loaded with infinite scroll? In a website that has posts system similar to Facebook, where the user has

: Will Google automatically re-index my page when I remove the 'noindex' tag On my request, our company has implemented a function in our website that adds <meta name="robots" content="noindex">

: Least SEO-disruptive HTTPS migration strategy We are moving a website from HTTP to HTTPS and I have read Google's support article which is quite good: https://support.google.com/webmasters/answer/6033049

: Angular2 : 'Fetch as Google' doesn't render page I am working on Angular2 based web app. I used Angular CLI to generate app and then to build it for prod. I have hosted website on AWS S3

: Google Blocked Resources showing incorrect data In Google Webmaster Blocked Resources tab it is showing 500+ blocked resource (like .js and .css), but when I tested those URL in robots.txt Tester

: Avoid "Cloaking" with GeoIP Redirects I'm currently working on a US-based site that consists of the following: National Landing Site (call this WWW, i.e. www.site.com) 50 regional subdomains,

: Does adding CDN stops Google from crawling? I want to add Cloudflare free CDN to my site but worried about whether Google bots will be able to crawl my site later on or not.

: How block only Yandex bot Can you show me how will look robots.txt when I block only yandex bot, allow Google bot and block Yandex bot.

: GoogleBot is crawling my datepicker to inifnity Our website is an agenda of events taking place in our city. We have a datepicker for users to look at events scheduled in the next week, next

: SEO - Pages are blocked because google failed to get the resource since it is blocked by robots.txt I would like to index all the pages in my angular site by Google. I used ngMeta in my

: How can I manage my web site search result in google? I am managing an e-commerce website. I do not want google to crawl my products and any subpages. All I want is to just crawl my index

: How do you properly SEO-tag an app that is only a catalogue of images? I am making a little helper app that mostly links a lot of graphs and images. There is also some text explaining a

: Site not indexed after moving site from WordPress to Magento I moved a site from WordPress to Magento. But now Google webmaster does not index the site. I have submitted the sitemap, but it

: Will Google respect changing the description with JavaScript? I am building a single-page-application/SPA that uses JavaScript to control all the pages. Naturally, this means only one meta description

: Google not crawling my site (robots.txt error) I'm currently performing SEO for my client's project. I'm kind of new to this, so please bear with me. I've read a lot mixed reviews on inclusion

: How to check whether the infinite page scroll data is crawled and indexed by google or not? I am having a music platform website where at a time 20 songs are visible right now then after

: SEO: Moving domain without having access to the old domain The mother of my girlfriend has a contract with a company that provides her website and domain. The contract costs 360€ per year

: Google bot requesting URLs from old 301 redirectd site and then reporting a bunch of 404 errors I'm reviewing some errors in Google Webmaster Tools / Search Console. I'm getting a lot of

: Sudden traffic fall related with DNS Error We juts notice a real time traffic fall in our website , from 1500 visits to 600 real time. This is extremely rare, I do a check on the behavor

: Sudden Spike in mobile app crawl errors - Search console We are seeing something weird in our mobile app crawl dashboard on the search console. Up until 3rd Feb, we had only 3 crawl errors

: Google Search Console: 404 errors on existing pages There is a few years old small website with very few pages (~5), which were indexed and ranked by Google. A few days ago 4 of those pages

: How do I stop Google from indexing AJAX calls within Javascript? We are getting a number of odd results come up on Google EG: http://www.somedomain.com/somepage/AjaxFunction.aspx?stuff=XXX&other=XXX

: Does Search Console 404s from relative path links affect Crawl Budget? Search Console is reporting 404s for URLs that don't exist on my site. However, GoogleBot seems to be crawling a URL by

: Googlebot not indexing https pages with 301 redirect I recently installed a new SSL in my blog and i forced 301 redirect on all http to https pages. It took like 2 months for google to index
Next Page
Terms of Use Create Support ticket Your support tickets Powered by ePowerPress Stock Market News! Top Seo SMO © topseosmo.com2022 All Rights reserved.