# Indexing: When Google Ignores Your Important Pages

> "Crawled - currently not indexed" is a puzzle for many SEO marketers. Some pages simply cannot be found. Here we discuss the solutions.

- URL: https://www.jaeckert-odaniel.com/en/indexing-when-google-ignores-your-important-pages/
- Language: en
- Published: 2024-06-03
- Updated: 2024-06-07
- Author: [Fabian Jaeckert](https://www.jaeckert-odaniel.com/en/about-us/fabian-jaeckert/)
- German version: https://www.jaeckert-odaniel.com/wenn-google-deine-wichtigen-seiten-ignoriert.md
- Topics: technik

---

<a slot="topics" href="#grauerindex">What is the gray index?</a>
<a slot="topics" href="#relevanz">Why this matters</a>
<a slot="topics" href="#loesung">How we solve the problem</a>

For many marketing leads it is a puzzle. Some of their pages simply cannot be found in search, even if you google for them very specifically. Product pages, for example. Even if you search for the product combined with the company name, the matching result does not come up.

Similar situations also exist with glossary articles, press releases, and many other formats and page types.

There is a report in Google Search Console for exactly this problem: "Crawled - currently not indexed". Google crawls an extreme number of pages, meaning URLs. But by no means every one of them makes it into the index, and therefore into the ranking.

In our Academy we offer [a workshop on this](https://academy.jaeckert-odaniel.com/der-graue-index-in-der-search-console-teil-2/). There we go into Google Search Console and discuss the problem using a sample website from an Academy member. It is the second part of our workshop series on the "gray index" ([the recording of part 1 is here](https://academy.jaeckert-odaniel.com/der-graue-index-in-der-google-search-console/)).

## What the gray index in Google Search Console is

Under the menu item "Indexing", all pages known to Google are shown. For smaller websites that is hundreds to thousands of URLs. For shops and portals it quickly reaches hundreds of thousands or millions of URLs.

They are sorted into a "green" index and a "gray" index (see image). The green index lists all URLs that are in the Google index, and therefore have a chance of being visible in the Google ranking.

The gray index holds all URLs that exist, but are not indexed by Google, and therefore do not appear in the ranking, meaning the search results, in the first place. There can be many different reasons for that. More on that here.

For example, website owners set redirects or exclude individual URLs from indexing ("no-index").

The report we are talking about is about something else, though: **Google excludes URLs without you having intended it**. That is why the report also says "Google systems" under "Source", and not "Website".

[In this guide](https://www.linkedin.com/posts/fabianjaeckert_checkliste-indexierung-pr%C3%BCfen-activity-7204009520497344512-L4d7), Fabian explains how you can quickly check whether you have an indexing problem.

## Why optimizing indexing matters

In SEO, a great deal revolves around keywords, content, and links. But the basis of everything is the technology. Website owners face the task of signaling to Google exactly which URLs should go into the Google index, and which should not.

A lot of mistakes are often made here. Those mistakes are rarely recognized, though. The case described at the start, where the company itself notices, is already an exception.

A technical optimization automatically affects the whole website. In the chart you see, for example, [a consulting project](https://www.jaeckert-odaniel.com/en/consulting/) of ours in which we were able to reduce the gray index, and the number of indexed pages increased sharply as a result. The consequence: the website received **significantly more traffic via Google**.

## How we solve the problem

**Look for patterns**

The report itself shows hundreds of sample URLs. So Google itself does not show every page there that has been crawled but not indexed. But at least a large share, and definitely a larger share than if you search for examples by hand. We analyze the report and look for patterns there, meaning whether certain page types or URL types appear there more often. That way you often get to the bottom of the cause. By the way: with unimportant page types it can also be that you do not need to pursue the problem directly, or that you assign it a much lower priority. Because not every problem is equally important. Often a core point in our SEO consulting.

**Fix technical problems**

Even though Google itself says in the report that you have no control over it, there are still options. Because the cause often lies somewhere else, which in turn leads to this technical problem. Examples: faulty markup of the language versions (hreflang), or faulty programming. That in turn leads to duplicate structures and duplicates. The website and its entire content are essentially mirrored several times. Google then knows all the content and throws pages out on its own. Which ones is then left to chance. So at the core it is about keeping your website lean and steering indexing through that.

## We advise marketing leads on SEO

We are Fabian Jaeckert (on the right) and Benjamin O'Daniel. For many years we have worked as consultants for marketing teams. In doing so we connect two worlds: Fabian is the technical expert, Benjamin takes on every topic around content development.

> Fabian and Benjamin were recommended to us by a prominent figure in online marketing. The SEO concept they developed both revealed new opportunities for us and confirmed existing approaches. It was highly beneficial to gain an external perspective. Their concept now serves as a guiding star that will guide us going forward. Some aspects have already been implemented, and others are ready for implementation.
>
> — Florian Heidinger, Benz24

"How can we improve our SEO visibility?"

This fundamental question sits behind every project we are brought into.

It is often about reviewing existing SEO and content strategies from the outside and developing new levers.

That is exactly what we have specialized in.

We run SEO audits and look at technology, rankings, and content. Afterwards we develop SEO strategies (keywords, content templates, roadmaps). We present that in focus workshops, in a structured and understandable way, to the people responsible. Afterwards we support the in-house leads during implementation.

Sound interesting?

We can arrange an introductory SEO video call (30 min.).

[Get in touch](mailto:info@jaeckert-odaniel.com)

## Deepen your SEO knowledge: every Monday by email

## Our conversations with SEO professionals in the industry

### SEO quality assurance: how to protect your rankings. Interview with Gianna Brachetti-Truskawa

### What does an online shop need in order to rank successfully? Interview with Stefan Vorwerk

### How Hansgrohe does SEO in 40 countries: Interview with Jörg Niethammer

### How B2B SEO works: Interview with Melissa Karabacak and Anke Peuss

### The SEO strategy of Hubspot: Interview with Jenny Lapp

### How user testing works: Interview with Astrid Kramer on UX and SEO

### SEO for software companies: Interview with Lisa Karasch

### SEO for a furniture startup: Interview with Manon Tolkowski
