Diving Into 404 Not Indexed Pages

Should you be concerned if you get a report from Google’s Search Console indicating some pages on your website are not being indexed? Will those pages directly affect your search ranking?

The answer to if 404 not indexed pages will directly effect your search ranking is NO, it does NOT. Do they need to be fixed? That depends on why they aren’t being indexed.

To view the specific URLs on your website that are causing 404 errors in Google’s Search Console (GSC) and understand why they are not indexed, follow these steps:

  1. Access Google Search Console:
  2. Navigate to the Page Indexing Report:
    • In the left sidebar, click on Indexing > Pages. This opens the Page Indexing report, which lists reasons why pages on your site are not indexed, including “Not found (404)” errors.
  3. Locate the 404 Errors:
    • Scroll down to the section labeled Not found (404) in the “Why pages aren’t indexed” table. This section shows the number of URLs returning a 404 error.
    • Click on the Not found (404) row to expand it. This displays a list of up to 1,000 URLs that Googlebot tried to crawl but found missing. The list includes the last crawl date for each URL.
  4. Inspect Individual URLs:
    • Click on any URL in the list to open the URL Inspection tool. This provides details about the specific URL, including:
      • The source of the crawl (e.g., where Google found the link, such as internal links, external links, or sitemaps).
      • The HTTP response (confirming the 404 status).
      • Additional information like whether the page was linked from your sitemap or other pages.
  5. Export the List of 404 URLs:
    • To see all affected URLs (especially if there are more than a few), click the Export icon (usually in the top right corner of the table). You can download the list as a CSV file, Excel file, or Google Sheets for further analysis.
  6. Analyze the URLs:
    • Review the exported list to identify patterns, such as:
      • URLs that were deleted or renamed (common after site migrations or URL structure changes).
      • Typos in internal links or sitemaps.
      • External links pointing to non-existent pages (e.g., from spam or outdated backlinks).
      • Pages impacted by SEO spam or hacks, which may have created and then removed spam pages.
  7. Additional Tools for Insight:
    • Use the URL Inspection Tool directly (found in the left sidebar) to manually check specific URLs for indexing status and crawl issues.
    • Check your sitemap in GSC (under Sitemaps in the sidebar) to ensure it doesn’t include URLs that no longer exist, as this can trigger 404 errors.

Notes:

  • GSC limits the list to 1,000 URLs, so it may not show all 404s if you have more. Fixing the listed errors and requesting re-crawls can help reveal additional ones.
  • Not all 404s need fixing (e.g., external spam links to non-existent pages can be ignored). Focus on 404s from internal links or sitemaps.

It’s been my experience that at least for WordPress sites, most SEO plugins like Yoast, RankMath and AIOSEO do an excellent job of managing sitemaps. It’s worth noting that since WordPress 5.5, XML sitemaps have been built into the core, so you may not need a plugin solely for basic sitemap functionality. However, these plugins enhance sitemap management with advanced customization, analytics integration, and additional SEO tools.

ProlimeHost RAID Server Solutions

BROUGHT TO YOU BY PROLIMEHOST

We’ve been in the web hosting industry for over a decade, helping hundreds of clients succeed in what they do best and that’s running their business. We specialize in Virtual Private Servers (VPS) and dedicated servers, with data centers in Los Angeles, Denver & Singapore.

VPS SERVICES: LIGHTNING FAST SSD VIRTUAL SERVERS

Our Virtual Private Servers all feature high performance Xeon processors and SSD storage in a RAID10 configuration to optimize your server’s performance, which dramatically enhances visitor experiences on your site.

That speed is backed by unparalleled 24/7 support, featuring both outstanding response AND resolution times to maximize your uptime.

Now is the time to join the ProlimeHost virtual private server revolution.

DEDICATED SERVERS: BACKED BY A 99.9% SLA NETWORK UPTIME GUARANTEE

We only use enterprise-class hardware in our dedicated servers and offer a four (4) hour hardware replacement. Throw in IPMI for remote management, support for public and private networks, free operating system (OS) re-installs, and SATA, SAS & SSD (including NVMe) storage. Call 1-877-477-9454 or contact us. For everything from gaming servers to cheap dedicated servers, we’re here to help.

ASIA OPTIMIZED NETWORK: IMPROVING CONNECTION SPEED AND QUALITY

Procuring an Asia optimized server improves the connection speed and quality between the server and the users in Asia or China. This can reduce latency, packet loss, jitter, and bandwidth issues that can affect the performance and reliability of the server and the applications hosted on it. For more information, please call 1-877-477-9454 or contact us

Steve

Leave a Reply