Technical SEO

Technical SEO in 2026: A Field Guide From the Sites We Fix

Technical SEO is not a 200-row spreadsheet of warnings. It is the plumbing that decides whether Google can find, read and trust your pages. Here is how we audit it and, more usefully, the order we fix things in.

By EmergingAds SEO Team  /  2 Oct 2026  /  15 min read
Technical SEO field guide cover showing crawling, rendering and indexing concepts

Key takeaways

  • Technical SEO is about four questions in order: can Google crawl it, render it, index it and understand which version counts.
  • Most audits fail because they list every warning at equal weight. Triage by how many valuable URLs an issue touches.
  • Search Console’s Page indexing report and your server logs tell you more than any crawler score ever will.
  • Canonicals, redirects and sitemaps must all agree. Mixed signals are the most common problem we find on inherited sites.
  • Fix indexing blockers first, then duplication and architecture, then speed and structured data polish.

01What technical SEO really covers (and what it does not)

When a founder asks us about technical SEO, they usually mean one of two things: a site that has quietly dropped out of Google, or an audit tool that has just emailed them a health score of 61 out of 100. The first is urgent. The second is often noise. Technical SEO is the work that makes sure search engines can discover your pages, render them the way a visitor sees them, store them in the index and understand which version of each page is the real one. Everything else in search engine optimisation sits on top of that foundation.

It is not copywriting, it is not link building and it is not choosing keywords. Those matter just as much, but they are wasted if the page carrying them is invisible or split across five duplicate URLs. We have taken on sites with genuinely excellent content that ranked for almost nothing, because a staging robots.txt rule had been copied to production during a redesign. Nobody noticed for four months. The content was never the problem.

The four questions we ask of every site

  1. Can Google crawl it? Are important URLs linked, allowed in robots.txt and returning a 200 status quickly?
  2. Can Google render it? Does the main content and the internal linking exist in the HTML, or only after JavaScript runs?
  3. Will Google index it? Is the page unique, useful and free of noindex tags or conflicting canonical signals?
  4. Does Google understand it? Is the site structure clear, is the right version canonical, and does structured data describe the page accurately?

If you keep those four questions in that order, most technical SEO decisions become obvious. A slow page that is not indexed is not a speed problem. It is an indexing problem, and it gets fixed first.

Four steps from crawling to rendering, indexing and understanding a page in technical SEO
The four questions we ask of every site, in the order we ask them.

02Crawling: helping Google find the pages that earn money

Crawling is discovery. Googlebot follows links and reads sitemaps, and it has only so much patience for any single site. For a 40-page service business, crawl budget is almost never the issue. For a WooCommerce store with 3,000 products and a filter system that generates a new URL for every combination of size, colour and price, it very much is.

Robots.txt: a scalpel, not a mop

Robots.txt tells crawlers which paths they may request. It does not remove a page from the index. We see this misunderstanding weekly: a client blocks a folder of thin pages in robots.txt, and months later those URLs still appear in results with no description, because Google knows they exist but is not allowed to read the noindex tag on them. If you want a page out of the index, let it be crawled and use noindex, or remove it and return a 404 or 410. Use robots.txt to stop crawlers wasting time on internal search results, cart pages and endless parameter combinations.

Internal links do more work than sitemaps

An XML sitemap is a hint. An internal link from a page Google already values is a much louder one. On a B2B site we inherited last year, the highest-margin service pages sat four clicks deep behind a mega menu that only rendered on hover through JavaScript. Moving those links into the plain HTML navigation and adding contextual links from the blog did more for those pages than any sitemap resubmission. If you are on WordPress, this is often a theme decision, and it is worth raising with whoever handles your WordPress website design before the next rebuild.

Rule of thumbIf a page matters commercially, it should be reachable in three clicks from the homepage through plain HTML links. If it is not, fix the architecture before you worry about anything else in this guide.

03Rendering and JavaScript: what Google sees vs what you see

Google renders pages with an up to date version of Chromium, so it can process most modern JavaScript. The catch is that rendering is a separate step and can happen later than the initial crawl. If your product descriptions, prices or internal links only appear after a script runs, you are relying on that second step going smoothly every time.

Our simple test: open the page, view the raw source (not the inspected DOM), and search for a sentence from the main content. If it is not there, the page depends on client-side rendering. Then use the URL Inspection tool in Search Console, look at the rendered HTML Google captured, and compare. We have found headless builds where the rendered HTML Google stored was missing half the page because an API call timed out.

Rendering approachWhat Google receives firstRisk level for SEOWhere we see it
Server-side rendering (SSR)Full HTML with content and linksLowMost WordPress and Shopify themes
Static generationPre-built HTML filesLowMarketing sites on modern frameworks
Hybrid or hydrationHTML shell plus some contentMedium, depends on what is deferredHeadless ecommerce builds
Client-side only (CSR)Mostly empty shellHigh for content and linksOlder single page apps, some app builders

None of this means JavaScript is bad for SEO. It means the critical things (main copy, headings, links, canonical and meta robots tags) should be present in the HTML the server sends. Everything else can be enhanced afterwards.

Comparison of client-side rendered pages and server-side rendered pages for technical SEO
What Google gets first depends on how your pages are built.

04Indexing: reading the Page indexing report like a practitioner

The Page indexing report in Search Console is the single most useful technical SEO screen we open. It tells you which URLs Google has chosen not to index and, roughly, why. If your team has never set it up properly, our Google Search Console setup work usually starts here, because the reasons listed shape the whole audit.

Status you will seeWhat it usually means on real sitesWhat we do first
Crawled, currently not indexedGoogle read it and decided it was not worth storing yetCheck for thin or near-duplicate content and weak internal links
Discovered, currently not indexedGoogle knows the URL but has not crawled itImprove internal linking; check server speed and crawl waste
Duplicate, Google chose different canonicalYour canonical tag is being overruledFind the conflicting signals: links, sitemaps, redirects
Excluded by noindex tagSomeone asked for this, deliberately or notConfirm every noindex is intentional
Blocked by robots.txtCrawling disallowedConfirm the block is intended and not hiding key pages
Page with redirectURL redirects elsewhereRemove redirected URLs from sitemaps and internal links

A big number in the excluded column is not automatically bad. A Shopify store will always show plenty of excluded URLs because of tag pages, variant parameters and collection filters. What matters is whether pages you want indexed are sitting in there. Export the list, filter by your important templates (product, category, service, location) and start with those.

A quick diagnostic we run on every new account

  • Count the URLs in your XML sitemaps and compare with the indexed count for those sitemaps in Search Console.
  • Sample 20 URLs from the “crawled, currently not indexed” list and read them honestly. Would you index them?
  • Search for the site’s most important page by exact title. If it does not appear, inspect it before doing anything else.
  • Check the rendered HTML of one page per template for a stray noindex, often added by a plugin or staging setting.

05Canonicals, redirects and duplicate URLs

Duplication is the quiet killer on ecommerce and multi-location sites. The same product sits under three collection paths. The same service page exists with and without a trailing slash. HTTP and HTTPS both resolve. Each duplicate splits signals and asks Google to guess which one you meant.

A canonical tag is a strong hint, not a command. Google weighs it alongside internal links, sitemap entries, redirects and hreflang. When those signals disagree, Google picks its own canonical, and that is exactly what the “Google chose different canonical than user” status is telling you. On one Shopify store we manage, internal links pointed to the collection-scoped product URL while the canonical pointed to the clean product URL. Once the theme was edited to link to the clean URL everywhere, the conflicts cleared over the following weeks. If you run Shopify, this is one of the first things our Shopify website management team checks in a theme.

Redirect hygiene

  • Use 301s for permanent moves. Temporary redirects left in place for years send a muddled message.
  • Kill chains. A to B to C to D wastes crawl requests and slows users. Point A straight at D.
  • Update internal links after a redirect instead of relying on it forever.
  • Map redirects before a migration, not after traffic drops. Every old URL with links or traffic needs a destination.
  • Do not redirect everything to the homepage. Google tends to treat that as a soft 404.
From a migration we rescuedA retailer moved platforms and redirected 1,400 old product URLs to the new homepage. Organic revenue fell sharply within a fortnight. Rebuilding a one-to-one redirect map from old crawl data and backlink exports was tedious, but it was the only fix that worked. Keep a full crawl of your old site before any rebuild.
Checklist for canonical tags, redirects and duplicate URL hygiene
The duplication checks we run on every inherited site.

06Site architecture, XML sitemaps and international setups

Good architecture is a technical SEO decision disguised as a design one. Pages that sit close to the homepage and receive many internal links are treated as more important. Group pages into clear sections (services, industries, locations, resources) and link between related items so both people and crawlers can follow the logic.

XML sitemaps that actually help

A sitemap should list only canonical, indexable URLs that return a 200 status. A single sitemap file can hold up to 50,000 URLs or 50MB uncompressed, so larger sites split them, ideally by template: products, categories, posts, locations. That split pays off later, because Search Console then shows indexing coverage per sitemap and you can see at a glance that, say, only a fraction of product pages are indexed. Keep lastmod accurate. A lastmod that updates every day on every URL teaches Google to ignore it.

Hreflang and multi-region sites

If you sell into several countries or languages, hreflang tells Google which version to show to which audience. It is fiddly: every page must reference itself and its alternates, and the references must be reciprocal. Most hreflang problems we find are missing return links or tags pointing at redirected URLs. For brands expanding into the Gulf, the UK and Europe from one domain, our international SEO services usually start with a hreflang audit before any new content is written.

Bar chart of the technical SEO issues we most often find on inherited client sites
How often each issue shows up in our audits, scored 1 to 10 (illustrative, not a survey).

07Log files, structured data and the rest of the toolkit

Crawlers simulate. Server logs record. A log file shows every request Googlebot actually made, which templates it spends time on and which it ignores. On a large catalogue we analysed, a big share of Googlebot requests went to filtered URLs that were never meant to be indexed, while newer products waited weeks for a first crawl. Blocking those filter paths and tidying internal links changed where Googlebot spent its time. Always verify Googlebot by reverse DNS, as plenty of scrapers pretend to be it.

Tools we use and what each is good for

ToolBest atWhere it misleads
Google Search ConsoleWhat Google actually indexed and whyData is sampled and delayed
Screaming FrogFull crawls, redirect maps, rendering checksFlags warnings that may not matter
Server log analysersReal Googlebot behaviourNeeds clean, verified logs
PageSpeed InsightsField and lab performance dataLab scores vary run to run
Rich Results TestStructured data eligibilityValid markup does not guarantee a rich result

Our starting point is almost always a full crawl, and our Screaming Frog technical SEO audit pairs that crawl with Search Console and log data so every issue is tied to real URLs. For a free overview first, our main site also keeps a shorter technical SEO checklist you can work through.

Structured data: describe, do not decorate

Schema markup helps search engines understand entities on a page: a product with a price, an organisation with an address, an article with an author. It can make pages eligible for rich results, but eligibility is not a promise, and Google has narrowed some rich result types over the years, FAQ rich results being the best known example. Mark up what is genuinely on the page, keep it consistent with visible content, and validate it after every theme update. We usually deploy it through the template or a controlled Google Tag Manager setup only when the CMS gives us no cleaner option.

Core Web Vitals belong in this toolkit too. Google’s published good thresholds are LCP of 2.5 seconds or less, INP of 200 milliseconds or less and CLS of 0.1 or less. They matter, but in our experience they rarely rescue a page with indexing or duplication problems. For stores where speed is the real bottleneck, we run a dedicated Shopify speed optimisation sprint once the indexing picture is clean.

Matrix plotting technical SEO fixes by effort and impact on indexed revenue pages
How we sort audit findings before a sprint (illustrative placement).

08The technical SEO triage order we use on live accounts

Every audit produces more fixes than any team can ship in a month. The skill is ordering them. We score each issue by how many valuable URLs it touches and how directly it blocks crawling or indexing, then work down the list. This is the order that has served our clients best across ecommerce, SaaS and local service sites.

  1. Indexing blockers. Stray noindex tags, robots.txt blocking key folders, broken canonicals pointing at the wrong page, server errors.
  2. Duplication and canonical conflicts. Parameter URLs, trailing slash variants, collection paths, HTTP vs HTTPS.
  3. Architecture and internal linking. Orphaned money pages, deep click depth, JavaScript-only navigation.
  4. Redirects and broken links. Chains, loops, 404s with backlinks pointing at them.
  5. Sitemaps and hreflang. Clean, split, accurate, reciprocal.
  6. Performance and structured data. Core Web Vitals, schema validation, image formats.

A slow page that is not indexed is not a speed problem. Fix the order, and the order fixes the site.

For ecommerce, filters and variants push duplication up the list, and our ecommerce SEO work tends to spend more of its first month on crawl control than anything else. Content-led sites usually move faster to internal linking and template fixes on titles and headings, which is where on-page SEO services pick up the baton.

Pyramid showing the technical SEO triage order from indexing blockers to performance polish
Our triage order: fix the base before polishing the top.

09When to handle technical SEO in-house and when to call for help

Plenty of technical SEO can be done by a sharp marketing lead with Search Console, a crawler and a developer willing to listen. Checking the Page indexing report monthly, keeping sitemaps clean and fixing broken internal links does not need an agency. Migrations, headless rebuilds, large catalogues and international setups are different. The cost of a mistake is measured in months of lost traffic, and the fixes need someone who has seen the failure before.

If you want a second pair of eyes, you can browse everything we do on our services page, or head back to the EmergingAds SEO blog homepage for the rest of this series. Next in the series we move from how Google reads a site to what people type into it, starting with keyword research.

Frequently asked questions

Straight answers to what clients ask us most about technical seo.

What is technical SEO in simple terms?
Technical SEO is the work that makes sure search engines can find, render, index and understand your pages. It covers crawl access, site architecture, canonical tags, redirects, sitemaps, JavaScript rendering and structured data. It does not cover what your content says, but without it, even excellent content can stay invisible in search results for months.
How often should we run a technical SEO audit?
We run a full crawl and Search Console review quarterly for most clients, and monthly for large ecommerce catalogues or sites that ship frequent releases. Always run one before and after a migration, theme change or platform move. Between audits, a quick weekly look at the Page indexing report catches most surprises before they cost you traffic.
Does robots.txt stop a page from being indexed?
No. Robots.txt only controls crawling. If other pages link to a blocked URL, Google can still index it, usually without a description. To keep a page out of the index, allow crawling and add a noindex meta tag, or remove the page and return a 404 or 410 status code.
What does crawled, currently not indexed mean?
It means Google visited the page and decided not to store it for now. On sites we manage, the usual causes are thin or near-duplicate content, weak internal linking or a page that simply adds little beyond what is already indexed. Improve the page, link to it from relevant stronger pages and request indexing once it is genuinely better.
Is JavaScript bad for SEO?
Not inherently. Google renders JavaScript with a modern browser engine. The risk is depending on it for essential content, links or meta tags, because rendering is a separate step that can be delayed or fail. Serve main copy, headings, navigation links and canonical tags in the initial HTML and use JavaScript to enhance the experience rather than build it.
Should every page have a canonical tag?
We recommend a self-referencing canonical on every indexable page, because it removes ambiguity when tracking parameters or alternate paths create duplicates. Canonicals are hints, so they must agree with your internal links, sitemaps and redirects. If those signals conflict, Google may choose a different canonical, which you will see flagged in Search Console.
How long do technical SEO fixes take to show results?
It depends on how often Google crawls the affected pages. Removing a stray noindex on an important page can show results within days. Fixing duplication across thousands of URLs can take several weeks to settle as Google recrawls and consolidates. We track indexed counts per sitemap so clients can watch progress rather than guess.
Do XML sitemaps improve rankings?
Not directly. A sitemap helps Google discover and prioritise URLs, especially on large or new sites, and it gives you useful indexing data in Search Console. Include only canonical, indexable pages that return a 200 status. A sitemap full of redirects, noindexed pages or parameter URLs sends mixed signals and makes your reports harder to read.
What is the difference between a 301 and a 302 redirect for SEO?
A 301 signals a permanent move and a 302 a temporary one. Google can treat a long-standing 302 as permanent eventually, but we use 301s whenever a move is permanent because the intent is unambiguous. Avoid redirect chains, update internal links to the final URL and never mass redirect old pages to the homepage.
Do Core Web Vitals matter more than other technical fixes?
In our experience, no. Core Web Vitals are part of page experience and they matter for conversions, but they rarely outweigh relevance or indexing problems. We fix crawling, indexing and duplication first, then work on LCP, INP and CLS. A page that cannot be indexed gains nothing from loading faster.
Can we do technical SEO without a developer?
Some of it. Monitoring Search Console, cleaning sitemaps through your SEO plugin and fixing internal links is manageable for a marketing team. Template changes, server configuration, rendering issues and migrations usually need a developer. The best results we see come from a short weekly check-in between the SEO lead and one developer who owns the fixes.
Technical SEOCrawling and indexingSite architectureSEO audit
EA
EmergingAds SEO Team

The EmergingAds SEO team handles technical SEO, content and link building for brands that want organic growth that compounds. Everything here comes from sites we manage. See the full SEO service.

Free SEO and ads audit

Want to know which technical fixes actually matter on your site?

We will crawl your site, read your Search Console data and hand you a ranked list of fixes, starting with the ones that stop pages being indexed.

Book your free audit

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top