Technical SEO for Beginners: Crawling, Indexing, Core Web Vitals and Site Speed

You can write the best page in Jalandhar, but if Google cannot crawl it, index it or load it quickly on a phone, nobody will see it. That is what this guide to technical SEO for beginners covers: the behind-the-scenes foundations of crawling, indexing, Core Web Vitals and site speed, explained without jargon and with checks you can run yourself.

Quick Answer

Technical SEO for beginners means making sure search engines can crawl, index and render your website, and that it loads fast and works well on mobile. The core tasks are checking robots.txt and sitemaps, fixing indexing issues in Google Search Console, using HTTPS, and improving Core Web Vitals: LCP, INP and CLS.

What Is Technical SEO?

Technical SEO is the work of optimising a website's infrastructure so search engines can discover, understand and store its pages, and so users get a fast, stable experience. It sits alongside on-page SEO (the content of each page) and off-page SEO (links and mentions from elsewhere).

Think of on-page SEO as the stock in your shop and technical SEO as the road leading to it. If the road is blocked, the stock does not matter.

How Does Google Crawl and Index a Website?

Google works in three broad stages, and a problem at any stage stops a page from ranking.

1. Crawling: Googlebot discovers URLs by following links and reading sitemaps, then requests those pages.
2. Rendering: Google processes the HTML, CSS and JavaScript to see the page roughly as a visitor would.
3. Indexing: Google decides whether to store the page in its index. Only indexed pages can appear in search results or AI Overviews.

Crawl budget is the number of pages Google is willing to crawl on your site in a given period. Small sites rarely need to worry about it; large stores with thousands of filter URLs do.

robots.txt and XML sitemaps

robots.txt is a text file at the root of your domain that tells crawlers which areas they may not crawl. A single wrong line such as Disallow: / can block your entire site, often left over from a staging server.

An XML sitemap is a file listing the URLs you want search engines to find. WordPress with an SEO plugin like Yoast or Rank Math, and Shopify, generate one automatically. Submit it in Google Search Console under Sitemaps.

Why Are Some Pages Not Indexed?

Open Google Search Console, go to the Pages report, and you will see which URLs are indexed and why others are not. Common reasons include:

• noindex tag: the page tells Google not to index it. Useful for thank-you pages, harmful when left on by mistake.
• Canonicalised to another URL: a canonical tag tells Google which version of similar pages is the main one. Wrong canonicals hide the pages you want ranked.
• Duplicate content: the same text on several URLs, such as product variants or http and https versions.
• Crawled – currently not indexed: Google saw the page but did not think it was worth storing yet. This is usually a content quality or uniqueness issue, not a technical bug.
• 404 and soft 404 errors: broken or near-empty pages.

Use the URL Inspection tool to test any single page and request indexing after fixing it.

What Are Core Web Vitals in 2026?

Core Web Vitals are Google's metrics for real-world page experience, measured from actual Chrome users. There are three:

• LCP (Largest Contentful Paint): how quickly the main content, often a hero image or heading, appears. Google's "good" threshold is 2.5 seconds or less.
• INP (Interaction to Next Paint): how quickly the page responds when someone taps or clicks. INP replaced FID as a Core Web Vital in 2024. Good is 200 milliseconds or less.
• CLS (Cumulative Layout Shift): how much the layout jumps while loading, such as a button moving just as you tap it. Good is 0.1 or less.

Check them in PageSpeed Insights or the Core Web Vitals report in Search Console. Field data from real users matters more than a single lab score.

How Can Beginners Improve Site Speed?

Most slow small-business sites in Punjab share the same causes.

Fixing LCP

• Compress images and serve them in WebP or AVIF format.
• Do not lazy-load the main hero image; lazy-load images further down instead.
• Use decent hosting and a CDN such as Cloudflare, rather than the cheapest shared plan.

Fixing INP

• Remove unused plugins, chat widgets and tracking scripts you no longer need.
• Avoid heavy page builders stacking multiple sliders and animations on one page.

Fixing CLS

• Always set width and height on images and video embeds.
• Reserve space for banners, ads and cookie notices so they do not push content down.

Which Other Technical SEO Basics Should You Check?

• HTTPS everywhere: a valid SSL certificate and redirects from http to https.
• Mobile-friendly layout: Google uses mobile-first indexing, so the phone version is what it evaluates.
• Clean URL structure: readable, hyphenated URLs and a sensible folder hierarchy.
• Redirects: use 301 redirects when you change a URL, and avoid chains of redirect after redirect.
• Internal linking: every important page should be reachable within a few clicks from the homepage. Orphan pages with no links pointing to them are hard for Google to find.
• Structured data: schema markup helps search and AI engines understand page types; see our schema markup guide.
• Crawlable content for AI: keep key text in HTML rather than only inside images or scripts, so AI crawlers and answer engines can read it.

A Simple Technical SEO Audit Routine

1. Verify your site in Google Search Console and submit the sitemap.
2. Visit yourdomain.com/robots.txt and confirm nothing important is blocked.
3. Review the Pages report and fix noindex, canonical and 404 issues.
4. Run your top five pages through PageSpeed Insights on mobile.
5. Crawl the site with a tool like Screaming Frog (free up to a limit), Semrush or Ahrefs to find broken links and redirect chains.
6. Repeat monthly, and after every redesign or migration.

Once the foundations are solid, move to page-level work with our on-page SEO checklist.

Key Takeaways

• Technical SEO ensures Google can crawl, render and index your pages; unindexed pages cannot rank or appear in AI answers.
• robots.txt, XML sitemaps, canonical tags and noindex settings are the most common sources of silent problems.
• Core Web Vitals are LCP, INP and CLS; INP replaced FID in 2024.
• Image compression, fewer scripts and fixed image dimensions solve most speed issues on small sites.
• Google Search Console and PageSpeed Insights are free and enough to start auditing.

Learn Technical SEO at techcadd Jalandhar

Technical SEO becomes far less intimidating when you practise it on a real site. In the digital marketing course in Jalandhar at techcadd, you work with Search Console, PageSpeed Insights, sitemaps and WordPress or Shopify settings on live or demo projects. Learners who want to go deeper can also look at the SEO course in Jalandhar.

The programme is offered as 3-month, 6-month and 9-month certificate tracks, with analytics, tracking and advanced SEO covered more deeply in the longer tracks, plus placement assistance. Speak to a counsellor about which track suits you, and book a free demo class to experience a session first.

Frequently Asked Questions

Do I need coding skills to learn technical SEO?

No. Beginners can handle most technical SEO with tools such as Google Search Console, PageSpeed Insights, WordPress SEO plugins and site crawlers. Basic familiarity with HTML helps you read tags and spot issues, but you can pick that up gradually while practising on real websites.

How long does it take Google to index a new page?

It varies from a few hours to several weeks, depending on how often Google crawls your site, how well the page is linked internally and its perceived quality. Submitting a sitemap, linking the page from existing pages and using URL Inspection can help it get discovered sooner.

Does site speed directly affect rankings?

Page experience, including Core Web Vitals, is one of many ranking signals, and relevance usually matters more. However, a slow site loses visitors before they read anything, which hurts enquiries and sales. Improving speed is worthwhile for users even where ranking gains are modest.

What is the difference between noindex and robots.txt blocking?

robots.txt stops Google from crawling a URL, while a noindex tag lets Google crawl the page but tells it not to store it in the index. If you want a page removed from results, use noindex and keep it crawlable so Google can see the instruction.

Is technical SEO different for Shopify and WordPress?

The principles are the same, but the controls differ. WordPress gives more flexibility through plugins and hosting choices, while Shopify handles hosting, SSL and sitemaps for you but limits some settings. Apps and themes on either platform are common causes of slow loading.

How often should a small business run a technical SEO audit?

A light monthly check of Search Console reports and a fuller audit every few months is enough for most small business sites. Always run an audit immediately after a redesign, domain change or platform migration, because that is when indexing problems most often appear.