SEO

The Internal Linking System That Moves Rankings Without a Single New Backlink

Technical SEO. The Free Lever

The Internal Linking System That Moves Rankings Without a Single New Backlink

100%
In your control, unlike backlinks
200+
Deep pages revived in one client fix
3 clicks
Maximum depth for money pages
0
Rupees of link building budget required

Internal linking is the least glamorous lever in SEO and consistently one of the highest leverage. I have watched a site recover from a ranking slide purely by restoring internal links a redesign had deleted, and I have watched brand new pages rank in days because the internal architecture handed them authority from day one. No outreach, no budget, no waiting on anyone else.

The reason it works is simple: Google discovers, understands, and values your pages substantially through how you link to them. Every internal link is a vote you cast for your own page, with anchor text you fully control. Most sites cast those votes randomly.

The System, Not Just Tips

1
Map your money pages and their supporting cast

List the 10 to 20 pages that drive revenue. Every other page on the site exists, in linking terms, to support one of them. If a blog post cannot name which money page it supports, that is a content strategy problem wearing a linking disguise.

2
Link down from strength

Find your highest-authority pages: usually the homepage and your most-linked posts. Ensure each links, with descriptive anchors, to the money pages that need the push. Authority flows where you point it.

3
Fix the anchors

Click here and read more anchors waste the single strongest relevance signal you control. Anchors should describe the destination: e-commerce SEO services, not this page. Vary phrasing naturally across sources.

4
Kill the orphans and the depth traps

Any indexable page with zero internal links is invisible to the system. Any money page more than three clicks from the homepage is being quietly devalued. Crawl quarterly and fix both lists.

5
Wire new content on publish day

Every new post links to its cluster pillar and one money page, and receives a link from at least two existing relevant pages within a week. New content with inbound internal links gets crawled and ranked measurably faster.

The Quarterly Audit in Four Crawls

CheckTool and what to look for
Orphan pagesCrawl versus sitemap comparison. Pages in the sitemap with no inbound internal links.
Click depthAny crawler. Money pages deeper than three clicks from home.
Anchor qualityExport all anchors. Sort by generic phrases and rewrite the worst offenders.
Authority routingYour most-linked pages by external backlinks. Check where their internal links point, and whether that is where you want authority flowing.

The compounding effect surprises people. Internal linking improvements touch every page at once, which is why a disciplined pass often moves mid-tail rankings within two to four weeks, faster than almost any other on-site change I make.

A Worked Example: The Redesign Recovery

The clearest internal linking demonstration I have is the redesign case from my rankings emergencies: a beautiful new design that deleted a text-heavy footer and collapsed descriptive navigation into a minimal menu. Two hundred deep pages lost most of their inbound internal links overnight. No content changed, no backlinks were lost, and rankings for the mid-tail slid for six straight weeks anyway.

The recovery doubled as an upgrade: instead of restoring the old footer wholesale, we built a structured one, category hubs with descriptive anchors, routed from the pages with the strongest external links. Rankings recovered in roughly the time they had taken to fall, and several supporting pages settled higher than before, because for the first time the internal votes were deliberate instead of historical accident. Redesigns are the single most common way sites accidentally rewire their own authority. Put internal link preservation in every redesign checklist.

Internal linking mistakes that undo the system:

  • Sitewide links to every page, which is the same as emphasising nothing
  • The same exact anchor on every link to a page, which reads as a pattern, not language
  • Related posts widgets doing random selection and being mistaken for strategy
  • Linking only from new content to old, never updating old winners to vote for new pages
  • Nofollowing internal links, which simply throws the vote away

Questions I Get on This Topic

How many internal links per page is right? As many as genuinely help a reader, usually a handful in content plus structural navigation. The ceiling that matters is dilution: a page linking to 300 others passes little through each. Think in terms of emphasis, not counts.

Do breadcrumbs count as internal linking? Yes, and they are among the most valuable: consistent, descriptive, and structurally meaningful on every page. Breadcrumbs plus a disciplined content-to-money-page habit covers most of what sites are missing.

Can internal linking really substitute for backlinks? Substitute, no. Sequence, yes: internal architecture determines how efficiently the authority you already have gets used. Most sites have more unused authority than they think, and routing it is free.

Internal architecture work like this sits inside my technical SEO service.

Want your internal architecture mapped and fixed?

An internal linking audit is part of every technical SEO engagement I run: orphans, depth, anchors, and an authority routing plan your team can maintain.

Technical SEO ServicesBook a Free Strategy Call

Tags: Internal LinkingTechnical SEOSite Architecture

How Google AI Overviews Decide Which Sites to Feature: What the Data Shows

AI Search. How Selection Works

How Google AI Overviews Decide Which Sites to Feature: What the Data Shows

60%+
Of searches now end without a click
3 to 5
Sources typically cited per Overview
Top 10
Ranking still feeds most citations
40+
Client queries tracked for Overview presence

Google AI Overviews now sit above the traditional results for a growing share of queries, and they answer the question before anyone scrolls. For site owners the question has changed from how do I rank to how do I get cited inside the answer. After tracking Overview appearances across 40+ client queries for months, the selection logic is less mysterious than it looks.

The short version: AI Overviews are not a separate index. They are assembled from pages Google already trusts, overwhelmingly from the top ten organic results, then filtered for pages that answer cleanly. Ranking is the entry ticket. Extraction-friendliness decides who gets quoted.

The Four Filters Between Ranking and Citation

1
Direct answers near the top of the page

Cited pages answer the query within the first few hundred words, in plain declarative sentences. Pages that build up to the answer over 800 words of preamble rank fine but get skipped for citation. Lead with the answer, then earn depth.

2
Question-shaped structure

Headings phrased as the questions people ask, each followed by a self-contained answer. Overviews are assembled from fragments, and a fragment that makes sense alone is a fragment that gets used.

3
Verifiable specificity

Numbers, dates, named methods, and concrete steps get cited over general prose. Language models select passages that sound checkable. Vague content reads as filler to both readers and machines.

4
Independent corroboration

Overview citations skew toward claims that appear consistently across multiple trusted sources. Being the consensus, as with assistant recommendations, matters more than being unique on contested points.

“You do not optimise for AI Overviews instead of rankings. You optimise for rankings, then make every answer easy to lift.”

Ram Kr Shukla, SEO and Growth Consultant

What This Means for Your Content This Quarter

The Overview readiness pass, page by page:

  • Restructure money pages so the core question is answered in the first two paragraphs
  • Convert vague section headings into the actual questions buyers ask
  • Add a concrete number, timeframe, or named step to every major claim
  • Keep FAQ schema live and matched to real query phrasing
  • Track which of your queries trigger Overviews and whether you are cited, monthly, in a simple sheet

One caution: chasing Overview citations on queries where the Overview fully answers the question is chasing traffic that no longer exists. Prioritise queries where the Overview summarises but the searcher still needs depth, comparison, or a decision, because those still send clicks, and increasingly, pre-sold ones.

A Worked Example: Restructuring One Page Into the Overview

A client in the B2B services space ranked fourth for a definition-heavy query that had grown an AI Overview, and their traffic on it had eroded by a third. The page was a classic 2019 build: a slow scene-setting introduction, the actual answer arriving around word six hundred, headings written as clever phrases rather than questions.

The restructure took one working day: a direct two sentence answer moved to the top, headings rewritten as the questions the People Also Ask box already confirmed people ask, a specific timeline and cost range added to replace hedged generalities, and FAQ schema aligned to the new structure. Within three weeks the page was cited inside the Overview, and click-through recovered most of its loss, because a citation with your brand name attached converts the Overview from a traffic thief into a referrer. One page, one day, measurable within a month: that is the unit of work Overview optimisation actually comes in.

The Overview mistakes I keep correcting:

  • Chasing citations on queries the Overview fully answers, where the click is gone regardless
  • Burying the answer to protect scroll depth, an engagement metric Google no longer rewards there
  • Question headings with answers that depend on the previous section, unliftable as fragments
  • Treating the Overview as a separate strategy instead of a formatting layer over ranking fundamentals
  • Never tracking which of your queries even show Overviews, which makes progress invisible

Questions I Get on This Topic

Do AI Overviews kill more traffic than they send? On pure informational queries, often yes, and no restructuring changes that. On commercial and complex queries, the Overview summarises but the searcher still clicks for depth, and cited sources take a disproportionate share of those clicks. Fight on the second battlefield, not the first.

Does FAQ schema still matter for Overviews? The visual FAQ rich result has been reduced, but the structured question and answer pairs remain exactly the shape Overview assembly favours. Keep it on pages answering real questions; skip it as decoration.

Can I block AI Overviews from using my content? You can restrict via nosnippet controls, but you surrender the citation along with the excerpt. For most businesses the presence is worth more than the protection. Decide per content type, not sitewide.

Want to know which of your queries trigger Overviews and who gets cited?

I run AI visibility audits covering Google AI Overviews, ChatGPT, and Perplexity: where you appear, where competitors do, and the restructuring plan to close the gap.

Explore AI SEO ServicesBook a Free Strategy Call

Tags: AI OverviewsAI SEOGoogleCitations

Blog Traffic vs Category Traffic: Where E-Commerce Brands Should Actually Invest

The Allocation Argument. E-Commerce SEO

Blog Traffic vs Category Traffic: Where E-Commerce Brands Should Actually Invest

79%
Of conversions from commercial pages in my audit data
22 of 30
Audited stores over-invested in blog content
3x
Typical conversion gap, category versus blog visitor
60%
Impression growth from category work alone, one client

There is an allocation error hiding inside most e-commerce content budgets, and it is expensive. Ask a store owner where their SEO effort goes and the answer is almost always the blog: publishing schedules, topic calendars, freelance writers. Ask where their organic revenue comes from and the answer, once you actually attribute it, is category and product pages, usually by an enormous margin.

Across the 30 e-commerce SEO strategies I audited last year, 22 stores put the majority of their content effort into blogging while their category pages sat as bare product grids with a title tag. Meanwhile the commercial pages, roughly 6 percent of most sites’ indexed content, produced around 79 percent of organic conversions. The budget and the revenue were pointed in opposite directions.

Why the Blog Gets Overfunded

Three reasons, all understandable. Blog content is easy to commission: you can brief a writer today. Category page work is cross-functional: it needs SEO, copy, design, and dev cooperation, so it stalls. And blog metrics flatter: informational keywords have big volumes, so traffic charts rise, dashboards look healthy, and nobody asks the conversion question. Activity substitutes for outcome.

“Your blog builds the audience. Your category pages bank the revenue. Most stores fund the first like a business and the second like an afterthought.”

Ram Kr Shukla, SEO and Growth Consultant

What the Numbers Say, Side by Side

DimensionBlog and informational pagesCategory and commercial pages
Share of typical content budget60 to 80 percentUnder 20 percent
Conversion rate of visitors0.3 to 0.8 percent typical2 to 4 percent, and higher for alternatives pages
Time to rank6 to 12 months for competitive topics2 to 4 months, they inherit domain authority
Revenue attributionIndirect, assisted, hard to defendDirect, last-click visible, easy to defend
Compounding roleBuilds authority and email listConverts the authority into orders

The Category-First Playbook

1
Rewrite your top ten categories like buying guides

Real intro copy addressing how buyers choose, FAQ sections answering pre-purchase questions with schema, and internal links to your best supporting content. This single move outperformed entire quarters of blogging in my client work, including the fashion brand that went from zero to 120,000 monthly organic visitors.

2
Build the commercial middle layer

Best X for Y pages, comparison pages, and gift or use-case collections. These target buyers who know what they want but not which one. They rank faster than blog posts and convert several times better.

3
Then, and only then, blog with a job description

Every post gets a cluster, a money page to support, and a conversion path. Two to four pieces a month with structural purpose beats twelve orphans. The blog is the supporting cast, not the lead.

4
Route authority deliberately

Your blog’s accumulated authority is a battery. Internal links with descriptive anchors from your strongest posts into category and commercial pages is how you spend it. Most stores never wire this circuit at all.

The Reallocation, Practically

If you currently spend 80 percent of content effort on the blog, flip to roughly 60 percent commercial and 40 percent blog for two quarters. Do not stop blogging entirely: the informational layer feeds the email list, earns the links, and increasingly feeds AI assistant citations. This is a rebalance, not an abandonment. One client made exactly this shift and grew category impressions 60 percent in two months without publishing a single new blog post, purely from finally investing in the pages that sell.

The category-first reallocation described here is the core of my e-commerce SEO service.

Want the allocation audit for your store?

I will map your content spend against your actual organic revenue by page type, and show you precisely how far your budget and your income have drifted apart.

E-Commerce Marketing Services Book a Free Strategy Call

Tags: E-Commerce SEOContent StrategyCategory PagesBudget Allocation

The Free SEO Audit I Give Every Founder: My Exact 40 Point Checklist

The Working Checklist. Technical, Content, and Conversion

The Free SEO Audit I Give Every Founder: My Exact 40 Point Checklist

40
Checks, the same list I use on paid audits
6
Areas: technical, on-page, content, links, conversion, AI
30 min
To self-score your site honestly
0
Tools required beyond free ones

Every strategy call I take starts the same way: I run the site through a checklist I have refined over 18 years and hundreds of audits. Founders regularly ask if they can have the list. Here it is, complete, in the exact order I work through it.

A warning before you start: the list looks simple. Almost every item is a yes or no question you can answer in under a minute. The difficulty was never knowing what to check. It is knowing what the answers mean together, which fixes move revenue versus which just tidy up, and in what order to sequence them. That judgment is the actual product of 18 years. The list, you can have for free.

Technical Foundations (1 to 8)

Score one point per yes:

  • Your main content appears in View Source, not just after JavaScript renders
  • Site loads under 2.5 seconds on mobile (test a category or service page, not the homepage)
  • One canonical version of the site: single protocol, single host, no duplicate URL variants indexed
  • robots.txt is not blocking anything important, and you have looked at it in the last quarter
  • XML sitemap contains only live, indexable, canonical URLs
  • No index bloat: site: search count roughly matches your real page count
  • Faceted navigation and filter URLs are controlled with canonicals or noindex
  • Core Web Vitals pass in Search Console’s field data, not just Lighthouse lab runs

On-Page and Architecture (9 to 16)

Score one point per yes:

  • Every money page targets one primary keyword, and no two pages target the same one
  • Title tags lead with the keyword and read like something a human would click
  • One H1 per page, and heading levels follow an actual hierarchy
  • URLs are short, readable, and stable
  • Money pages are reachable within three clicks of the homepage
  • Internal links use descriptive anchors, not click here
  • Organisation and relevant page-level schema are implemented and valid
  • Images have descriptive file names and alt text on money pages

Content Reality Check (17 to 24)

Score one point per yes:

  • You know your branded versus non-branded traffic split without looking it up
  • Commercial intent pages exist: comparisons, alternatives, pricing, use cases
  • Every blog post belongs to a defined cluster with a pillar page
  • Your top 10 pages by traffic have been updated in the last 12 months
  • No two posts compete for the same query (no cannibalization in GSC)
  • Content answers the questions your sales team hears, not just keyword tools
  • Thin, outdated, and zero-traffic pages have been pruned or consolidated in the last year
  • At least one page of original data, research, or first-hand insight exists on the domain

Authority, Conversion, and AI (25 to 40)

Links and authority (25 to 30):

  • Referring domains have grown month over month for the last six months
  • You could show your backlink profile to Google without flinching
  • Anchor text distribution looks natural, dominated by brand and URL anchors
  • Your best links point at money pages, not only the homepage
  • You appear in at least three third party best-of or comparison articles for your category
  • No toxic link cleanup has been left unfinished

Conversion and measurement (31 to 36):

  • Every money page has one clear primary CTA above the fold
  • Informational content captures emails with a contextual offer, not a generic trial banner
  • GA4 attributes revenue or leads to organic landing pages, reviewed monthly
  • Forms ask for the minimum viable information
  • You know your organic visit-to-lead or visit-to-sale conversion rate
  • Somebody with authority sees organic revenue numbers every month

AI readiness (37 to 40):

  • You have tested what ChatGPT and Perplexity say when asked for recommendations in your category
  • Your entity description is identical across site, LinkedIn, and directories
  • Key pages read cleanly when converted to markdown or viewed as text
  • Structured data establishes who you are, what you sell, and where you operate

How to Read Your Score

ScoreWhat it means
Above 32Strong foundation. Your gains now come from content depth, digital PR, and conversion optimisation, not fixes.
24 to 32Typical for a decent site. Usually two or three structural issues are silently capping everything else. Sequencing matters most here.
16 to 24Meaningful revenue is being left on the table. Expect the first two quarters of work to feel like repair, then compounding starts.
Below 16Do not buy more content or links. Fix the foundation first, or every rupee spent on top of it is discounted.

“The checklist is free because the list was never the moat. Knowing which three of the forty items are strangling your growth, that is the moat.”

Ram Kr Shukla, SEO and Growth Consultant

This checklist is the public skeleton of my fixed-scope SEO audit: the paid version runs it against your data and competitors, then sequences the fixes by revenue impact.

Want me to run this list on your site with you?

Bring your score to a free 30 minute call. I will tell you which failing items actually matter for your revenue, which can wait, and what order to fix them in.

See How I Work Book a Free Strategy Call

Tags: SEO AuditChecklistTechnical SEOFounders

I Asked ChatGPT, Perplexity, and Gemini to Recommend Brands in 10 Industries. Here Is Who Gets Cited and Why

Original Research. AI Search Visibility

I Asked ChatGPT, Perplexity, and Gemini to Recommend Brands in 10 Industries. Here Is Who Gets Cited and Why

150
Prompts run across three AI assistants
10
Industries tested, India and global
4
Signals shared by almost every cited brand
68%
Of cited brands appear in third party listicles

Every founder I meet now asks some version of the same question: when someone asks ChatGPT for a recommendation in my category, do I come up? Almost nobody has actually tested it. So I did, systematically.

Over two weeks I ran 150 recommendation prompts across ChatGPT, Perplexity, and Gemini: ten industries, five buyer-style questions per industry, repeated across all three assistants. Categories ranged from D2C skincare and project management software to business loans and online MBA programmes. I logged every brand cited, where the assistant sourced it when citations were visible, and what those brands had in common. The patterns were far more consistent than I expected.

The Headline Finding: AI Does Not Discover Brands. It Repeats Consensus

The single biggest pattern: assistants overwhelmingly recommend brands that already appear in aggregated third party content. Best-of listicles, comparison articles, review platforms, and category roundups. In my sample, 68 percent of all cited brands appeared in at least three independent listicle-style pages ranking in Google’s top ten for related queries. The assistants are not crawling your homepage and judging your product. They are synthesising what the web already says repeatedly about your category.

“Google ranks pages. AI assistants rank reputations. You cannot prompt-engineer your way into being the consensus answer. You have to actually become it.”

Ram Kr Shukla, SEO and Growth Consultant

The Four Signals Cited Brands Share

1
Presence in third party comparison content

The strongest signal by a distance. Brands cited by assistants live in someone else’s best-of lists, not just their own website. Digital PR that lands you in credible roundups is now AI visibility work, not just link building.

2
A clean, consistent entity description

Cited brands describe themselves the same way everywhere: same category label, same positioning phrase, on their site, LinkedIn, directories, and press. Assistants echo that language almost verbatim. Brands with fuzzy, inconsistent descriptions got miscategorised or skipped.

3
Structured comparison content on their own site

Brands that publish honest versus pages and alternatives pages were disproportionately cited, especially by Perplexity, which loves a page that already did the comparison work. This matched what I have seen drive conversions in my SaaS client work too.

4
Wikipedia or strong knowledge graph presence

For established categories, brands with a Wikipedia page or rich knowledge panel were cited roughly twice as often in my sample. Entity infrastructure that felt optional in classic SEO is becoming table stakes for AI visibility.

What Differed Between the Three Assistants

AssistantWhat I observed across 50 prompts each
ChatGPTLeans on training data consensus. Slow to reflect new brands, strong bias toward category leaders and brands with heavy historical coverage.
PerplexityMost responsive to current top-ranking content. Brands in fresh listicles and recent comparisons surfaced quickly. The most winnable assistant for challengers.
GeminiClosest to Google’s own results. Strong overlap with top organic rankings and heavy weight on review platforms and knowledge graph data.

What to Do With This

The AI citation playbook, in priority order:

  • Run your own version of this test: 15 buyer-style prompts in your category across all three assistants, logged in a sheet. That baseline is your starting scoreboard.
  • Audit the listicles and comparison pages ranking for your category keywords. Every one you are missing from is a citation you are not getting.
  • Standardise your entity description everywhere: one category label, one positioning sentence, used identically across your site, profiles, and PR.
  • Publish honest comparison and alternatives pages on your own domain.
  • Build the knowledge graph layer: Organisation schema, consistent sameAs links, and press coverage that establishes you as an entity, not just a website.

This research is a snapshot, not a permanent truth. Assistant behaviour shifts with every model release, which is exactly why I now run this test quarterly for clients. The brands doing this work now are compounding a lead that will be very expensive to close later.

Earning the third party placements this research identifies is the modern half of my link building and digital PR service.

Want your AI citation baseline measured?

I run this exact test for client brands: 15 category prompts across ChatGPT, Perplexity, and Gemini, competitor citation comparison, and a prioritised plan to become the consensus answer in your category.

Explore AI SEO Services Book a Free Strategy Call

Tags: AI SEOOriginal ResearchChatGPTAI Visibility

Your Content Exists But Google Cannot See It: Diagnosing and Fixing Client-Side Rendering

Technical SEO. Field Notes From Multiple Brand Audits

Your Content Exists But Google Cannot See It: Diagnosing and Fixing Client-Side Rendering

7
Brands audited with this exact problem in the past year
0
Of them knew rendering was the cause before the audit
5 min
To run the diagnostic yourself with this post
Weeks
Of indexing delay this problem quietly causes

The pattern is always the same. A founder or marketing head tells me their content is not ranking, sometimes not even indexed. The team swears everything is fine: the pages load, the content is there, the sitemap is submitted. Everyone is confused and someone has usually already blamed the content team.

Then I open the page source, and the mystery dissolves in about thirty seconds. The HTML the server sends contains a page title, a JavaScript bundle, and almost nothing else. The content everyone can see in their browser is assembled by JavaScript after the page arrives. Visitors get the full page. Google’s first crawl gets an empty shell.

I have now audited and fixed this exact situation for seven brands in the past year: React storefronts, Vue marketing sites, and single page applications of every flavour. This post is the full playbook: how to diagnose it in five minutes, why it happens, and which fix fits which situation, because the right answer is different for a 40 page marketing site and a 40,000 page store.

Why This Happens: Google Crawls in Two Waves

Googlebot processes pages in two passes. The first wave fetches your raw HTML and indexes what it finds immediately. If your content, links, and meta tags are in that HTML, you are done. The second wave happens only for JavaScript-heavy pages: the URL goes into a rendering queue, where Google’s Web Rendering Service eventually executes your JavaScript and sees the assembled page.

The word doing the damage is eventually. That rendering queue can take hours, days, or in low-authority sites, weeks. And rendering is expensive for Google, so pages that look empty on the first pass get crawled less enthusiastically over time. On one audit, a client’s new product pages were taking 3 weeks to appear in the index while their server-rendered competitor showed up in hours. Same content quality. Different plumbing.

“Client-side rendering asks Google to do your work for you. Google will do it, reluctantly, slowly, and less often for sites that make it a habit.”

Ram Kr Shukla, SEO and Technical Consultant

The Five Minute Diagnostic

1
View source, then search for your own content

Right click, View Page Source, and search for a sentence from your main content. Not Inspect Element, which shows the assembled page. View Source shows what the server actually sent. If your paragraph is not in there, Google’s first wave cannot see it either.

2
Confirm with the URL Inspection tool

In Search Console, inspect a suspect URL and click View Crawled Page. Compare the HTML Google stored against what users see. Pay attention to Page Resources too: blocked or failing JavaScript files listed there are part of the crime scene.

3
Run the two-crawl comparison in Screaming Frog

Crawl the site twice: once with rendering set to Text Only, once set to JavaScript. Compare word counts and internal links per page between the two crawls. Every page where the text crawl finds dramatically less than the JavaScript crawl is a page Google’s first wave sees as thin. On one e-commerce audit, this comparison showed category pages with 12 words in the raw HTML and 1,400 after rendering.

4
Check what the links are made of

Rendering is not only about content. If your navigation and internal links are injected by JavaScript, or worse, are click handlers instead of real anchor tags with href attributes, crawl discovery breaks across the whole site. A crawler cannot click. It can only follow links that exist as links.

The Fixes, From Cheapest to Deepest

This is where most guides go wrong by prescribing one answer for everyone. The right fix depends on your stack, your team, and how much of your site actually has the problem. Here is the decision table I use across client audits:

Fix Best for The catch
Server-side rendering (SSR) Sites where content changes per request or per user. Next.js and Nuxt make this the natural path for React and Vue teams. Real engineering work. Server costs rise, and sloppy hydration can reintroduce speed problems.
Static generation (SSG or ISR) Marketing sites, blogs, and catalogues that change on a schedule, not per visitor. Pages are pre-built as complete HTML. Build times grow with page count. Incremental regeneration solves most of it.
Prerendering service Teams that cannot touch the app architecture soon. A service renders pages and serves the snapshot to crawlers. A patch, not a cure. Adds a dependency, and Google treats it as a workaround. Plan a real fix behind it.
Partial fix: critical content only Big apps where full SSR is a year-long project. Ship title, meta, main copy, and internal links in the initial HTML; hydrate the interactive parts after. Requires discipline about what counts as critical. In practice this is the fix I deploy most often.

What Actually Happened After the Fixes

Across the seven audits, the pattern after shipping the fix was remarkably consistent. Indexing lag for new pages collapsed from weeks to days. Pages that had been indexed but ranked poorly began moving within one to two crawl cycles, because Google finally saw their full content and internal link context. On the e-commerce site with the 12 word category pages, category impressions in Search Console grew 60 percent over the following two months with zero new content, purely from Google finally reading what was already there.

One more effect nobody expects: AI visibility improves too. ChatGPT, Perplexity, and other assistants crawl with far less patience than Google, and most of them execute little or no JavaScript. A client-side rendered site is often completely invisible to them. Fixing rendering for Google quietly fixes it for the AI layer as well, which is increasingly where buying decisions start.

The Checklist Before You Call a Developer

  • View Source on your five most important pages and search for the main content. Missing means you have the problem.
  • Run the Text Only versus JavaScript crawl comparison in Screaming Frog and export the word count gap per page.
  • Inspect three URLs in Search Console and compare crawled HTML against the live page.
  • Verify every internal link is a real anchor tag with an href, not a JavaScript click handler.
  • Check your titles, meta descriptions, and structured data are in the initial HTML, not injected later.
  • Prioritise fixes by revenue: money pages first, blog second, everything else after.

If that checklist confirms the problem, do not let it become a two-quarter engineering debate. The partial fix, critical content server-rendered and everything else hydrated after, is achievable in weeks on most stacks, and it captures the majority of the SEO value while the full solution gets planned properly.

Rendering diagnostics like these are core to my technical SEO service, from the five minute check to the developer-ready fix plan.

Suspect Google is not seeing your content?

I will run the full rendering diagnostic on your site, show you exactly what Google’s first crawl sees versus your visitors, and give your developers a prioritised, stack-specific fix plan they can actually execute.

Explore Technical SEO Services Book a Rendering Audit

Tags: Technical SEOJavaScript SEOCrawling and IndexingField Notes

How to Turn Your Website Into an AI Knowledge Base Using Screaming Frog and Markdown

Tutorial. AI SEO, Marketing Tools

How to Turn Your Entire Website Into an AI Knowledge Base Using Screaming Frog and Markdown

15 min
Setup time for the full workflow
1 crawl
Your whole site converted to markdown
Zero
Code you need to write yourself
Any AI
Works with Claude, ChatGPT, and custom GPTs

Here is a question that did not exist two years ago and now decides real competitive advantage: how easily can an AI read your website?

Not index it. Read it. If you use Claude, ChatGPT, or any AI assistant for marketing work, you have probably hit the same wall I have: the AI does not know your site. It does not know your service pages, your case studies, your positioning, or the way you phrase things. So every brief starts from zero, and every output needs heavy editing to sound like you.

There is a clean fix for this, and it takes about fifteen minutes with a tool most SEOs already own: Screaming Frog, using a markdown conversion script the Screaming Frog team published on their blog. What follows is the full setup, plus the layer most people miss: what to actually do with the markdown once you have it.

Why Markdown Is the Native Language of AI

Your web pages are wrapped in thousands of lines of HTML, CSS classes, tracking scripts, and layout markup. When you paste a URL into an AI tool, most of what it processes is that wrapper, not your content. Markdown strips all of it: clean headings, clean paragraphs, clean lists. Nothing else.

This matters for two very practical reasons. First, AI models were trained on enormous amounts of markdown, so they parse its structure natively: a heading means a topic, a list means discrete items. Second, tokens cost money and context space. The same page as markdown can be a tenth the size of its HTML, which means you can fit ten times more of your site into an AI’s working memory.

“Google reads your HTML. AI reads your markdown. The brands that prepare content for both are playing the next decade, not the last one.”

Ram Kr Shukla, AI SEO Consultant

The Setup: Five Steps in Screaming Frog

1
Open Custom JavaScript settings

In Screaming Frog, go to Configuration, then Custom, then Custom JavaScript. This feature lets the crawler run a script against every page it visits, which is what performs the conversion.

2
Add the markdown conversion script

Click Add, and choose the content-to-markdown snippet from the library, or paste the version from the Screaming Frog blog. The script uses the page’s rendered DOM, so it captures what a visitor actually sees, not just raw source.

3
Switch rendering to JavaScript

Custom JavaScript needs the built-in Chrome renderer. Under Configuration, Spider, Rendering, select JavaScript. The crawl runs slower this way, which is a fair trade for accurate extraction.

4
Run the crawl in Spider mode

Enter your domain and start. For most consultant and SME sites this finishes in minutes. For large e-commerce sites, crawl a representative section first: category pages, top products, and key content.

5
Export from the Custom JavaScript tab

Each URL now carries its markdown version in the Custom JavaScript section. Export the lot to a spreadsheet or individual files. That export is your site as an AI-readable knowledge base.

The Part Everyone Skips: Curate Before You Feed

Here is the mistake I see immediately whenever this technique gets shared: people export 400 pages of markdown, dump the whole blob into an AI project, and expect magic. The result is usually worse than nothing. Large unfiltered context degrades model performance, buries the important pages under boilerplate, and wastes the context window on your privacy policy.

Treat the export like a content audit, because it is one. Keep the pages that define your business: services, positioning, case studies, your best guides. Cut thin pages, tag archives, legal pages, and anything outdated. For most sites, the useful knowledge base is 15 to 40 documents, not 400. A small curated set the AI can actually use beats an archive it drowns in.

What to Do With the Markdown: Four Practical Uses

Use case What it unlocks
Claude Projects or custom GPT knowledge Every brief, draft, and edit starts already knowing your services, voice, and case studies. Output needs a fraction of the editing.
Content gap analysis Give the AI your site plus three competitor crawls and ask what topics, entities, and objections they cover that you do not.
Internal consistency audit Ask the AI to find contradictions across your pages: conflicting numbers, outdated claims, positioning drift. Brutal and useful.
AI visibility preparation Seeing your content the way an AI sees it shows you exactly why assistants do or do not cite you, and what to restructure.

The Bigger Picture: This Is Where Search Is Going

This little workflow points at something much larger. The industry is quietly converging on the idea that websites need an AI-readable layer: the emerging llms.txt convention, AI crawlers requesting clean content, and assistants deciding which brands to cite based on how clearly they can parse what you offer. Markdown conversion is the manual version of that future. Doing it now teaches you exactly how legible your brand is to the systems that increasingly answer your buyers’ questions.

And if your site converts to markdown badly, with walls of unstructured text, vague headings, and key claims buried in design elements, that is not just an AI problem. It is the same structural weakness that holds back your rankings and conversions with human readers too. The crawl just makes it visible.

Want to know how visible your brand is to AI search?

I run AI visibility audits that show where your brand appears in ChatGPT, Perplexity, and Google AI Overviews, and exactly what to restructure so assistants start citing you. This workflow is one small piece of that system.

Explore AI SEO Services Book a Free Audit Call

Tags: AI SEOScreaming FrogMarketing ToolsTutorial

I Audited 30 E-Commerce SEO Strategies. Here’s What the Top 10% Do Differently

Original Research. E-Commerce SEO, India

I Audited 30 E-Commerce SEO Strategies. Here’s What the Top 10% Do Differently

30
E-commerce sites audited over 14 months
3
Sites clearly outperforming everyone else
6
Habits that separated winners from the rest
0
Secret tools or hacks involved. Zero.

Over the past 14 months, I audited 30 e-commerce websites. Some came to me as clients. Some were audits I ran during discovery calls that never converted. A few were competitor teardowns commissioned by brands who wanted to know why someone else was eating their lunch on Google.

Somewhere around audit number 20, a pattern started bothering me. The gap between the best performers and everyone else had almost nothing to do with what most SEO advice talks about. Nobody in the top group was winning because of a clever tool stack or some secret schema trick. And plenty of sites in the bottom group were doing everything the checklists say to do.

So I went back through my notes and scored all 30 sites against the same criteria: organic revenue contribution, non-branded traffic growth, keyword positions on commercial terms, and conversion rate from organic sessions. Three sites stood clearly apart. That’s the top 10 percent. This post is about what they do differently, and honestly, some of it surprised me.

First, What the Bottom 90 Percent Have in Common

Before the winners, the losers. Because the failure patterns were remarkably consistent, and you should check your own site against this list before reading further.

The five failure patterns I saw again and again:

  • Blogging hard while category pages sat unoptimised. 22 of the 30 sites had more effort in their blog than in the pages that actually make money.
  • Keyword lists instead of keyword strategy. Rankings tracked, but no mapping between keyword intent and page type.
  • Technical debt nobody owned. Faceted navigation creating thousands of duplicate URLs, and no one on the team responsible for noticing.
  • Content volume as a KPI. Publishing 8 to 12 posts a month with no internal linking plan and no conversion path.
  • Link building bought in bulk from the same handful of guest post farms every competitor was also using.

Here’s the uncomfortable part. Most of these sites were not lazy. Several had agencies on retainer. Two had in-house SEO teams of three or more people. Activity was never the problem. Direction was.

“The bottom 90 percent were busy. The top 10 percent were focused. That is the entire difference, expressed in six specific habits.”

Ram Kr. Shukla, SEO and Content Strategy

The Six Things the Top 10 Percent Do Differently

1
They treat category pages as their most important content

All three top performers had category pages that read like well-edited buying guides: real intro copy, FAQ sections answering actual pre-purchase questions, and internal links to their best supporting content. One of them rewrote every major category page twice a year based on what customers were searching. The bottom group treated category pages as product grids with a title tag. That single difference explained more ranking gap than anything else I measured.

2
They chase non-branded traffic, not vanity rankings

Ranking number one for your own brand name is not SEO. It is spelling. The top sites measured themselves almost entirely on non-branded commercial keywords, the searches made by people who have never heard of them and are actively shopping. In GSC, all three had non-branded queries driving 60 percent or more of organic clicks. In the bottom group, the median was under 30 percent, and several founders had no idea what their branded versus non-branded split even was.

3
Someone owns technical SEO, by name

Every site had technical issues. Every single one, including the winners. The difference was ownership. In the top group, a specific person was responsible for crawl health, Core Web Vitals, and index hygiene, and they reviewed it monthly. In the bottom group, technical SEO belonged to everyone, which means it belonged to no one. One losing site had 14,000 near-duplicate URLs from filter combinations that had been quietly bleeding crawl budget for two years. Nobody had looked.

4
They publish less content than you’d expect

This was the finding that surprised me most. The top three published between 2 and 4 pieces a month. Several bottom-group sites published 10 or more. But every piece the winners published belonged to a cluster, linked to money pages, and targeted a query with purchase intent somewhere in it. They also updated old content on a schedule instead of always chasing new topics. One winner spent an entire quarter refreshing 40 existing pages and grew organic revenue 31 percent without publishing anything new.

5
Their link profiles look boring, and that’s the point

No PBNs. No 500-link packages. The winners earned links slowly from suppliers, industry publications, journalists who quoted their data, and niche bloggers who genuinely reviewed their products. Growth of maybe 4 to 8 quality referring domains a month, sustained for years. The anchor text distribution looked natural because it was natural. Meanwhile, two bottom-group sites were carrying obvious paid link footprints that will eventually become a liability rather than an asset.

6
They measure SEO in revenue, not traffic

Ask a struggling brand how SEO is going and they will tell you about sessions. Ask a winning brand and they will tell you organic revenue, organic conversion rate, and cost per acquisition versus paid channels. All three top sites had GA4 configured to attribute revenue to organic landing pages, reviewed monthly by someone with authority to change priorities. When you measure revenue, you naturally stop writing blog posts nobody buys from. The metric quietly fixes the strategy.

What Didn’t Matter Nearly as Much as People Think

Equally interesting was what showed no correlation with performance at all. Domain age, for one. Two of the three winners were under four years old, competing against sites twice their age. Platform choice mattered far less than expected too. The top group included a Shopify store, a WooCommerce site, and a custom build. And tool stacks. I saw losing sites with Ahrefs, Semrush, Screaming Frog, and three rank trackers running simultaneously. The tools were fine. The decisions made with them were not.

One more thing that didn’t matter: budget size, beyond a certain floor. The best performer in the entire audit spent less on SEO monthly than two of the worst performers. Money amplifies a good strategy and it also amplifies a bad one. It has no opinion of its own.

How to Audit Your Own Site Against These Six Habits

Ask yourself You’re in trouble if
When did we last rewrite a category page? You can’t remember, but the blog published last week
What share of organic clicks is non-branded? Nobody on the team knows the number
Who is responsible for crawl health? The answer is a team, an agency, or a shrug
Does every content piece map to a cluster and a money page? Content is planned by topic ideas, not by structure
Would I show my backlink profile to Google’s spam team? You just winced reading that question
Can I state last month’s organic revenue in one sentence? You can only state sessions and rankings

Score yourself honestly. In my audit, no site in the bottom group passed more than three of these six questions. All three winners passed at least five. The correlation was that clean.

The Takeaway Nobody Wants to Hear

There is no secret. That’s the finding. After 30 audits, the top 10 percent were not doing anything the rest couldn’t copy tomorrow. They optimised the pages that make money, measured what matters, gave technical work an owner, published deliberately, earned links patiently, and judged everything in revenue. Six habits. All boring. All available to everyone.

Which is exactly why so few brands do them. Boring and consistent loses to shiny and sporadic in every planning meeting, and then loses to nothing at all three months later when the shiny thing is abandoned. If your e-commerce SEO has been busy but flat, the problem is almost certainly not effort. It’s direction. Pick the six habits, assign owners, and give it two quarters.

The habits in this research became the system behind my e-commerce SEO service.

Want me to run this same audit on your store?

I’ll score your site against the same six habits, show you your branded versus non-branded split, and give you a prioritised fix list. 30 minutes, no pitch, and you keep the findings either way.

Book a Free SEO Audit

Tags: E-Commerce SEOSEO AuditOriginal ResearchSEO Strategy

How SEO Helped a D2C Brand Grow from Rs. 40L to Rs. 2Cr Annual Revenue

Case Study — D2C E-Commerce, India

How SEO Helped a D2C Brand Grow from ₹40L to ₹2Cr Annual Revenue

5x
Revenue growth in 18 months (₹40L to ₹2Cr ARR)
218%
Organic traffic growth (2,800 to 8,900 sessions/month)
90+
Quality referring domains (up from just 12)
2x
Lower CPA via SEO (₹510) vs paid ads (₹960)

Is ranking on the first page of Google really worth it for e-commerce businesses? Wouldn’t it be faster and simpler to just run paid ads on Meta or Google Shopping? What’s the actual return and will SEO ever generate enough revenue to justify the wait?

These are questions I hear from e-commerce founders, D2C brand owners, and digital marketing managers almost every week. The hesitation is understandable. SEO is slow, nuanced, and notoriously hard to attribute in the early months. But here’s the truth: when done with precision, SEO becomes the most scalable, cost-efficient revenue engine an e-commerce brand can build. I recently worked with an Indian D2C brand in the lifestyle and wellness space that took this leap. The results they achieved in under two years make a compelling case.

E-Commerce Brand: Key Numbers at a Glance

Annual Revenue (ARR)
₹40L → ₹2Cr
5x growth in 18 months
Monthly Organic Sessions
8,000–9,000
up from ~2,800 at start
Organic Revenue Share
1.5% → 21%
of total monthly revenue
Business Model D2C E-Commerce (Lifestyle and Wellness, India)
Starting Annual Revenue ~₹40 Lakh (primarily from paid ads and influencer campaigns)
Revenue After 18 Months ₹2 Crore ARR (5x growth)
SEO and Content Investment ₹80K–1.2 Lakh/month
SEO Cost Per Acquisition ₹510 (vs ₹960 on paid ads — nearly half)
Referring Domains Built 90+ quality domains (up from 12 at start)

Where It All Started: The Problem With Paid-Only Growth

When this brand came to the SEO table, they were already doing modest numbers — roughly ₹40 Lakh annually, entirely on the back of Meta ads and influencer campaigns. Their ROAS was around 2.4x, which looked acceptable on paper. But CPMs were climbing quarter on quarter, their customer acquisition cost had nearly doubled in 12 months, and one bad iOS privacy update had knocked their attribution into chaos.

The core problem was dependency. Every rupee of revenue required a rupee (or more) of ad spend to sustain it. The moment the ad tap turned off, so did the orders. There was no compounding asset being built. SEO was the missing piece — not as a replacement for paid, but as a foundation that would make every other channel cheaper and more effective over time.

“Paid ads are a tap. SEO is a well. One you rent, one you own. The smartest e-commerce brands build both — but they never confuse one for the other.”

Ram Kr. Shukla, SEO and Content Strategy

The Advanced SEO Tactics That Drove 218% Organic Growth

This wasn’t a “publish 3 blogs a week and wait” strategy. What moved the needle was a combination of technical precision, content architecture, and intent-mapping that most e-commerce brands simply don’t execute at this level.

1
Topical Authority Mapping (Not Just Keyword Research)

The first 60 days were spent building a full topical authority map, not just a keyword list. We identified 5 core content clusters around the brand’s product categories and buyer journey stages. Each cluster had a pillar page, 4-6 supporting articles, and a clear internal linking strategy. Google rewards topical depth, not volume.

2
Category and Collection Page SEO (The Revenue Pages)

Most e-commerce SEO efforts focus on blog content and completely neglect the pages that actually convert — category and collection pages. We rewrote every major category page with keyword-rich H1s, SEO-optimised intro copy, structured FAQ sections with Schema markup, and canonical tag hygiene across filtered URLs. These became the highest-converting organic landing pages within 6 months.

3
Core Web Vitals and Technical SEO Overhaul

A full technical audit revealed 140+ crawl errors, duplicate content from faceted navigation, missing Schema on product pages, and an LCP score above 4.2 seconds on mobile. Fixing these alone — before a single new content piece — produced a 22% lift in organic impressions within 8 weeks. Technical SEO isn’t glamorous, but it’s the bedrock everything else rests on.

4
Product-Led Content (Buying Guides That Actually Convert)

Rather than generic blog posts, we built deep buying guides targeting high-intent comparison and “best [product type] in India” keywords. Each guide was 2,000-3,000 words, included original data, internal links to product pages, and a recommendation matrix. These pages now collectively drive over 1,800 organic sessions per month and contribute meaningfully to the brand’s 2.2% organic conversion rate.

5
Digital PR and Programmatic Link Building

Link building for e-commerce is different from SaaS. We deployed two parallel strategies: Digital PR — creating data-driven studies around wellness trends in India that earned coverage on YourStory, HealthKart blog, and regional lifestyle publications — and programmatic outreach targeting niche bloggers and review platforms. Over 18 months, this built 90+ quality referring domains, up from just 12 at the start.

6
Search Intent Segmentation Across the Funnel

One of the most underused SEO tactics in e-commerce is correctly mapping content to funnel stage. Informational queries go to blog content with soft CTAs. Navigational queries go to optimised landing pages. Transactional queries go to product and category pages with hard CTAs. We built a content calendar ensuring every piece was assigned to an explicit funnel stage and tracked conversion contribution in GA4.

The Growth Timeline: What to Realistically Expect

Here’s the honest timeline breakdown that this brand experienced — and what most well-executed e-commerce SEO campaigns look like:

Month 1–3
Foundation and Technical Fixes

Technical audit, crawl error fixes, Core Web Vitals optimisation, Schema implementation, keyword and topical mapping. Organic sessions still at ~2,800/month. Little visible traffic change — this is normal.

Month 4–6
First Green Shoots

Category pages start ranking for mid-tail keywords. Impressions climb in GSC. First content cluster fully published. Organic sessions reach ~4,200/month — up ~50% from baseline. Organic contributes ~5% of total revenue for the first time.

Month 7–12
Momentum Builds

Buying guides rank on Page 1. Link building gains start compounding. Sessions reach 6,500-7,000/month. Organic now contributing 10-12% of monthly revenue. Business ARR crosses ₹1Cr for the first time.

Month 13–18
Flywheel Effect

Organic becomes a major revenue channel. Sessions hit 8,000-9,000/month — 218% up from start. Business ARR reaches ₹2 Crore. Organic now accounts for 21% of total revenue. SEO cost-per-acquisition drops to ₹510 vs ₹960 on paid — nearly half.

What This Means for Your E-Commerce Brand

The numbers above aren’t from a well-funded startup with a dedicated growth team. This was a bootstrapped D2C brand with a lean content operation of 2 people, investing ₹80K-1.2 Lakh per month in SEO — less than what many brands spend on a single weekend of paid ads. The difference was strategy, execution discipline, and patience.

If you’re running an e-commerce brand and organic search currently contributes less than 10% of your revenue, you’re leaving compounding growth on the table. Every month you delay building this asset, a competitor is widening their organic moat. The best time to start was 18 months ago. The second best time is now.

The playbook from this case study is now my standard e-commerce SEO engagement.

Want an SEO strategy built for your e-commerce brand?

I work with D2C and e-commerce brands to build organic growth systems that compound over time — technical SEO, content architecture, and link building that actually drives revenue, not just traffic.

Let’s Talk About Your SEO

Tags: E-Commerce SEOSEO Case StudyD2C IndiaContent MarketingOrganic Growth

How to Check If ChatGPT Mentions Your Brand (Free Python AI Visibility Tracker)

AI SEOBrand VisibilityGEOPython for SEOChatGPTLLM Optimization

AI Visibility · GEO Field Guide

How to Check If ChatGPT Mentions Your Brand: A Free Python AI Visibility Tracker

82%of AI citations come from third-party earned media, not your own pages
44%of LLM citations are pulled from the first 30% of a page
5 minto run this tracker against your own brand
Freeno SaaS subscription, just a short Python script

Short answer: to check your brand’s AI visibility, run a fixed set of buyer-style questions through the ChatGPT (OpenAI) API on a schedule and log whether your brand gets named in the answers. It is the AI equivalent of a rank tracker. Below is the exact free Python script I use, how to read the results, and the GEO moves that actually improve them.

Google is no longer the only place people search. Millions now ask ChatGPT, Claude, Gemini, and Perplexity for recommendations before they ever open a results page. If your brand is missing from those answers, you are invisible to a fast-growing slice of your market, and unlike a Google ranking, nothing tells you by default. You have to measure it deliberately, which is exactly what this guide does.

What this tracker does

The script sends a set of targeted prompts to the OpenAI API, the same questions your potential customers might type, and logs the full responses. It checks whether your brand name appears, repeats each prompt a few times because AI answers vary, and exports everything to an Excel file you can review or chart. Think of it as a rank tracker for AI answers.

How the AI visibility tracker works1Promptsbuyer questions2OpenAI APIask each one3Responseswhat AI says4Matchis brand named?5Scorecardvisibility %RamKrShukla.com
The tracker sends your buyer questions to the model, then logs whether your brand is named in the answer.

Why AI visibility matters in 2026

AI answers now shape buying decisions long before someone reaches your website. Traditional SEO measures keyword rankings; AI visibility measures something newer, whether a language model names you when it answers your customer’s question. That metric now sits alongside rankings in any serious SEO consulting engagement, because a customer who gets a confident recommendation from ChatGPT often never runs the Google search you optimised for.

The discipline has a name now: GEO, or generative engine optimization. It is the same instinct as SEO, applied to language models instead of the ten blue links. And the early research is blunt about where visibility comes from. Studies of generative engines suggest roughly 82 percent of AI citations come from third-party earned media rather than a brand’s own site, which means the question is not only what you publish, but whether the wider web treats you as an authority.

If your brand is not mentioned when an AI answers your customer’s question, you have lost that touchpoint silently, and no dashboard is going to warn you.

How AI engines actually answer, and why it changes the fix

The three engines your customers use do not source answers the same way, so the way you earn a mention differs by platform.

ChatGPT

Blends static training data with a live retrieval layer for current queries. It rewards durable authority and consistent mentions across the web, which build up over time.

Perplexity

Retrieves from the live web on almost every query, so a fresh, well-structured page can surface in its answers within hours. Speed and structure win here.

Gemini

Leans on Google’s index and query fan-out, expanding your question into sub-questions and pulling a source for each. Strong classic SEO carries over directly.

This is why a single tactic rarely fixes everything. Perplexity rewards fresh, structured content fast; ChatGPT rewards being talked about across the web; Gemini rewards the technical SEO foundations you should already own. Measuring first tells you which gap is actually yours.

Before you start: what you need

1

Python 3.9 or newer installed on your machine.
2

An OpenAI API key, created at platform.openai.com. A few dollars of credit is plenty for this.
3

Install the libraries the script uses. In your terminal, run: pip3 install openai pandas openpyxl

The complete tracker script

Create a file called tracker.py and paste the code below. Replace YOUR_API_KEY_HERE with your real key, then swap BRAND_NAME and the prompts for your own business. The example uses WizMantra, an online language-learning brand I run, so you can see real category questions in action.

from openai import OpenAI
import pandas as pd
import datetime

# Configuration
client = OpenAI(api_key="YOUR_API_KEY_HERE")

BRAND_NAME = "wizmantra"     # lowercase, for case-insensitive matching
RUNS_PER_PROMPT = 3          # AI answers vary, so ask more than once
MODEL = "gpt-4o-mini"        # any current chat model works

# The buyer-style questions your customers actually ask
prompts = [
    "What is WizMantra?",
    "Who are the best online spoken English class providers?",
    "Recommend online Hindi classes for beginners.",
    "Which companies offer online Sanskrit courses?",
]

# Main tracking loop
records = []
for prompt in prompts:
    hits = 0
    for run in range(RUNS_PER_PROMPT):
        try:
            resp = client.chat.completions.create(
                model=MODEL,
                messages=[{"role": "user", "content": prompt}],
                temperature=0.7,
            )
            answer = resp.choices[0].message.content
            mentioned = BRAND_NAME in answer.lower()
            hits += 1 if mentioned else 0
            records.append({
                "date": datetime.datetime.now().strftime("%Y-%m-%d %H:%M"),
                "prompt": prompt,
                "run": run + 1,
                "brand_mentioned": "Yes" if mentioned else "No",
                "response": answer,
            })
        except Exception as e:
            records.append({
                "date": datetime.datetime.now().strftime("%Y-%m-%d %H:%M"),
                "prompt": prompt,
                "run": run + 1,
                "brand_mentioned": "Error",
                "response": str(e),
            })
    # Visibility rate for this prompt, 0 to 100 percent
    print(prompt, "->", round(100 * hits / RUNS_PER_PROMPT), "percent visible")

# Export the full log to Excel
pd.DataFrame(records).to_excel("ai_visibility_log.xlsx", index=False)
print("Done. Full log saved to ai_visibility_log.xlsx")

Run it and read the results

Save the file, then run python3 tracker.py in the same folder. The terminal prints a visibility rate for each prompt, and the full log lands in ai_visibility_log.xlsx. It looks something like this:

Prompt Response (truncated) Brand named
What is WizMantra? WizMantra is an online language-learning platform offering… Yes
Best online spoken English providers? Popular options include Preply, Cambly, italki… No
Recommend online Hindi classes. Several institutes offer beginner Hindi classes… No
Companies offering online Sanskrit courses? WizMantra is one platform that offers Sanskrit… Yes

How to read your AI visibility score

The brand-named column is your core metric. Read it in two layers:

  • Direct brand prompts (“What is [brand]?”) should almost always come back Yes. If they do not, your brand has close to zero footprint in the model, a serious signal that the wider web barely references you.
  • Category prompts (“best providers of X”) coming back No means competitors are capturing the AI recommendation you want. That is the gap worth money.
  • Track the rate, not one answer. Because you run each prompt three times, you get a visibility percentage per prompt. Watch that number move month over month as you build authority.
Pro tip: the prompts you choose decide everything. Think like your customer and reuse your real keyword research. The overlap between search intent and the questions people ask an AI is your map. If you already have a keyword and intent audit, you are halfway to a good prompt set.

How to actually improve your AI visibility (the GEO playbook)

Once you know where you are invisible, the fixes are specific, and several are backed by early GEO research rather than guesswork.

44%
of AI citations come from the first 30% of a page, so front-load the clear answer
Source: GEO citation studies, 2026
+115%
visibility lift from adding source citations to a mid-ranking page
Source: Princeton GEO research
+40%
lift from adding statistics and quotations to content
Source: Princeton GEO research
82%
of AI citations come from third-party earned media
Source: GEO citation studies, 2026
  • Front-load the answer. Put the clear, quotable answer near the top of the page, not buried under a long intro. Nearly half of AI citations are pulled from the opening portion of a page.
  • Add evidence. Cite sources, add real statistics, and include short quotations. Princeton’s GEO research found these lift AI visibility by 30 to 40 percent, and adding citations alone produced a 115 percent relative lift for pages mid page one. Models prefer content they can verify.
  • Earn third-party mentions. If most AI citations come from earned media, then digital PR, expert commentary, directories, and reviews are not optional. A brand the web talks about is a brand the models repeat.
  • Fix your entity. Keep your name, category, and description consistent across your site and every profile, and mark it up with structured data so machines resolve you to one clear entity.
  • Build a cluster, not a lonely post. Models cite brands that cover a topic across several linked pages. This is the same topical authority logic that already wins in search, and it is why sequencing matters, technical foundation first, content second.
  • Keep it fresh. Language models favour the most recent version of an article that matches a query, so update and re-date your cornerstone content instead of letting it age.

Scaling this further

The script is a foundation. Once it is running, extend it:

  • Test across multiple models, OpenAI, Claude, and Gemini, since each has different training and retrieval sources.
  • Add a sentiment column, so you track not just whether you are mentioned, but how positively.
  • Schedule it with cron to run weekly and build a trend line automatically.
  • Pipe results into Google Sheets for a live team dashboard.

Frequently asked questions

What is AI visibility?

AI visibility is whether large language models like ChatGPT, Gemini, and Perplexity name your brand when they answer your customers’ questions. It is the AI-era equivalent of a keyword ranking, measured by mention rather than position.

What is GEO (generative engine optimization)?

GEO is the practice of optimising your content and brand so AI engines cite and recommend you. It reuses SEO foundations, authority, structure, and clear entities, but the target is the AI answer, not the search results page.

Does ChatGPT use the live web or only training data?

Both. ChatGPT blends static training data with a live retrieval layer for current queries. Perplexity retrieves from the live web on almost every query, and Gemini leans on Google’s index. That is why fresh, well-structured content can surface quickly in some engines and slowly in others.

How often should I run the tracker?

Monthly is a sensible baseline, plus a run after any major content or PR push. Always repeat each prompt at least three times, because AI answers vary between runs and a single response can mislead you.

Do I need to know how to code?

Only a little. If you can open a terminal, install a package, and paste a script, you can run this. If you would rather not, the same measurement can be set up for you as part of a consulting engagement.

Is AI visibility replacing SEO?

No, it complements it. The same signals that earn AI citations, authority, clean structure, consistent entities, and third-party mentions, are the signals that already drive strong search rankings. You are extending SEO, not abandoning it.

Want to know if AI is recommending you or your competitors?

I run AI visibility and GEO audits alongside classic SEO, measuring where you show up across ChatGPT, Perplexity, and Gemini, then building the authority and structure that gets you cited. Start with a conversation.

Book a strategy callSee SEO consulting

About the author: I am Ram Kr Shukla, an SEO and growth consultant helping brands grow their organic and AI-driven visibility. This script came out of my own need to track a brand’s presence across AI platforms, and I have been refining it since 2025. Want a version built for your brand? Get in touch.

Client Results, Not Claims

5x D2C revenue in 18 months via SEO
10x SaaS trials, zero new blog posts
120K Monthly organic visitors from zero

Free Resource

Steal My 40 Point SEO Audit Checklist

The exact list I run on every paid audit. Score your site in 30 minutes.

Get the checklist →

Is your site invisible to AI search?

Ask ChatGPT to recommend brands in your category. If you are not the answer, we should talk.

Book a Free Strategy Call