How Google decides what you see before you even finish typing
Share
You type three words into a search bar and within 200 milliseconds, one result lands at the top — above millions of others. Who decided that? Not a human editor. Not a coin flip. Something stranger and more deliberate than either.
Software makes decisions constantly — which post you see first, which word your phone autocorrects, which sentence an AI generates next. Each of those decisions runs on a different mechanism. This lesson is about one of the most consequential ones: the algorithm that ranks search results. It's been running, in some form, since 1998. And it's changed more dramatically in the last five years than in the previous twenty.
Larry Page (b. 1973, Michigan) — co-founder of Google and the person who gave PageRank its name — had a specific insight in graduate school: the web is basically a citation network. Academic papers that get cited a lot are probably important. Webpages that get linked to a lot are probably important too. So Google's original algorithm counted links. A page that 10,000 other pages pointed to ranked higher than one that only 12 did. Simple, elegant, and genuinely useful — it produced better results than anything else in 1998.
But link-counting broke almost immediately. The moment people realized links = rankings, they started manufacturing links. Spam farms. Link exchanges. Whole businesses built around getting thousands of low-quality sites to point at your page. Google spent the next decade in an arms race: making PageRank smarter about which links counted. A link from the New York Times carried more weight than a link from a random blog. A link from a site that itself had lots of quality links carried even more. The algorithm got recursive — it was measuring the reputation of the reputations.
Make your call
So by the 2010s, Google had a sophisticated link-reputation system. When you search 'best running shoes,' what do you think it's actually matching against?
A
The exact words on each webpage, compared to your query word-by-word
B
The meaning behind your query, matched to what pages are actually about
C
The pages with the most links that contain the word 'running shoes'
Remember the question from the hook — who decides that first result? The honest answer is: it used to be a popularity contest, and now it's closer to a reading comprehension test. Around 2013, Google started moving away from keyword matching toward understanding what a query actually means. By 2019, a system called BERT — built on the same transformer architecture that powers modern AI — was processing nearly every English search. BERT doesn't look for the word 'running shoes' on a page. It tries to understand that you probably want something durable, within a price range, reviewed by real runners. Then it finds pages whose content satisfies that intent, regardless of whether they use your exact phrasing. A page that says 'trail footwear for long distances' can outrank one that says 'running shoes' fifty times, if BERT decides the first one actually answers your question better.
Key Insight
The shift from PageRank to semantic search is a shift from 'what pages are popular?' to 'what pages are actually useful for this specific question?' Popularity still matters — but now it's one signal among hundreds, and meaning-matching has taken the wheel.
Related threads
Technology
·
Your AI Has No Idea What It's Saying
·
how an LLM actually produces a sentence…
Your AI Has No Idea What It's Saying
Technology
·
Why Websites Make You Click on Crosswalks
·
the test that knows you're human…
Why Websites Make You Click on Crosswalks
Technology
·
Why Every App You Use Is Broken
·
why software always has bugs (the gap…
Why Every App You Use Is Broken
Sources
Images from Wikimedia Commons. Attribution required by license.
internet network nodes
Generated by Grok Imagine (xAI), prompt: Generate a single 16:9 horizontal image for an educational lesson.
Lesson title: "Why the First Search Result Isn't Random" · How Google decides what you see before you even finish typing
Domain: tech…
Larry Page Google early
Generated by Grok Imagine (xAI), prompt: Generate a single 4:3 horizontal image for an educational lesson.
Lesson title: "Why the First Search Result Isn't Random" · How Google decides what you see before you even finish typing
Domain: techn…
Diagram illustrating the two principle phases of GraphRAG with a knowledge graph with selectable access patterns for unstructured, structured and mixed data.
Indexing Phase, knowledge graph construction:
a) Documents (unstructured data) are transformed into a lexical graph with hiearchical levels of detail and cross-document topical summarization. Each level includes a vector representation of the text. Named entity recognition is performed to extract structured data from the text, which is optionally attached to an in-graph schema. Finally, text representations are cross-linked and may be enriched with graph analysis like a centrality score.
b) Structured data is imported as a domain graph using primitive data types recorded in nodes and relationships.
c) Connections are made between the structured and unstructured data.
Inference Phase, GraphRAG access patterns:
A vector embedding is calculated for the user question.
Rule-based or agent-based tool selection determines the access pattern to use:
a) Search - text from the lexical graph is searched using keyword, full-text, or vector similarity search
b) Search + pattern match - following a search, graph pattern matching is used to expand the context of the text with structured data that can also be used for post-filtering
c) Query - the user question is used to generated a database query, which is validated and executed to retrieve relevant information
Together, the combined text and data added to the prompt as context for the original user question.
The LLM then generates the final answer.
This process ensures efficient and relevant document retrieval based on the semantic content of queries.