AI Search & Agents
Semantic Search
In shortSearch that matches the meaning and intent behind a query, using entities, context and embeddings, rather than only the exact words typed.
Semantic search is search that tries to understand what a query means and return results that match that meaning, even when they share few or no words with the query. It relies on context, entities and intent, and in modern systems on embeddings, numerical representations of meaning. Google has moved in this direction for over a decade, from the Knowledge Graph (2012) to BERT (2019) and today’s AI search.
How it works
Classic lexical retrieval, such as BM25, scores documents by the words they share with a query. Semantic retrieval converts queries and documents into vectors with an embedding model such as Sentence-BERT, then finds the documents whose vectors are closest, usually by cosine similarity. Knowledge graphs add a second layer, connecting queries to known entities and their attributes.
In practice most systems are hybrid. As MLforSEO’s fuzzy matching guide puts it, modern retrieval runs on two layers at once: lexical matching repairs messy input and handles exact terms, while semantic matching captures paraphrases, synonyms and intent. Results are then often re-ranked by a more expensive model.
How it’s used in SEO and marketing
- Keyword research: grouping queries by meaning, which is the basis of a semantic keyword universe.
- Internal linking: finding pages that are about the same thing even when they use different vocabulary.
- On-site search and RAG: loading page embeddings into a vector database to power site search or a retrieval-augmented assistant.
- Content strategy: writing for topics and entities, with clear terminology, so both lexical and semantic retrieval can find a page.
Example
A query for “cheap flights to the sun in winter” contains none of the words in a page titled “Budget Canary Islands holidays for January”. A keyword match misses it; an embedding-based search places the two close together because they share a meaning. Screaming Frog’s embeddings feature applies the same idea to a crawl, offering semantic search across your own pages.
Limitations and things to watch
- Embeddings can miss exact requirements such as product codes, prices or negations (“not gluten-free”), which is why hybrid retrieval exists.
- Results depend on the embedding model and how text is chunked.
- Close in meaning does not mean useful: semantic similarity is a retrieval signal, while quality and information gain decide what gets chosen.
Learn it on MLforSEO
Where Semantic Search shows up on MLforSEO
Read about it on the blog
Try it yourself
- Coding Script or NotebookSemantic Search Intent Classification with Google Cloud NLP & spaCy in Python (Colab Notebook)
- Coding Script or NotebookIBM Watson NLU Complete API Implementation Template for Multi-Feature Text Analysis (Notebook)
- Coding Script or NotebookKnowledge Graph API Extraction and Entity Relationship Analysis for Semantic Keyword Research (Notebook)
Sources and further reading
- https://www.mlforseo.com/machine-learning-tutorials/fuzzy-matching/what-fuzzy-matching-is-and-where-it-fits-in-seo/ MLforSEO
- https://www.mlforseo.com/machine-learning-implementation-guides/internal-link-analysis/automate-internal-linking-ai/ MLforSEO
- Google: Understanding searches better than ever before (BERT, 2019)
- Sentence Transformers documentation: Semantic search
- Elastic: What is semantic search?
Other terms from AI Search & Agents
- Agentic AIAI systems that pursue a goal over several steps on their own: planning, choosing tools or sources, acting and…
- Agentic Commerce Protocol (ACP)An open standard from OpenAI and Stripe defining how AI agents complete purchases with businesses on a buyer's…
- Agentic SearchSearch where an AI system plans, runs and evaluates many searches itself, then delivers one synthesised answer…
- AI AgentA system that pursues a goal on its own: it plans, uses tools, keeps track of what it has learned and adapts u…
- AI Citation (LLM Citation)A source link or named mention an AI search system attaches to its answer, showing which pages or brands it dr…
- AI Crawlers (GPTBot, ClaudeBot, PerplexityBot)Bots run by AI companies that fetch web pages for model training, AI search indexes or live answers; you contr…
- AI Mode (Google)Google AI Mode is a conversational search experience that answers with a Gemini-written response, built by fan…
- AI OverviewGoogle's AI-generated answer shown above some search results, summarising information from several pages and l…
- AI Rank Tracking (Prompt Tracking)Monitoring whether and how AI assistants mention or cite your brand by running a fixed set of prompts on a sch…


