AI Search & Agents
Vector Search
In shortFinding content by meaning: queries and documents become embedding vectors, and the closest vectors are returned as the most similar results.
Vector search retrieves items by comparing embeddings, lists of numbers that represent meaning, instead of matching exact words. A query is turned into a vector with the same Embedding Model used for the documents, and the system returns the documents whose vectors sit closest to it. That is how a search for “cheap flights to Rome” can surface a page about “budget airfare to Italy”.
How it works
- Embed: every document or chunk is converted into a vector, often with hundreds or thousands of dimensions.
- Store and index: vectors go into a Vector Database or an index inside a search engine such as Elasticsearch, Postgres with pgvector, or a cloud service such as Vertex AI Vector Search.
- Query: the query is embedded and compared with stored vectors using a measure such as Cosine Similarity.
- Approximate nearest neighbours: comparing against every vector is slow at scale, so indexes such as HNSW find very close matches quickly, trading a little accuracy for speed.
Most production systems are hybrid: they combine vector search with lexical retrieval such as BM25 and then re-rank the merged candidates. In MLforSEO’s five-stage retrieval funnel, keyword and vector similarity together decide which chunks enter the candidate pool at all.
How it’s used in SEO and marketing
- Understanding why AI search can retrieve pages that never use the exact query wording, and why semantically diffuse paragraphs match nothing well.
- Internal-link suggestions and “read next” widgets based on page embeddings.
- On-site semantic search and RAG assistants over your own content.
- Keyword clustering and mapping keywords to the closest existing page.
- Near-duplicate detection for content and images.
Example
In 10 Ways to Automate Internal Linking with AI, each post is embedded with sentence-transformers and stored in a vector database. For any page, the nearest neighbours become link candidates, and the same index can later power semantic site search. The approach finds related pages that share no tags or keywords.
Limitations and things to watch
- Vectors are weak on exact matches such as product codes, names and numbers, which is why lexical search is kept alongside.
- Results depend on the embedding model; changing models means re-embedding everything.
- Similarity is not quality or truth. Re-ranking and filtering are still needed.
- Hard to explain: you can see that two vectors are close, not easily why.
Learn it on MLforSEO
Where Vector Search shows up on MLforSEO
Learn it in a course
Sources and further reading
Other terms from AI Search & Agents
- Agentic AIAI systems that pursue a goal over several steps on their own: planning, choosing tools or sources, acting and…
- Agentic Commerce Protocol (ACP)An open standard from OpenAI and Stripe defining how AI agents complete purchases with businesses on a buyer's…
- Agentic SearchSearch where an AI system plans, runs and evaluates many searches itself, then delivers one synthesised answer…
- AI AgentA system that pursues a goal on its own: it plans, uses tools, keeps track of what it has learned and adapts u…
- AI Citation (LLM Citation)A source link or named mention an AI search system attaches to its answer, showing which pages or brands it dr…
- AI Crawlers (GPTBot, ClaudeBot, PerplexityBot)Bots run by AI companies that fetch web pages for model training, AI search indexes or live answers; you contr…
- AI Mode (Google)Google AI Mode is a conversational search experience that answers with a Gemini-written response, built by fan…
- AI OverviewGoogle's AI-generated answer shown above some search results, summarising information from several pages and l…
- AI Rank Tracking (Prompt Tracking)Monitoring whether and how AI assistants mention or cite your brand by running a fixed set of prompts on a sch…
