A measure used to evaluate how much new, meaningful information a feature, document, or phrase provides beyond what is already known; it quantifies the reduction in uncertainty/entropy when additional data is introduced.
Information Gain is a measure used by search systems to evaluate the value of content by quantifying how much new, meaningful information a feature, document, or phrase provides beyond what is already known. It quantifies the reduction in uncertainty or entropy when additional data is introduced. The IG score is often calculated as a ratio of the actual co-occurrence rate of two phrases to their expected co-occurrence rate. This score determines the strength of the relationship between phrases; if the score exceeds a threshold, the phrases are considered significantly related.
Sources & References
Explore other Core Concepts (AI/ML) terms
A
AI Overview
AI-generated summaries of highly informational, low-intent queries, offering quick answers to users, or generally, a…
A
Artificial Intelligence (AI)
The overarching concept related to the design and study of intelligent systems. Early systems relied…
A
Augmented Search Queries
Queries that expand or modify the original user query to improve search accuracy and relevance…
B
Bag of Words
A type of semantic representation of data, which can be extracted from page contents.
B
Bigram
A sequence of two adjacent words.
D
Deep Learning
A part of machine learning; Generative AI models like ChatGPT and LLM-based chatbots fall within…
D
Dimensionality Reduction
A process that reduces data, such as high-dimensional vectors, for visualization while preserving semantic structure…
E
Embedding
A numerical representation capturing the meaning of a document or data. Also referred to as…
E
Entity
A representation of real-world objects (people, products, places, concepts) that hold value from an SEO…
E
Entity Attribute (EAV Model)
Defining properties or characteristics of an entity (e.g., location, niche) used in the EAV model…
E
Entity Attribute Variable (EAV Model)
The concept encompassing entities, their attributes, and the specific values (variables) associated with those attributes.
E
Entity Variables (EAV)
Specific values an entity attribute can take (e.g., London, Paris for the Location attribute).