Categories

vector representation

Embedding

Embedding is a numerical representation of content that allows a model or search system to compare meaning, not just exact wording. A text, image, document or another input is converted ...

Embedding is a numerical representation of content that allows a model or search system to compare meaning, not just exact wording. A text, image, document or another input is converted Read article

Token

A token is the basic unit of text or other input that a language model processes. It is not exactly the same as a word, a sentence or a character. ...

A token is the basic unit of text or other input that a language model processes. It is not exactly the same as a word, a sentence or a character. Read article