Glossary / TokenToken

TokenToken

A small piece of text the model reads and writes. In English one token is about three quarters of a word.

Potongan kecil teks yang dibaca dan ditulis model. Dalam bahasa Inggris, satu token kira-kira tiga perempat kata.

Example

Contoh

"unbelievable" may be split into 3 tokens.

"unbelievable" bisa dipecah jadi 3 token.

Why it matters

Kenapa penting

Limits and prices are counted in tokens, not words. Indonesian usually needs more tokens per word.

Batas dan harga dihitung dalam token, bukan kata. Bahasa Indonesia biasanya butuh lebih banyak token per kata.

See it in the calculator →Lihat di kalkulator →

More terms

Istilah lain