tokenize

English

Etymology

token +‎ -ize

Verb

tokenize (third-person singular simple present tokenizes, present participle tokenizing, simple past and past participle tokenized)

  1. (transitive, computing) To reduce to a set of tokens by parsing.
  2. (transitive, computing) To substitute sensitive data with meaningless placeholders.
  3. (transitive) To treat as a token minority.

Derived terms

This article is issued from Wiktionary. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.