tokenize
Pronunciation
This text is extracted from the Wiktionary and it is available under the CC BY-SA 3.0 license | Terms and conditions | Privacy policy 0.003
Pronunciation
- (GA) IPA: /ˈtoʊ.kən.aɪz/
tokenize (tokenizes, present participle tokenizing; past and past participle tokenized)
- (transitive, computing) To reduce to a set of tokens by lexical analysis.
- (transitive, computing) To substitute sensitive data with meaningless placeholders.
- (transitive) To treat as a token minority.
This text is extracted from the Wiktionary and it is available under the CC BY-SA 3.0 license | Terms and conditions | Privacy policy 0.003