…swered in one call. Numbers (Apple M5 Pro, 1,000 DBpedia abstracts) Core ML (fp16) gliner2 PyTorch, Mac GPU --- ---: ---: Time ~5.9 s 22.8 s Peak memory ~1.0 GB 5.7 GB We

…cy). - LayaTokenizer : mmBERT/Gemma byte-fallback BPE, byte-exact with HuggingFace tokenizers on the conversion fixtures. - FluidUseLaya CLI: answer , tetris , benchmark

…d together, so multi-byte codepoints split across BPE tokens no longer surface as U+FFFD in WordTimestamp.word . Full changelog : https://github.com/nyrahealth/CrisperWhi

…LT text encoder (shared) - clip vocab.json — CLIP BPE vocabulary (shared) Demo: sample apps/YOLOEDemo (camera/photo/video + Visual tab). License: AGPL-3.0 (THU-MIG/yoloe)

… ChatML marker filter — 32-byte lookahead catches BPE-split stop tokens across boundaries - 16 chat-cache bugs eliminated — two audit passes found hidden bugs in KV prefi

…ty and top alternative tokens for each position - BPE-aware - Correctly decodes GPT-2 BPE and SentencePiece token formats Enable logprobs in the chat settings to activate