8 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Sergey Penkovsky	87a38e06c4	Переименовал token_embedings.py → token_embeddings.py (исправление опечатки)	2025-07-18 00:17:37 +03:00
Sergey Penkovsky	f74f41b65e	Добавлены TokenEmbeddings: реализация, документация и примеры	2025-07-17 17:51:53 +03:00
Sergey Penkovsky	6f2de3c13d	docs(readme): add encode/decode examples and output samples	2025-07-13 01:08:37 +03:00
Sergey Penkovsky	6d746a960e	feat: implement encode/decode methods	2025-07-12 11:48:34 +03:00
Sergey Penkovsky	3de32b2856	docs(example): update BPE example with encode/decode demonstration	2025-07-12 11:46:57 +03:00
Sergey Penkovsky	26f173cc16	doc: update bpe algorithm	2025-07-12 11:19:54 +03:00
Sergey Penkovsky	362a7483e6	feat: implement bpe algorithm	2025-07-11 12:21:33 +03:00
Sergey Penkovsky	45eaaabd51	Initial commit	2025-07-08 14:42:24 +03:00