Sergey Penkovsky ec0d2bd8d0 feat(mistral): add Mistral model implementation and configs ...

- implement Mistral model in llm/models/mistral/mistral.py with GroupedQueryAttention, SwiGLU, RoPE, sliding window attention
- add __init__.py for module export
- add config files for mistral training and generation
- update universal experiment runner to support Mistral model
- add notebook for Mistral experiments

2025-10-14 14:53:45 +03:00

..

bpe.ipynb

chore: add ipykernel dependency and update notebooks

2025-10-05 11:59:24 +03:00

gpt2.ipynb

docs: add GPT-2 analysis notebook

2025-10-05 12:48:32 +03:00

gpt.ipynb

fix: rename notebook

2025-10-05 12:46:17 +03:00

llama.ipynb

fix(rope, attention): корректное позиционирование RoPE при генерации с кэшем

2025-10-14 12:03:20 +03:00

mistral.ipynb

feat(mistral): add Mistral model implementation and configs

2025-10-14 14:53:45 +03:00