Sergey Penkovsky db0ab511d1 feat(gpt2): add Gpt2Decoder module, refactor model and add tests ...

- Implemented core/gpt2_decoder.py: transformer decoder block with kv cache in GPT2 style
- Refactored models/gpt/gpt2.py to use new Gpt2Decoder, improved documentation
- Added tests/core/test_gpt2_decoder.py for main features and cache
- Temporarily skipped HF proxy integration test for compatibility

2025-10-31 15:35:54 +03:00

..

test_cached_decoder.py

docs(core): add docstrings and unit tests for CachedDecoder module

2025-10-16 12:30:53 +03:00

test_feed_forward.py

Рефакторинг: единообразие оформления кода (пробелы, кавычки, пустые строки), без изменения логики по всему проекту.

2025-10-06 22:57:19 +03:00

test_geglu.py

feat(gemma): document and test GeGLU, MultiQueryAttention, GemmaDecoder, update Gemma model docs

2025-10-21 15:12:45 +03:00

test_gelu.py

docs(core): improve docstrings and add unit tests for GELU activation

2025-10-16 13:59:38 +03:00

test_gemma_decoder.py

feat(gemma): document and test GeGLU, MultiQueryAttention, GemmaDecoder, update Gemma model docs

2025-10-21 15:12:45 +03:00

test_gpt2_decoder.py

feat(gpt2): add Gpt2Decoder module, refactor model and add tests

2025-10-31 15:35:54 +03:00

test_gpt_decoder.py

refactor(gpt1): migrate Decoder to GptDecoder, unify API, and update tests

2025-10-22 16:27:08 +03:00

test_group_query_attention.py

docs(core): add comprehensive docstrings and unit tests for GroupedQueryAttention (GQA)

2025-10-15 17:27:55 +03:00

test_mistral_decoder.py

docs(core): add docstrings and unit tests for MistralDecoder

2025-10-15 18:07:11 +03:00

test_mixtral_decoder.py

feat(mixtral): add MixtralDecoder, enhance MoE and Mixtral model docs, add unit tests

2025-10-20 16:07:51 +03:00

test_moe.py

feat(mixtral): add MixtralDecoder, enhance MoE and Mixtral model docs, add unit tests

2025-10-20 16:07:51 +03:00

test_multi_head_attention.py

refactor(core): refactor RoPE and MultiHeadAttention, add math-rich docs, expand tests, remove unused head_attention

2025-10-15 11:04:07 +03:00

test_multi_query_attention.py

feat(gemma): document and test GeGLU, MultiQueryAttention, GemmaDecoder, update Gemma model docs

2025-10-21 15:12:45 +03:00

test_positional_embeddings.py

Рефакторинг: единообразие оформления кода (пробелы, кавычки, пустые строки), без изменения логики по всему проекту.

2025-10-06 22:57:19 +03:00

test_rms_norm.py

docs(core): expand docstrings and add unit tests for RMSNorm

2025-10-16 14:37:25 +03:00

test_rope.py

refactor(core): refactor RoPE and MultiHeadAttention, add math-rich docs, expand tests, remove unused head_attention

2025-10-15 11:04:07 +03:00

test_silu.py

docs(core): add docstrings and unit tests for SiLU activation

2025-10-16 14:48:50 +03:00

test_swi_glu.py

docs(core): add docstrings and unit tests for SwiGLU block

2025-10-16 15:09:09 +03:00

test_token_embeddings.py

Рефакторинг: единообразие оформления кода (пробелы, кавычки, пустые строки), без изменения логики по всему проекту.

2025-10-06 22:57:19 +03:00