penkovsky_sa/llm-arch-research
1
0
Fork 0
mirror of https://github.com/pese-git/llm-arch-research.git synced 2026-01-24 05:21:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
66 Commits 8 Branches 0 Tags
db0ab511d18f9784feb59a8adef7feadf5b0fb23
Commit Graph

3 Commits

Author SHA1 Message Date
Sergey Penkovsky
db0ab511d1 feat(gpt2): add Gpt2Decoder module, refactor model and add tests 
- Implemented core/gpt2_decoder.py: transformer decoder block with kv cache in GPT2 style
- Refactored models/gpt/gpt2.py to use new Gpt2Decoder, improved documentation
- Added tests/core/test_gpt2_decoder.py for main features and cache
- Temporarily skipped HF proxy integration test for compatibility
 2025-10-31 15:35:54 +03:00
Sergey Penkovsky
712278e33c Рефакторинг: единообразие оформления кода (пробелы, кавычки, пустые строки), без изменения логики по всему проекту. 2025-10-06 22:57:19 +03:00
Sergey Penkovsky
ec07546ea8 feat: initial project setup with LLM architecture and HF integration 
- Add LLM library with GPT model implementation
- Add hf-proxy for HuggingFace integration
- Add experiments for training and generation
- Add comprehensive documentation and examples
- Configure uv workspace with proper dependencies
 2025-10-04 22:40:21 +03:00