test: add comprehensive test suite for LLM components

- Add pytest configuration and fixtures
- Add tests for core modules: decoder, feed_forward, multi_head_attention
- Add tests for positional and token embeddings
- Add tests for GPT model
- Add tests for tokenizers (base and BPE)
- Add basic integration tests
This commit is contained in:
Sergey Penkovsky
2025-10-05 08:11:18 +03:00
parent f4bdc81829
commit fb74dc7c17
12 changed files with 1653 additions and 0 deletions

15
llm/pytest.ini Normal file
View File

@@ -0,0 +1,15 @@
[tool:pytest]
testpaths = tests
python_files = test_*.py
python_classes = Test*
python_functions = test_*
addopts =
--verbose
--tb=short
--strict-markers
--strict-config
--disable-warnings
markers =
slow: marks tests as slow (deselect with '-m "not slow"')
gpu: marks tests that require GPU
integration: marks tests as integration tests