llm-arch-research

penkovsky_sa/llm-arch-research

Fork 0

mirror of https://github.com/pese-git/llm-arch-research.git synced 2026-01-23 21:10:54 +00:00

Commit Graph

Author	SHA1	Message	Date
Sergey Penkovsky	dc440a3938	test(gpt2): add unit tests for generation, cache behavior, and error conditions - Covers forward pass with and without KV-cache - Verifies correct sequence generation for greedy, top-k, and top-p sampling - Adds ValueError test for exceeding max sequence length - Uses small random toy config and minimal setup for fast test feedback Motivation: Prevent regressions in decoding, sampling, and KV-cache logic in GPT2 implementation.	2025-10-15 14:36:32 +03:00

Author

SHA1

Message

Date

Sergey Penkovsky

dc440a3938

test(gpt2): add unit tests for generation, cache behavior, and error conditions

- Covers forward pass with and without KV-cache
- Verifies correct sequence generation for greedy, top-k, and top-p sampling
- Adds ValueError test for exceeding max sequence length
- Uses small random toy config and minimal setup for fast test feedback

Motivation: Prevent regressions in decoding, sampling, and KV-cache logic in GPT2 implementation.

2025-10-15 14:36:32 +03:00

1 Commits