18 Commits
Author SHA1 Message Date
jens b534be9fad commit stale changes 2026-07-26 21:23:50 +02:00
jens 74371975ad [JayRnn]
- reduced VOCAB
- changed test text
2026-06-07 17:49:05 +02:00
jens 2d3361d5ce rework forward_step to use char-by-char state priming with SPACE token
Replace space ' ' with explicit SPACE='_' vocab token to disambiguate
padding from real spaces, and rewrite forward_step to take a single
character plus rolling state string instead of a reconstructed vc matrix,
producing predictions one character at a time per unit.
2026-06-07 13:34:02 +02:00
jens 51274ee1ae [jayRnn]
- adjusted params
2026-06-06 12:49:09 +02:00
jens 588f58883f - no "^" in vocabular
- JayRnn: wrong but stable
2026-06-06 12:35:20 +02:00
jensandClaude Sonnet 4.6 a41ddce6a8 scale up model, expand vocab, collect predicted text in forward pass
- Increase H_SIZE to 128, lr to 0.2, disable Rao-Blackwell
- Expand VOCAB to include lowercase and hyphen/period
- Fix batch_delay to always use delay=1 per unit
- forward_step now returns (vc, text) with predicted char per unit step
- Collect and print generated text in main inference loop

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 18:17:41 +02:00
jensandClaude Sonnet 4.6 5ac4608ba8 tune hyperparams and fix forward_step shift, re-enable training
- Switch TEXT to "HALLO MAUSI! SUPER HASE!", H_SIZE to 64, lr to 0.1
- Extract v2char() helper from vc2char()
- Fix shift_left to use vocab_size() step instead of 1
- Re-enable model.train() and model.save() in main
- Clean up dead prediction loop code

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 17:47:30 +02:00
jensandClaude Sonnet 4.6 f7ed8563d7 refactor RnnModel: multi-unit delay training and unified vc interface
- Add batch_delay() to shift visible input per unit index
- Unify forward_step() to work with combined vc matrix
- Fix split() to always slice on axis=1
- Add index param to Entity for readable naming
- Rename test_xor.py to xor.py, replace Mat with np.array

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 16:29:36 +02:00
jensandClaude Sonnet 4.6 248ae4f199 tune hyperparams, add README, simplify training loop
- reduce WIN to 3 and H_SIZE to 32 for faster iteration
- increase NUM_EPOCHS to 1000 and collapse NUM_ITERATIONS to a single pass
- add README_JayRnn.md with algorithm description and ASCII architecture diagrams

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 09:34:33 +02:00
jens b5a128fb61 fixed error for other WIN sizes 2026-06-04 23:19:18 +02:00
jens 06ab8d0166 refactored forward_step 2026-06-04 19:30:58 +02:00
jens 7f6818670e - changed sample text
- changed model params
2026-06-04 16:43:41 +02:00
jens 62dd450c9c increased difficulty 2026-06-04 11:15:17 +02:00
jens 4bd516798a cleaned up 2026-06-04 10:36:50 +02:00
jens bb6680c931 getting Rnn to work 2026-06-04 10:28:19 +02:00
jens 851bad28d3 cleaned up 2026-06-03 23:01:10 +02:00
jens 3a41014d50 improved context update for JayRnn 2026-06-03 22:58:18 +02:00
jens 2701daf1c4 added JayRnn 2026-06-03 22:14:40 +02:00