3 Commits

Include renames

Author	SHA1	Message	Date
jensandClaude Sonnet 4.6	952045b9f1	[StackRnn] - temporal-shift padding, joint training, vocab reduction, TEMPORAL_DEPTH=64 ... stack_rnn.py: - _train_unrolled: C++-style temporal-shift padding — flatten (num_seq, T, s) → (N, s), append T-1 zero rows, layer t trains on batch[t:N+t]; joint training replaces greedy sequential (all layers update each epoch) - Reverted sequential/greedy training path (poor next-step prediction) moby_rnn.ipynb: - Vocabulary reduced 85 → 40 chars (A-Z, 0-9, space, .!?) - T renamed to TEMPORAL_DEPTH throughout - TEMPORAL_DEPTH increased 5 → 64; CONTEXT_SIZE 128 - SEED "Call me Ishmael." now falls within training data coverage state.py: - Remove per-file load/save print messages (too noisy with 64-layer checkpoints) README_moby_rnn.md: - Update vocab, constants, parameter count, checkpoint listing - Add temporal-shift padding and joint training sections - Clarify reconstruction accuracy vs next-step prediction as honest metric Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-05-31 14:37:08 +02:00
jensandClaude Sonnet 4.6	3698c85ed4	[StackRnn] - add unrolled (own-weights) mode; each position gets its own RBM ... Previously a single shared-weight Entity processed every time step. Now: - Shared mode (1 layer via make_layer): original behaviour unchanged - Unrolled mode (N layers via make_unrolled): layers[t] owns W_t, b_v_t, b_h_t New API: make_unrolled(T, sensory_size, h_size, ...) → list[Layer] next_entity() → Entity for the upcoming step() call current_entity() → Entity from the most recent step() call is_shared → bool moby_rnn.ipynb: switch Build model cell to make_unrolled(T=100); update predict_next() to use rnn.next_entity() for position-correct Gibbs sampling README_moby_rnn.md: redraw temporal-unrolling ASCII art showing per-position weights W_t; update parameter count and checkpoint file listing Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-05-31 11:52:01 +02:00
jensandClaude Sonnet 4.6	0b302a9c12	[moby_rnn] - add README with architecture ASCII art; consolidate constants ... - README_moby_rnn.md: single-step and temporally-unrolled ASCII diagrams, configuration table, notebook cell guide, generation API docs, references - moby_rnn.ipynb: move all constants (T, NUM_SEQ, EVAL_CHARS, PRED_CHARS, N_GIBBS, SEED, SEQ_IDX) into the Build model cell under a Configuration header; rename H_SIZE → CONTEXT_SIZE throughout Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	2026-05-31 11:42:55 +02:00