11 Commits
Author SHA1 Message Date
jensandClaude Sonnet 5 656a0252d3 Wire up temperature-based sampling for poet text generation
Greedy argmax decoding in RbmListener::forward always produces the
exact same character sequence and quickly falls into short repeating
loops once the 5-character lookback state revisits a prior cycle.

Add an optional temperature argument (poet f <seed> [temperature]) that
switches decoding to RnnStack::sample_one_hot, which now does proper
categorical sampling (temperature-scaled, renormalized draw) instead of
the old per-code Bernoulli approach that could leave the result as a
non-one-hot probability vector. Also seed Armadillo's RNG in main(),
since it otherwise defaults to a fixed seed and every run would sample
identically.

Add docs/RNN_ARCHITECTURE.md documenting how the RnnStack/Layer stack
implements the RNN (context chaining across layers, training/generation
data flow, and the decoding behavior above).

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016K8Gu7Qejd11JbdiHZqYAs
2026-07-27 12:34:44 +02:00
jens e58593973d - refactored
- create training one th e fly from file name

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@860 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-21 16:41:11 +00:00
jens 6a05a88d15 - numcontext is property of Layer
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@844 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-19 16:05:23 +00:00
jens 7232870123 - added one hot gen
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@841 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-19 11:02:11 +00:00
jens 1c206de402 - forward: provide current expect next
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@836 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-18 20:14:31 +00:00
jens 0544e7721b - improved poet
- fixed time reversal in Rnn train and forward

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@834 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-18 17:56:43 +00:00
jens d6ea343d4a - cleaned up
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@828 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-18 15:22:28 +00:00
jens 9a8ad70a0b - improved RnnStack
- AStack: context doesn't belong o training data

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@827 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-18 14:27:39 +00:00
jens 17770f402c - integrated RnnStack
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@826 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-18 08:36:10 +00:00
jens 51e6eef12e - refactored
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@824 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-17 20:22:10 +00:00
jens e55f8e2153 - added StackCreator
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@823 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-17 18:40:50 +00:00