jens/Rbm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
311 Commits 1 Branch 1 Tag
156babeb49fd660888c1315321531128c28780ee
Commit Graph
40 Commits
Author SHA1 Message Date
jensandClaude Sonnet 5 656a0252d3 Wire up temperature-based sampling for poet text generation 
Greedy argmax decoding in RbmListener::forward always produces the
exact same character sequence and quickly falls into short repeating
loops once the 5-character lookback state revisits a prior cycle.

Add an optional temperature argument (poet f <seed> [temperature]) that
switches decoding to RnnStack::sample_one_hot, which now does proper
categorical sampling (temperature-scaled, renormalized draw) instead of
the old per-code Bernoulli approach that could leave the result as a
non-one-hot probability vector. Also seed Armadillo's RNG in main(),
since it otherwise defaults to a fixed seed and every run would sample
identically.

Add docs/RNN_ARCHITECTURE.md documenting how the RnnStack/Layer stack
implements the RNN (context chaining across layers, training/generation
data flow, and the decoding behavior above).

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016K8Gu7Qejd11JbdiHZqYAs
 2026-07-27 12:34:44 +02:00
jens f2f03479e2 - don't print training text after training 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@861 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 16:46:53 +00:00
jens e58593973d - refactored 
- create training one th e fly from file name

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@860 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 16:41:11 +00:00
jens 97c9dcce7c - added char2vec and vec2char 
- refactored

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@859 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 15:27:30 +00:00
jens a967f08874 - added DEFAULT_START_WORD 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@858 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 13:22:06 +00:00
jens 632a538bff - provide start text 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@857 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 13:13:12 +00:00
jens c10d9c6e38 - poet use AStack::weightsInit 
- AStack::weightsSave continue for other layer on failure 

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@854 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 06:28:39 +00:00
jens 02b40561ec - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@853 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-20 18:53:10 +00:00
jens ae81da610b - gibbsDoSampleHidden and gibbsDoSampleVisible onl used only training 
- very good results

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@852 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-20 18:16:35 +00:00
jens 7910a246fd - do forward pass after training 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@849 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-20 07:29:15 +00:00
jens d5d5ef62d9 - switch on gibbsDoSampleHidden during training. Leave it for forward pass 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@848 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 20:32:00 +00:00
jens 46bfddeab3 - do not save project per default 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@846 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 17:40:14 +00:00
jens 660c9ec9c2 - added simple command parsing 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@845 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 17:30:40 +00:00
jens 6a05a88d15 - numcontext is property of Layer 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@844 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 16:05:23 +00:00
jens 2f3c10095a - update poet 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@843 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 11:36:42 +00:00
jens da1139356a - update poet 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@842 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 11:21:08 +00:00
jens 7232870123 - added one hot gen 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@841 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-19 11:02:11 +00:00
jens 22833df1d8 - update model 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@839 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 20:42:43 +00:00
jens 022a273011 - use RnnTextHelper 
- update poet2

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@838 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 20:16:33 +00:00
jens cb066a5a5f - use RnnTextHelper 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@837 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 20:14:56 +00:00
jens 0544e7721b - improved poet 
- fixed time reversal in Rnn train and forward

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@834 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 17:56:43 +00:00
jens a061a94099 - update poet2 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@833 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 15:57:31 +00:00
jens 35cd850fb4 - added continous creative feedback sequence 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@832 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 15:54:52 +00:00
jens 87fc780461 - init weights on model load error 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@830 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 15:36:04 +00:00
jens d6ea343d4a - cleaned up 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@828 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 15:22:28 +00:00
jens 9a8ad70a0b - improved RnnStack 
- AStack: context doesn't belong o training data

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@827 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 14:27:39 +00:00
jens 17770f402c - integrated RnnStack 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@826 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-18 08:36:10 +00:00
jens 9b2861e3d8 - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@825 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-17 20:34:44 +00:00
jens 084c4902d8 - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@815 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-16 13:35:57 +00:00
jens a5bed3157a - fixed feed backs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@808 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-14 12:48:37 +00:00
jens 11ac4650d9 - more general to support more seq_lengths 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@807 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-14 10:47:22 +00:00
jens b1966a9ed8 - cleaned up 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@804 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 14:31:44 +00:00
jens 8377800998 - also print last char 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@803 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 13:01:30 +00:00
jens 3a615d74e5 - also print last char 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@802 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 13:00:49 +00:00
jens 9f1d442ab3 -use 3 gibbs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@801 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 12:56:42 +00:00
jens 8da5a99d81 - updated poet 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@799 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 12:36:52 +00:00
jens be64a88e04 - Layer: do gibbs sampling in calcContextBatch() 
- RBM: added Gibbs sampler
- Stack adjust training column vector according to needs

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@797 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 07:19:47 +00:00
jens dba52a651d - poet: create smaller data 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@796 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-12 20:12:14 +00:00
jens b69c735f5d - create training data 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@795 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-12 18:18:43 +00:00
jens 7c4b6fdb24 - added poet 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@794 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-12 14:25:00 +00:00