jens/Rbm
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
289 Commits 1 Branch 1 Tag
5321e01ccad4b2cfadb9950e0c85c2ca10754ce1
Commit Graph
75 Commits
Author SHA1 Message Date
jens 5321e01cca - improved cd_hinton() 
- uniform() returns vector
 2024-02-01 19:03:13 +01:00
jens 8e44aff7a5 - prepare cd_jens() for linear hidden units 2024-01-31 20:52:18 +01:00
jens ccc3e0ac87 - fixed total error calc 2024-01-31 12:52:29 +01:00
jens 2a2be76b2c - AStack:Load show mean and stddev 2024-01-31 12:20:15 +01:00
jens e211c568ac Rbm 
- enable linear hidden : instead of prob(v_to_h()): use toHiddenProbs()
- enable linear visible: instead of prob(h_to_v()): use toVisibleProbs()
- make v_to_h() and h_to_v() private and force to use toHiddenProbs() and toVisibleProbs()
- use cd_jens or cd_hinton. cd_hinton_hid_lineaer is not of use anymre, since it is not capable of CDn
 2024-01-31 12:03:47 +01:00
jens c0445f3bf8 - moved Rbm:prob() to Matutils::prob() 
- Matutils::Normalize uses prob()
 2024-01-29 13:04:13 +01:00
jens fe8142627d cd_hinton_hid_binary: added raoBlackwell, gibbs-sampling 2024-01-25 22:45:50 +01:00
jens 34b20f4fb3 - refactored 
- switch between cd_hinton hid/linear and cd_jens using doGaussionVisible (temporary solution)
 2024-01-24 19:22:57 +01:00
jens a5ed0be991 - added original implementation for binary RBM 2024-01-24 18:41:42 +01:00
jens 84a5dd4550 Refactored 2024-01-24 17:04:05 +01:00
jens 88f649e8f4 - refactored 2024-01-24 16:56:49 +01:00
jens 9a381c1899 - its gaussion hidden (not gaussian visible) 2024-01-24 15:14:30 +01:00
jens fe9b1951ea - Added gaussian hidden units 2024-01-24 14:47:21 +01:00
jens 938368f1fa - refactored 
- constify
 2024-01-22 12:26:03 +01:00
jens aef3049856 - refactored common functions into matutils 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@855 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-21 07:46:40 +00:00
jens ae81da610b - gibbsDoSampleHidden and gibbsDoSampleVisible onl used only training 
- very good results

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@852 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-20 18:16:35 +00:00
jens 78c05afbc2 - removed noise c-sources 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@812 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-15 09:23:57 +00:00
jens 4b7c29effd - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@811 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-15 09:19:50 +00:00
jens 1eb631d254 - use arma::randu for uniform 
- use arma functions for sample()

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@798 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 10:27:10 +00:00
jens be64a88e04 - Layer: do gibbs sampling in calcContextBatch() 
- RBM: added Gibbs sampler
- Stack adjust training column vector according to needs

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@797 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-13 07:19:47 +00:00
jens fa2014b4dd - trainingdata always contains context 
- load / store training batch with context
- on load: add context part to  legacy training batches 
- removed Rbm::setBatch()

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@790 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-12 08:12:35 +00:00
jens 5cb7b16d96 - added rms_error function 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@786 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-11 19:13:30 +00:00
jens 648d8a002e - added setBatch() 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@771 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-10 10:36:55 +00:00
jens e240eae073 - moved context awareness from Rbm to Layer (final) 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@770 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-10 10:03:43 +00:00
jens e9de02ac3d - moved context awareness from Rbm to Layer 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@769 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-10 08:09:49 +00:00
jens 967df2906d - removed flat train routine 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@768 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-10 07:24:32 +00:00
jens 238a6d9258 - context drawComponents are always visible 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@765 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-09 13:02:52 +00:00
jens 5427287838 - fixed gui wiring 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@764 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-09 12:36:45 +00:00
jens 56335914ea - train with context 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@762 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-09 08:34:59 +00:00
jens c2ffecd66a - pass numContext 
- fixed crash when numContext == 0

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@761 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-09 08:01:25 +00:00
jens 9fff2082d6 - use all-at-onec (v+c) method 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@759 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 15:24:07 +00:00
jens 3272899888 - train whv and whc separately 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@758 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 13:30:26 +00:00
jens b46e53f207 - prepared for context processing 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@757 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 11:52:01 +00:00
jens 1698ce0a1b - simplified initial v_states generation 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@756 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 11:23:31 +00:00
jens 91bfa0e6ec - fixed prototype for v_probs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@755 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 11:16:20 +00:00
jens ef82ae7ea6 - refactored in gibbs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@753 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 11:10:26 +00:00
jens be9a4a4d74 - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@752 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 10:56:36 +00:00
jens 637b237966 - refactored 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@751 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-08 10:41:41 +00:00
jens 9472bb0a36 - refactored Rbm 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@750 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-07 18:23:43 +00:00
jens deb5a9ce65 - use new weightUpdate() 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@748 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-07 12:49:56 +00:00
jens dc8db11d9a - constify 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@747 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-07 12:46:03 +00:00
jens 66fe4a018d - refactored Rbm 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@746 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-07 12:40:57 +00:00
jens 7f3535954b - prepared for context units 
- simplified status report

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@745 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-07 08:49:12 +00:00
jens cbadd106f4 - speed improvment: sample minibatch only on minibatch change 
- refactored

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@744 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2022-01-06 11:00:51 +00:00
jens f610d2930e - add Rbm::normalize() 
- normalize of training data

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@660 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-11 21:08:48 +00:00
jens 5bb8d7a442 - correctly scale learningRate and weightDecay 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@654 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-11 17:41:55 +00:00
jens 1a876bc8e5 - Rbm: scale learningRate and weightDecay by minibtachsize 
- after create: new Layer is selected

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@653 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-11 07:07:23 +00:00
jens c12cc6a5d3 - improved progressIndicator 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@639 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-08 06:39:23 +00:00
jens 9ea6e48fff - improved progressIndicator 
- fixed Stack::trainingData()
- fixed test::main

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@638 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-08 06:38:09 +00:00
jens 215cfd11fa - improved progressIndicator 
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@637 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-11-08 05:57:41 +00:00