jens/Rbm-legacy
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
74 Commits 1 Branch 0 Tags
master
Commit Graph
41 Commits
Author SHA1 Message Date
jens 0b85dd7148 - no weight decay per default 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@602 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-29 07:20:20 +00:00
jens 2c2039ec2f - added early stop of training 
- fixed non-visible training data after load

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@554 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-17 19:48:14 +00:00
jens 0f2fe2b315 - fully refactored traning 
- removed non working stuff

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@553 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-17 18:58:12 +00:00
jens 80a67ba314 [RBM] 
- committed last changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@359 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2018-06-12 17:01:49 +00:00
jens 2eabaa42ec [RBM] 
- miniBatchSize is parameter of train()

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@307 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-07 23:34:03 +00:00
jens 57cdfd7065 [RBM] 
- GUI: added gaussian hidden, added mini batch size
- Rbm: added mini batch training revised sample functions, reverted to old weight decay


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@305 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-07 19:27:33 +00:00
jens 4979ab41b4 [RBM] 
- introduced mini batch training


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@304 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-30 07:52:49 +00:00
jens 54e4065a00 [RBM] 
- splitted bm into hpp and cpp

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@302 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-27 07:36:28 +00:00
jens b1fcf14e99 [RBM] 
- sample h before negative phase

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@301 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-23 06:45:57 +00:00
jens 866a0349db [RBM] 
- DrawComponent: use fixed value scaling
- Rbm: fixed weight decay
- Rbm: fixed sparsity


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@298 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-22 19:11:09 +00:00
jens 9d00654932 [RBM] 
- removed classes HiddenLayer.hpp and VisibleLayer.hpp
- fixed warnings
- RbmComponent inherits Rbm
- improved Rbm::train
- use gaussion weight initialization

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@297 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-19 19:52:41 +00:00
jens 1705287e37 [RBM] 
- DBN fixes
- batch sample inside training loop
- implemented RbmComponent stacking

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@296 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-18 17:57:32 +00:00
jens 46bffda38f [RBM] 
- added DBN stack
- concentrated RBM params into structure


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@295 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-17 22:14:55 +00:00
jens ff88a62e73 [RBM] 
- pulled LayerArray out of RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@293 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-16 19:16:33 +00:00
jens 4dccddd50f [RBM] 
- added getHiddenBatch() and getVisibleBatch()
- cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@292 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 21:30:28 +00:00
jens 3a200cb46e [RBM] 
- fix: skip variable variance calculation if no training data is present

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@291 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:53:54 +00:00
jens 2de8e9ac48 [RBM] 
- refactored and cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@290 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:32:28 +00:00
jens 93b6144864 [RBM] 
- introduce RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@288 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-14 18:52:08 +00:00
jens 80135d0498 [RBM] 
- moved sigma and mean from WEIGHTS to RBM
- use Gibbs slider also for reconstruction draw


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@287 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-13 18:05:17 +00:00
jens 82d93ca7b5 more stable 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@286 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-05 22:04:13 +00:00
jens 7fada2a227 [RBM] 
- committed local changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@270 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2015-05-28 17:41:06 +00:00
jens 549089a440 - added data normalization 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@45 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-12 13:08:20 +00:00
jens 6e7b8bc151 - train(): added reconstruction error metric 
- train2(): 
  - added reconstruction error metric. 
  - added Gaussian units
  - added sparsity

- GUI: choose train() or train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@44 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-01 18:01:04 +00:00
jens 93fa8c64ce - bugfix: weightDecay needs to be multiplied by mu_weights 
- Biases are initialized with zero
- developing full matrix calculation in train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@43 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-28 21:12:03 +00:00
jens 6520c80eca - LayerArray: added copy constructor 
- minor changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@42 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-26 08:46:13 +00:00
jens 376f2dfa35 -autoscale of data during draw. data remains unchanged 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@41 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 21:08:57 +00:00
jens 6b2fe10d05 - correct energy calc. for BB-RBMs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@39 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 15:34:12 +00:00
jens 57761fe743 - RBM: changed calcualation of pre-weight update data in RBM 
- always use expectations
- removed "Use Expectations Button"
- removed Robbins-Monro
- added sparsity learning rate
- added momentum
- added weight decay
- added Slider as progress bar



git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@30 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-18 15:38:11 +00:00
jens 288775cf8c - update working weights after sparse pass 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@28 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-15 21:12:22 +00:00
jens afc1853664 - probsUpdateLogistic() use var for multiplication 
- automatic pattern reconstruction on pattern slider. Test button is obsolete
- revised sparse mode

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@27 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-15 20:35:49 +00:00
jens 005342e829 - RBM-Training has own thread 
- realtime update of Weights and reconstruction during training
- realtime update of reconstruction on relevant parameters
- added progress bar


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@26 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-14 23:06:34 +00:00
jens 7f4438d698 - added param sparsity 
- added gaussian visible unit
- added param sigma decay
- RBM modi and params are set using members
- use sigma instead of variance


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@25 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-14 21:23:01 +00:00
jens 0166b986cb - vectorized logSigmoid() and gaussProb() 
- added switch RBM_SPARSE
- added some experimental expect functions


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@24 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-12 18:18:09 +00:00
jens 19c69ac02a - use Matrix, linear algebra library Eigen 3.2.2 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@23 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-12 14:30:40 +00:00
jens fc1f53fdb6 - added useProbsForHiddenReconstruction 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@21 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-08 18:45:15 +00:00
jens da30d95e31 - added Robbins-Monro (but doesn't work well) 
- added DrawListener
- added realtime reconstruct
- additional LayerArray constructor

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@20 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-07 20:42:57 +00:00
jens 39bf50701b - added button and functionality for Rao-Blackwellized weight update 
- added button for Robins-Monro weight update

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@19 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-07 06:50:30 +00:00
jens fc758b853a - use expectations 
- improved gibbs sampling
- LayerArray is template class

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@18 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-06 17:08:50 +00:00
jens f62f1283f8 further development 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@17 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-04 19:09:35 +00:00
jens b1a0c90ea0 - added grayscale display 
- reconstruction and hidden probs can be displayed

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@15 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-09-26 05:30:16 +00:00
jens 470437eecb - initial version 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@14 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-09-24 17:21:29 +00:00