jens/Rbm-legacy
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
46 Commits 1 Branch 0 Tags
1705287e3760e74da73c00eefa7cf4330fa09d52
Commit Graph
46 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jens 1705287e37 [RBM] 
- DBN fixes
- batch sample inside training loop
- implemented RbmComponent stacking

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@296 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-18 17:57:32 +00:00
jens 46bffda38f [RBM] 
- added DBN stack
- concentrated RBM params into structure


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@295 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-17 22:14:55 +00:00
jens b10d06d96c [RBM] 
- refactored RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@294 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-16 20:09:16 +00:00
jens ff88a62e73 [RBM] 
- pulled LayerArray out of RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@293 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-16 19:16:33 +00:00
jens 4dccddd50f [RBM] 
- added getHiddenBatch() and getVisibleBatch()
- cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@292 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 21:30:28 +00:00
jens 3a200cb46e [RBM] 
- fix: skip variable variance calculation if no training data is present

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@291 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:53:54 +00:00
jens 2de8e9ac48 [RBM] 
- refactored and cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@290 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:32:28 +00:00
jens 3d56e4a163 [RBM] 
- MainComponent:fixed Jucer contention
- RBM : clear before file load

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@289 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 16:57:17 +00:00
jens 93b6144864 [RBM] 
- introduce RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@288 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-14 18:52:08 +00:00
jens 80135d0498 [RBM] 
- moved sigma and mean from WEIGHTS to RBM
- use Gibbs slider also for reconstruction draw


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@287 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-13 18:05:17 +00:00
jens 82d93ca7b5 more stable 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@286 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-05 22:04:13 +00:00
jens 40037f526d added 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@285 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-02 18:33:20 +00:00
jens cf4fb2a9ef added project 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@284 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-02 18:27:12 +00:00
jens f25f5b0dab fixed RBM 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@283 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-05-30 23:53:18 +00:00
jens 7fada2a227 [RBM] 
- committed local changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@270 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2015-05-28 17:41:06 +00:00
jens 549089a440 - added data normalization 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@45 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-12 13:08:20 +00:00
jens 6e7b8bc151 - train(): added reconstruction error metric 
- train2(): 
  - added reconstruction error metric. 
  - added Gaussian units
  - added sparsity

- GUI: choose train() or train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@44 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-01 18:01:04 +00:00
jens 93fa8c64ce - bugfix: weightDecay needs to be multiplied by mu_weights 
- Biases are initialized with zero
- developing full matrix calculation in train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@43 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-28 21:12:03 +00:00
jens 6520c80eca - LayerArray: added copy constructor 
- minor changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@42 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-26 08:46:13 +00:00
jens 376f2dfa35 -autoscale of data during draw. data remains unchanged 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@41 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 21:08:57 +00:00
jens 4d1f2f2e0c - changed gaussProb() 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@40 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 15:56:59 +00:00
jens 6b2fe10d05 - correct energy calc. for BB-RBMs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@39 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 15:34:12 +00:00
jens 025a45eb83 - weight decay is 0.0 per default 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@38 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 10:53:08 +00:00
jens 21701d103e - GUI: increased number of possible gibbs iterations 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@36 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-24 22:01:04 +00:00
jens 6a0ef8d8f7 - no need to free RBM instance when weight topology changes 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@35 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-24 06:10:54 +00:00
jens ba04927592 - added weight init std dev on GUI 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@34 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-20 06:47:51 +00:00
jens 0f38b78093 - changed noise API 
- noise initialized with help of clock()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@33 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-19 20:28:36 +00:00
jens d0243820d6 - init weight with dev = 0.001 
- layer load() plausibilty check

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@32 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-19 14:58:24 +00:00
jens 56b0c4bee6 - minor GUI fix 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@31 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-18 17:25:22 +00:00
jens 57761fe743 - RBM: changed calcualation of pre-weight update data in RBM 
- always use expectations
- removed "Use Expectations Button"
- removed Robbins-Monro
- added sparsity learning rate
- added momentum
- added weight decay
- added Slider as progress bar



git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@30 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-18 15:38:11 +00:00
jens 3fb8ac0629 - rearranged dot product 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@29 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-16 18:35:32 +00:00
jens 288775cf8c - update working weights after sparse pass 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@28 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-15 21:12:22 +00:00
jens afc1853664 - probsUpdateLogistic() use var for multiplication 
- automatic pattern reconstruction on pattern slider. Test button is obsolete
- revised sparse mode

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@27 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-15 20:35:49 +00:00
jens 005342e829 - RBM-Training has own thread 
- realtime update of Weights and reconstruction during training
- realtime update of reconstruction on relevant parameters
- added progress bar


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@26 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-14 23:06:34 +00:00
jens 7f4438d698 - added param sparsity 
- added gaussian visible unit
- added param sigma decay
- RBM modi and params are set using members
- use sigma instead of variance


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@25 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-14 21:23:01 +00:00
jens 0166b986cb - vectorized logSigmoid() and gaussProb() 
- added switch RBM_SPARSE
- added some experimental expect functions


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@24 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-12 18:18:09 +00:00
jens 19c69ac02a - use Matrix, linear algebra library Eigen 3.2.2 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@23 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-12 14:30:40 +00:00
jens 7b1a713adc - changed project settings: release is optimized for speed 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@22 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-08 18:48:02 +00:00
jens fc1f53fdb6 - added useProbsForHiddenReconstruction 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@21 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-08 18:45:15 +00:00
jens da30d95e31 - added Robbins-Monro (but doesn't work well) 
- added DrawListener
- added realtime reconstruct
- additional LayerArray constructor

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@20 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-07 20:42:57 +00:00
jens 39bf50701b - added button and functionality for Rao-Blackwellized weight update 
- added button for Robins-Monro weight update

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@19 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-07 06:50:30 +00:00
jens fc758b853a - use expectations 
- improved gibbs sampling
- LayerArray is template class

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@18 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-06 17:08:50 +00:00
jens f62f1283f8 further development 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@17 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-04 19:09:35 +00:00
jens b403b9776a - added 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@16 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-09-26 05:33:17 +00:00
jens b1a0c90ea0 - added grayscale display 
- reconstruction and hidden probs can be displayed

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@15 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-09-26 05:30:16 +00:00
jens 470437eecb - initial version 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@14 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-09-24 17:21:29 +00:00