jens/Rbm-legacy
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
64 Commits 1 Branch 0 Tags
262ae305767ca4571cc63a04b78b46f4b87a6ed1
Commit Graph
64 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
jens 262ae30576 - refactored 
- print L1 and L2 values

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@551 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-16 16:34:38 +00:00
jens 149385d292 - RBM use L1 weight decay 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@550 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-14 19:02:27 +00:00
jens 9d8bdf45b3 - check result of fscanf 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@549 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-14 19:01:12 +00:00
jens 77a3bca92d - check result of fscanf 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@548 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-14 19:00:51 +00:00
jens 82e7286848 - added tooltip window 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@547 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2019-10-01 17:51:15 +00:00
jens 4dc1a01c34 - changed path for prj files to /home/jens/.rbm 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@362 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2018-10-05 20:13:25 +00:00
jens 80a67ba314 [RBM] 
- committed last changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@359 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2018-06-12 17:01:49 +00:00
jens 9f8d84008c - load training: no size between samples, progress 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@308 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-12 16:54:21 +00:00
jens 2eabaa42ec [RBM] 
- miniBatchSize is parameter of train()

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@307 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-07 23:34:03 +00:00
jens 0259727a2c [RBM] 
- improved multi layer weight reconstruction using weight convolution

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@306 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-07 22:54:54 +00:00
jens 57cdfd7065 [RBM] 
- GUI: added gaussian hidden, added mini batch size
- Rbm: added mini batch training revised sample functions, reverted to old weight decay


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@305 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-07-07 19:27:33 +00:00
jens 4979ab41b4 [RBM] 
- introduced mini batch training


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@304 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-30 07:52:49 +00:00
jens 6e93c07863 [RBM] 
- render lower layer weights as linear combination from top weights using up pass of reconstructions

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@303 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-29 20:29:17 +00:00
jens 54e4065a00 [RBM] 
- splitted bm into hpp and cpp

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@302 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-27 07:36:28 +00:00
jens b1fcf14e99 [RBM] 
- sample h before negative phase

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@301 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-23 06:45:57 +00:00
jens 605ee4da46 update 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@300 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-22 19:29:13 +00:00
jens 866a0349db [RBM] 
- DrawComponent: use fixed value scaling
- Rbm: fixed weight decay
- Rbm: fixed sparsity


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@298 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-22 19:11:09 +00:00
jens 9d00654932 [RBM] 
- removed classes HiddenLayer.hpp and VisibleLayer.hpp
- fixed warnings
- RbmComponent inherits Rbm
- improved Rbm::train
- use gaussion weight initialization

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@297 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-19 19:52:41 +00:00
jens 1705287e37 [RBM] 
- DBN fixes
- batch sample inside training loop
- implemented RbmComponent stacking

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@296 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-18 17:57:32 +00:00
jens 46bffda38f [RBM] 
- added DBN stack
- concentrated RBM params into structure


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@295 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-17 22:14:55 +00:00
jens b10d06d96c [RBM] 
- refactored RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@294 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-16 20:09:16 +00:00
jens ff88a62e73 [RBM] 
- pulled LayerArray out of RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@293 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-16 19:16:33 +00:00
jens 4dccddd50f [RBM] 
- added getHiddenBatch() and getVisibleBatch()
- cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@292 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 21:30:28 +00:00
jens 3a200cb46e [RBM] 
- fix: skip variable variance calculation if no training data is present

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@291 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:53:54 +00:00
jens 2de8e9ac48 [RBM] 
- refactored and cleaned up

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@290 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 20:32:28 +00:00
jens 3d56e4a163 [RBM] 
- MainComponent:fixed Jucer contention
- RBM : clear before file load

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@289 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-15 16:57:17 +00:00
jens 93b6144864 [RBM] 
- introduce RbmComponent

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@288 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-14 18:52:08 +00:00
jens 80135d0498 [RBM] 
- moved sigma and mean from WEIGHTS to RBM
- use Gibbs slider also for reconstruction draw


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@287 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-13 18:05:17 +00:00
jens 82d93ca7b5 more stable 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@286 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-05 22:04:13 +00:00
jens 40037f526d added 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@285 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-02 18:33:20 +00:00
jens cf4fb2a9ef added project 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@284 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-06-02 18:27:12 +00:00
jens f25f5b0dab fixed RBM 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@283 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2016-05-30 23:53:18 +00:00
jens 7fada2a227 [RBM] 
- committed local changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@270 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2015-05-28 17:41:06 +00:00
jens 549089a440 - added data normalization 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@45 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-12 13:08:20 +00:00
jens 6e7b8bc151 - train(): added reconstruction error metric 
- train2(): 
  - added reconstruction error metric. 
  - added Gaussian units
  - added sparsity

- GUI: choose train() or train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@44 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-11-01 18:01:04 +00:00
jens 93fa8c64ce - bugfix: weightDecay needs to be multiplied by mu_weights 
- Biases are initialized with zero
- developing full matrix calculation in train2()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@43 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-28 21:12:03 +00:00
jens 6520c80eca - LayerArray: added copy constructor 
- minor changes

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@42 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-26 08:46:13 +00:00
jens 376f2dfa35 -autoscale of data during draw. data remains unchanged 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@41 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 21:08:57 +00:00
jens 4d1f2f2e0c - changed gaussProb() 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@40 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 15:56:59 +00:00
jens 6b2fe10d05 - correct energy calc. for BB-RBMs 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@39 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 15:34:12 +00:00
jens 025a45eb83 - weight decay is 0.0 per default 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@38 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-25 10:53:08 +00:00
jens 21701d103e - GUI: increased number of possible gibbs iterations 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@36 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-24 22:01:04 +00:00
jens 6a0ef8d8f7 - no need to free RBM instance when weight topology changes 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@35 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-24 06:10:54 +00:00
jens ba04927592 - added weight init std dev on GUI 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@34 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-20 06:47:51 +00:00
jens 0f38b78093 - changed noise API 
- noise initialized with help of clock()


git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@33 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-19 20:28:36 +00:00
jens d0243820d6 - init weight with dev = 0.001 
- layer load() plausibilty check

git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@32 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-19 14:58:24 +00:00
jens 56b0c4bee6 - minor GUI fix 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@31 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-18 17:25:22 +00:00
jens 57761fe743 - RBM: changed calcualation of pre-weight update data in RBM 
- always use expectations
- removed "Use Expectations Button"
- removed Robbins-Monro
- added sparsity learning rate
- added momentum
- added weight decay
- added Slider as progress bar



git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@30 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-18 15:38:11 +00:00
jens 3fb8ac0629 - rearranged dot product 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@29 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-16 18:35:32 +00:00
jens 288775cf8c - update working weights after sparse pass 
git-svn-id: http://moon:8086/svn/software/trunk/projects/RBM@28 b431acfa-c32f-4a4a-93f1-934dc6c82436
 2014-10-15 21:12:22 +00:00