Commit Graph
57 Commits
Author SHA1 Message Date
jens 1eb631d254 - use arma::randu for uniform
- use arma functions for sample()

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@798 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-13 10:27:10 +00:00
jens be64a88e04 - Layer: do gibbs sampling in calcContextBatch()
- RBM: added Gibbs sampler
- Stack adjust training column vector according to needs

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@797 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-13 07:19:47 +00:00
jens fa2014b4dd - trainingdata always contains context
- load / store training batch with context
- on load: add context part to  legacy training batches 
- removed Rbm::setBatch()

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@790 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-12 08:12:35 +00:00
jens 5cb7b16d96 - added rms_error function
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@786 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-11 19:13:30 +00:00
jens 648d8a002e - added setBatch()
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@771 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-10 10:36:55 +00:00
jens e240eae073 - moved context awareness from Rbm to Layer (final)
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@770 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-10 10:03:43 +00:00
jens e9de02ac3d - moved context awareness from Rbm to Layer
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@769 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-10 08:09:49 +00:00
jens 967df2906d - removed flat train routine
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@768 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-10 07:24:32 +00:00
jens 238a6d9258 - context drawComponents are always visible
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@765 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-09 13:02:52 +00:00
jens 5427287838 - fixed gui wiring
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@764 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-09 12:36:45 +00:00
jens 56335914ea - train with context
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@762 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-09 08:34:59 +00:00
jens c2ffecd66a - pass numContext
- fixed crash when numContext == 0

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@761 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-09 08:01:25 +00:00
jens 9fff2082d6 - use all-at-onec (v+c) method
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@759 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 15:24:07 +00:00
jens 3272899888 - train whv and whc separately
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@758 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 13:30:26 +00:00
jens b46e53f207 - prepared for context processing
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@757 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 11:52:01 +00:00
jens 1698ce0a1b - simplified initial v_states generation
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@756 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 11:23:31 +00:00
jens 91bfa0e6ec - fixed prototype for v_probs
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@755 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 11:16:20 +00:00
jens ef82ae7ea6 - refactored in gibbs
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@753 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 11:10:26 +00:00
jens be9a4a4d74 - refactored
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@752 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 10:56:36 +00:00
jens 637b237966 - refactored
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@751 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-08 10:41:41 +00:00
jens 9472bb0a36 - refactored Rbm
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@750 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-07 18:23:43 +00:00
jens deb5a9ce65 - use new weightUpdate()
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@748 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-07 12:49:56 +00:00
jens dc8db11d9a - constify
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@747 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-07 12:46:03 +00:00
jens 66fe4a018d - refactored Rbm
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@746 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-07 12:40:57 +00:00
jens 7f3535954b - prepared for context units
- simplified status report

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@745 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-07 08:49:12 +00:00
jens cbadd106f4 - speed improvment: sample minibatch only on minibatch change
- refactored

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@744 b431acfa-c32f-4a4a-93f1-934dc6c82436
2022-01-06 11:00:51 +00:00
jens f610d2930e - add Rbm::normalize()
- normalize of training data

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@660 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-11 21:08:48 +00:00
jens 5bb8d7a442 - correctly scale learningRate and weightDecay
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@654 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-11 17:41:55 +00:00
jens 1a876bc8e5 - Rbm: scale learningRate and weightDecay by minibtachsize
- after create: new Layer is selected

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@653 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-11 07:07:23 +00:00
jens c12cc6a5d3 - improved progressIndicator
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@639 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-08 06:39:23 +00:00
jens 9ea6e48fff - improved progressIndicator
- fixed Stack::trainingData()
- fixed test::main

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@638 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-08 06:38:09 +00:00
jens 215cfd11fa - improved progressIndicator
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@637 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-08 05:57:41 +00:00
jens 4c68cd4370 - Rbm::onProgress provides object to itself
- MainComponentz is Rbm::IListener

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@635 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-07 19:27:15 +00:00
jens 10aff804f0 Rbm: added assertion check for params
- improved creation of stack

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@609 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-07 07:39:13 +00:00
jens b20604e4f4 - Rbm: fixed parameter import
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@607 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-06 06:24:48 +00:00
jens 3ef7b07f5e - moved numEpochs and miniBatchSize to RBM::Params
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@606 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-11-06 06:12:51 +00:00
jens a8a8900bc8 - Rbm::uniform(): fixed usage of arma::randu()
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@604 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-29 16:39:53 +00:00
jens a061fdf0da - use custom noise for bugfixing
- init weights with zero mean uniform noise

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@598 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-29 07:00:59 +00:00
jens 595be173b1 - more compact
- added Stack::weights init
- create smaller test.prj

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@596 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-28 22:53:29 +00:00
jens 8a37ee6a69 - weightInit are construction time parameter
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@593 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-28 20:04:39 +00:00
jens e2bd0ee850 - rbm: no training params at construction
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@591 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-28 19:20:34 +00:00
jens 711ad3057e - Rbm: cleaned up, learning_rate and weight_decay normalized to miniBatchSizeActual
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@590 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-28 19:08:30 +00:00
jens 9fd440e761 - Rbm::Status: don't touch err_total until it's computed
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@585 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-26 06:28:35 +00:00
jens 28bbff0b45 Rbm:🚋 better status indication
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@584 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-26 06:26:02 +00:00
jens d16f0de8fa - rename Layer into RbmLayer
- add some log info on toJson()

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@582 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-26 06:07:13 +00:00
jens 36fc99df9c [Rbm]
- removed noise sources

git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@575 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-25 16:03:13 +00:00
jens 0760d08516 [Rbm]
- added JSON
- refactored


git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@574 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-25 16:01:55 +00:00
jens 0e544c1afc - changed parameter order of train()
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@571 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-24 18:54:40 +00:00
jens d6ed27f5d2 - renamed Params member
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@570 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-24 18:51:45 +00:00
jens f7acfc5bd0 - RBM fixed progress indication
git-svn-id: http://moon:8086/svn/software/trunk/projects/Rbm@569 b431acfa-c32f-4a4a-93f1-934dc6c82436
2019-10-24 18:34:41 +00:00