Commit Graph
86 Commits
Author SHA1 Message Date
jensandClaude Sonnet 4.6 07e430f109 [cd_gaussian_binary] - fix negative phase: remove spurious noise, sample hidden states
In cd_gaussian_binary, two CD formulation bugs:
1. Gaussian noise was incorrectly added to data_neg before computing h_probs_neg
2. Negative visible reconstruction used h_probs_pos (soft probabilities) instead
   of sampled binary hidden states, biasing the fantasy particle toward the mean

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-30 14:36:18 +02:00
jensandClaude Sonnet 4.6 95be9dd632 [conv2d] - add 2D convolution function and test
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-29 10:11:11 +02:00
jens 92afc16137 [SubImage]
- handle different image shapes
2026-01-11 11:21:42 +01:00
jens be64b0f8ce refactored 2026-01-10 16:46:27 +01:00
jens 1722a68b2a [entity]
- refactored training parameters for grad_compute()
- added l1-norm
- improved tests
2026-01-10 15:21:40 +01:00
jens f7e3693f45 - added image module with sub image and normalize
- improved tests
2026-01-10 14:12:29 +01:00
jens f1aae9b0f1 [train]
- reset grad at start of epoch
[state]
- init(): set default parameter mu=0
2026-01-10 10:19:30 +01:00
jens 4c939cab8b cd_gaussian_binary: no sampling of training data 2026-01-09 15:28:06 +01:00
jens 9025f54434 simplified EntityParams.from_dict 2026-01-06 21:49:35 +01:00
jens e7b287e632 - simplified TrainingParams.from_dict
- fixed test_rbm
2026-01-06 21:48:09 +01:00
jens 226453c7ae fixed status indention 2026-01-06 21:06:11 +01:00
jens 7d3ab02e26 fixed dividing l2-norm by length of vector 2026-01-06 18:17:45 +01:00
jens 542b8ae9b0 added L2-Regulation 2026-01-06 18:00:26 +01:00
jens ff6254a15d - Status has entity paarmeter
- train provides entity parameter to Status
2026-01-06 11:29:47 +01:00
jens ec5d259ff7 Entity: added property enable training 2026-01-06 09:44:29 +01:00
jens 74138b5514 train: swapped epochs and mini-batch loop 2026-01-05 20:53:31 +01:00
jens d238d2954e grad_compute(): pre-multiply weight decay with learning rate 2026-01-05 19:40:05 +01:00
jens fdf4186d6b significantly improved GB-RBM training 2026-01-05 14:16:34 +01:00
jens 9f72c1f253 - added cifar_test as jupiter lab
- started torch version of RBM
- enable CUDA in matrix
2026-01-04 18:30:01 +01:00
jens 6546c37657 train: fixed gaussian sampling 2026-01-03 19:30:47 +01:00
jens 529252166a train: sample gaussian visible units 2026-01-03 12:40:08 +01:00
jens 94595ddd8a train: added cd_binary_gaussian 2026-01-03 12:10:17 +01:00
jens 082bb3c566 Label: added OneHote encoding 2026-01-02 22:49:00 +01:00
jens 2e714685d1 model: forward() is not abstract method 2026-01-02 19:42:22 +01:00
jens 10691894d1 - training params are (again) attrubute of Entity
- ditched layout concept
2026-01-02 14:51:19 +01:00
jens 8b97350564 cd_binary_binary: added gibbs sampling 2026-01-01 20:02:22 +01:00
jens e67207504b fixed cd_binary_binary 2026-01-01 15:55:35 +01:00
jens dc998d30a2 - initroduced types: BB-RBM GB-RBM, GG-RBM as property of entity
- training simplification and for clarity: added specialized cd_funcs for each entity type
2026-01-01 12:05:39 +01:00
jens 38b834c640 - added training params as list for model.train()
- added gaussian sample
- introduced layout concept
- updated README
2025-12-31 16:13:59 +01:00
jens 35e045a701 added label 2025-12-22 10:02:36 +01:00
jens 781870b971 add label encoder/decoder (not finished) 2025-12-21 20:20:24 +01:00
jens ff05c729e8 - refactored read_armadillo into matrix
- added test_norbs
2025-12-21 18:16:48 +01:00
jens 4bd5cffd6b - state load/save revised
- num gibbs samples is also part of entity
- working 3-layer deep test model
2025-12-21 17:34:11 +01:00
jens 22d189cf2f added model 2025-12-21 16:39:53 +01:00
jens 7668c73ea4 refactored 2025-12-21 10:33:04 +01:00
jens 8ed6488b45 refactored train 2025-12-21 10:16:08 +01:00
jens 7f4505c1f8 Raise exception if doSampleBatch == True 2025-12-20 20:21:42 +01:00
jens 61c762150c - removed Optimizer
- refactored training
- use static seed for random (for better comparison)
- simplified StackDeep.train
2025-12-20 20:12:19 +01:00
jens 5f5c7c6d77 Optimizer.train() shall ignore param.do_batch_sample 2025-12-19 17:29:32 +01:00
jens d3c9fe4681 - numGibbs no longer part of EntityParameter
- refactored forward and reconstruct
- conditionally use optimizer for training
2025-12-19 17:15:10 +01:00
jens a47922cb1c refactored 2025-12-19 15:20:04 +01:00
jens a9e67da43a refactored 2025-12-19 11:55:29 +01:00
jens 13a7cff094 layer: refactored xor() into test_xor.py 2025-12-19 11:39:55 +01:00
jens cadbb34d1a fixed imports 2025-12-19 11:10:16 +01:00
jens a60f802443 refactored 2025-12-18 21:32:01 +01:00
jens b206ab5788 Entity: refactored taining algo into train module 2025-12-18 21:23:16 +01:00
jens 6664ebdb9b added shape to entity 2025-12-18 19:47:27 +01:00
jens c1c6c610ad - wrap numpy and cupy in matrix as np
- added type alias Mat for np.ndarray
2025-12-18 18:14:03 +01:00
jens 9000e70607 - fixed training_remain
- added total rms error after training
2025-12-18 16:46:33 +01:00
jens 3936a5be27 fixed progress indication 2025-12-18 16:36:47 +01:00