jens and Claude Sonnet 4.6
07e430f109
[cd_gaussian_binary] - fix negative phase: remove spurious noise, sample hidden states
...
In cd_gaussian_binary, two CD formulation bugs:
1. Gaussian noise was incorrectly added to data_neg before computing h_probs_neg
2. Negative visible reconstruction used h_probs_pos (soft probabilities) instead
of sampled binary hidden states, biasing the fantasy particle toward the mean
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-05-30 14:36:18 +02:00
jens and Claude Sonnet 4.6
95be9dd632
[conv2d] - add 2D convolution function and test
...
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-05-29 10:11:11 +02:00
jens
92afc16137
[SubImage]
...
- handle different image shapes
2026-01-11 11:21:42 +01:00
jens
be64b0f8ce
refactored
2026-01-10 16:46:27 +01:00
jens
1722a68b2a
[entity]
...
- refactored training parameters for grad_compute()
- added l1-norm
- improved tests
2026-01-10 15:21:40 +01:00
jens
f7e3693f45
- added image module with sub image and normalize
...
- improved tests
2026-01-10 14:12:29 +01:00
jens
f1aae9b0f1
[train]
...
- reset grad at start of epoch
[state]
- init(): set default parameter mu=0
2026-01-10 10:19:30 +01:00
jens
4c939cab8b
cd_gaussian_binary: no sampling of training data
2026-01-09 15:28:06 +01:00
jens
9025f54434
simplified EntityParams.from_dict
2026-01-06 21:49:35 +01:00
jens
e7b287e632
- simplified TrainingParams.from_dict
...
- fixed test_rbm
2026-01-06 21:48:09 +01:00
jens
226453c7ae
fixed status indention
2026-01-06 21:06:11 +01:00
jens
7d3ab02e26
fixed dividing l2-norm by length of vector
2026-01-06 18:17:45 +01:00
jens
542b8ae9b0
added L2-Regulation
2026-01-06 18:00:26 +01:00
jens
ff6254a15d
- Status has entity paarmeter
...
- train provides entity parameter to Status
2026-01-06 11:29:47 +01:00
jens
ec5d259ff7
Entity: added property enable training
2026-01-06 09:44:29 +01:00
jens
74138b5514
train: swapped epochs and mini-batch loop
2026-01-05 20:53:31 +01:00
jens
d238d2954e
grad_compute(): pre-multiply weight decay with learning rate
2026-01-05 19:40:05 +01:00
jens
fdf4186d6b
significantly improved GB-RBM training
2026-01-05 14:16:34 +01:00
jens
9f72c1f253
- added cifar_test as jupiter lab
...
- started torch version of RBM
- enable CUDA in matrix
2026-01-04 18:30:01 +01:00
jens
6546c37657
train: fixed gaussian sampling
2026-01-03 19:30:47 +01:00
jens
529252166a
train: sample gaussian visible units
2026-01-03 12:40:08 +01:00
jens
94595ddd8a
train: added cd_binary_gaussian
2026-01-03 12:10:17 +01:00
jens
082bb3c566
Label: added OneHote encoding
2026-01-02 22:49:00 +01:00
jens
2e714685d1
model: forward() is not abstract method
2026-01-02 19:42:22 +01:00
jens
10691894d1
- training params are (again) attrubute of Entity
...
- ditched layout concept
2026-01-02 14:51:19 +01:00
jens
8b97350564
cd_binary_binary: added gibbs sampling
2026-01-01 20:02:22 +01:00
jens
e67207504b
fixed cd_binary_binary
2026-01-01 15:55:35 +01:00
jens
dc998d30a2
- initroduced types: BB-RBM GB-RBM, GG-RBM as property of entity
...
- training simplification and for clarity: added specialized cd_funcs for each entity type
2026-01-01 12:05:39 +01:00
jens
38b834c640
- added training params as list for model.train()
...
- added gaussian sample
- introduced layout concept
- updated README
2025-12-31 16:13:59 +01:00
jens
35e045a701
added label
2025-12-22 10:02:36 +01:00
jens
781870b971
add label encoder/decoder (not finished)
2025-12-21 20:20:24 +01:00
jens
ff05c729e8
- refactored read_armadillo into matrix
...
- added test_norbs
2025-12-21 18:16:48 +01:00
jens
4bd5cffd6b
- state load/save revised
...
- num gibbs samples is also part of entity
- working 3-layer deep test model
2025-12-21 17:34:11 +01:00
jens
22d189cf2f
added model
2025-12-21 16:39:53 +01:00
jens
7668c73ea4
refactored
2025-12-21 10:33:04 +01:00
jens
8ed6488b45
refactored train
2025-12-21 10:16:08 +01:00
jens
7f4505c1f8
Raise exception if doSampleBatch == True
2025-12-20 20:21:42 +01:00
jens
61c762150c
- removed Optimizer
...
- refactored training
- use static seed for random (for better comparison)
- simplified StackDeep.train
2025-12-20 20:12:19 +01:00
jens
5f5c7c6d77
Optimizer.train() shall ignore param.do_batch_sample
2025-12-19 17:29:32 +01:00
jens
d3c9fe4681
- numGibbs no longer part of EntityParameter
...
- refactored forward and reconstruct
- conditionally use optimizer for training
2025-12-19 17:15:10 +01:00
jens
a47922cb1c
refactored
2025-12-19 15:20:04 +01:00
jens
a9e67da43a
refactored
2025-12-19 11:55:29 +01:00
jens
13a7cff094
layer: refactored xor() into test_xor.py
2025-12-19 11:39:55 +01:00
jens
cadbb34d1a
fixed imports
2025-12-19 11:10:16 +01:00
jens
a60f802443
refactored
2025-12-18 21:32:01 +01:00
jens
b206ab5788
Entity: refactored taining algo into train module
2025-12-18 21:23:16 +01:00
jens
6664ebdb9b
added shape to entity
2025-12-18 19:47:27 +01:00
jens
c1c6c610ad
- wrap numpy and cupy in matrix as np
...
- added type alias Mat for np.ndarray
2025-12-18 18:14:03 +01:00
jens
9000e70607
- fixed training_remain
...
- added total rms error after training
2025-12-18 16:46:33 +01:00
jens
3936a5be27
fixed progress indication
2025-12-18 16:36:47 +01:00