There might be some ascii image libraries. Matrex library has a ascii heat maps function you could copy. I think there are some tools for ImageMagick but don’t know if they’d support bitmaps to images. There’s gnuplot wrapper too.
elcritch
sym_num
sym_num
sym_num
I have added code to check the gradient confirmation. I am checking whether the function of CNN is correct. The goal is to be able to recognize images with CIFAR10. If you have any advice, thank you.
2
sym_num
I am verifying the operation of CNN. Many bugs have been fixed and now it is more stable than before. However, DP2 still can’t learn CIFAR10 well. I am still checking the gradient calculation.
3
sym_num
DP2 has learned for MNIST, 28 * 28 image data.
The notation of convolution of neural network means the following.
e.g. f (5, 5, 1, 12, 1, 1, 0.5, 0.0001)
Filter size 5 * 5
Input channel 1
Output channel 12
Stride 1
padding 1
rate to multiply initial random number 0.5
Learning rate 0.0001
CNN test for MNIST
defnetwork init_network4(_x) do
_x
|> f(5, 5, 1, 12, 1, 1, 0.5, 0.0001)
|> pooling(2)
|> f(3, 3, 12, 12, 1, 1, 0.5, 0.0001)
|> f(2, 2, 12, 12, 1, 1, 0.5, 0.0001)
|> pooling(2)
|> f(3, 3, 12, 12, 1, 0, 0.5, 0.0001)
|> relu
|> full
|> w(300, 10, 0.1, 0.001)
|> softmax
end
iex(1)> Test.cnn(100,100)
preparing data
learning start
100 13.068114280700684
99 13.220925331115723
98 12.160013198852539
97 12.39694595336914
96 12.35841178894043
95 9.357890129089355
94 10.0624361038208
…
6 6.846850395202637
5 7.928662300109863
4 8.563251495361328
3 6.413776874542236
2 6.471324920654297
1 8.531964302062988
learning end
accuracy rate = 0.398
“time: 47.943411 second”
“-------------”
:ok
I have the code for CIFAR10 in the cifar.ex file. But so far DP2 is not well learned. If you have any advice, thank you.
3
sym_num
A bug was found in convolution. I have fixed a bug and I am testing on CIFAR10. The GPU of my machine is GTX960. It takes 8 and a half hours to learn 20 epochs of 10,000 data in CIFAR10. I am looking for the proper hyperparameters. I would appreciate it if you could help with the test.
1
sym_num
In CIFAR’s code it is by SGD method. I presume that there is stagnation due to saddle points. I am improving by the Momentum method.
1
kip
ex_cldr Core Team
I only understand about 1% of what you are doing but I think this work is incredibly valuable to the community. Please keep going!
4