Keras: Difference between revisions

From Hegemon Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(One intermediate revision by the same user not shown)
Line 7: Line 7:


=General=
=General=
[http://picard.github.keplr.io/ Picard] - "Picard lets you easily declare large spaces of (keras) neural networks and run (hyperopt) optimization experiments on them."
[http://ankivil.com/kaggle-first-steps-with-julia-chars74k-first-place-using-convolutional-neural-networks/ Some Imageaugmentation info on Kaggle]

[http://ankivil.com/kaggle-first-steps-with-julia-chars74k-first-place-using-convolutional-neural-networks/ Some Image Augmentation info on Kaggle]


[http://online.cambridgecoding.com/notebooks/cca_admin/neural-networks-tuning-techniques Deep learning for complete beginners: neural network fine-tuning techniques by Cambridge Coding Academy]
[http://online.cambridgecoding.com/notebooks/cca_admin/neural-networks-tuning-techniques Deep learning for complete beginners: neural network fine-tuning techniques by Cambridge Coding Academy]

<strike>Look into using PRELU ELU, etc...</strike>
<strike>Look into using PRELU ELU, etc...</strike>
Look into [https://github.com/fchollet/keras/pull/2887 MPELU]
Look into [https://github.com/fchollet/keras/pull/2887 MPELU]
Line 26: Line 29:


[https://github.com/fchollet/deep-learning-models Pretrained Models]
[https://github.com/fchollet/deep-learning-models Pretrained Models]

==Visualizing==
[https://blog.keras.io/how-convolutional-neural-networks-see-the-world.html how-convolutional-neural-networks-see-the-world]
[http://ankivil.com/visualizing-deep-neural-networks-classes-and-features/ visualizing-deep-neural-networks-classes-and-features]


=RNN=
=RNN=

Latest revision as of 10:57, 9 February 2017

Keras Callbacks how-can-i-interrupt-training-when-the-validation-loss-isnt-decreasing-anymore

Embeddings

fast.ai

General[edit | edit source]

Picard - "Picard lets you easily declare large spaces of (keras) neural networks and run (hyperopt) optimization experiments on them."

Some Image Augmentation info on Kaggle

Deep learning for complete beginners: neural network fine-tuning techniques by Cambridge Coding Academy

Look into using PRELU ELU, etc... Look into MPELU

keras.io/applications/ - Inbuilt pre-trained Models.

keras.io/getting-started/sequential-model-guide/ - Sequential Model Guide. Shows examples!

predict_on_batch(self, x)
fit_generator(self, generator, samples_per_epoch, nb_epoch, verbose=1, callbacks=None, validation_data=None, nb_val_samples=None, class_weight=None, max_q_size=10, nb_worker=1, pickle_safe=False, initial_epoch=0)

Paper with Overview of loss/optimisation functions

Keras Tutorial

Pretrained Models

Visualizing[edit | edit source]

how-convolutional-neural-networks-see-the-world visualizing-deep-neural-networks-classes-and-features

RNN[edit | edit source]

Dimension mismatch in LSTM - Your input should be in this format (sequences, timesteps, dimensions). So based on your example, your input should be in (None, 8, 2). Your input now is (8,2).

Building Autoencoders in Keras - Includes LTSM!!!, Also shows a webserver graph showing progress. How to make a 2d graph. And how to interpolate between numbers...

Help: 'Wrong number of dimensions: expected 3, got 2 with shape (...)

cs231n-CNNs 10 - Recurrent Nerual Networks Lecture

Time Series Prediction with LSTMs

This guys ipython notebook

contextwindow function

Keras Sequence Preprocessing - keras.preprocessing.sequence.pad_sequences

Using Keras LSTM RNN for variable length sequence prediction - Recomends either zero-padding or batches of 1...

Good? - Specifically talks about sliding window. Alice in wonderland.

GANs[edit | edit source]

GANS

Font Aliasing[edit | edit source]

Can a CNN be trained to alias font glyphs. Can it work with 3D rotations?