Machine Learning Theory

Table of contents

1. Linear Regression and Logistic Classification
   1. Terms
   2. Initialization
   3. Optimizer
   4. Convolutional Neural Networks (CNN)
   5. Recurrent Neural Network (RNN)

---

This is the document written when I research the concept of Machine Learning.

Linear Regression and Logistic Classification

Terms

epoch, batch size

Initialization

• RBM (2006) -> Xavier
• DropOut (2014)
• Ensemble : Merge learning model

Optimizer

• gradient decent, adam and other optimizers

Convolutional Neural Networks (CNN)

• How to connect layers : Forward, Split & Merge, Recurrent Network(RNN)
• convolution, relu(2012), pooling, repeated.
• stride, convolution, sampling, padding, pooling

Recurrent Neural Network (RNN)

• Stacked RNN, Softmax
• Dynamic RNN
• Time Series RNN