Neural Network Tutorials - Herong's Tutorial Examples

http://www.herongyang.com/Neural-Network

© 2020 Dr. Herong Yang. All rights reserved.

Linux IT Operation This book is a collection of notes and sample codes written by the author while he was learning Neural Networks in Machine Learning. Topics include Neural Networks (NN) concepts: nodes, layers, activation functions, learning rates, training sets, etc.; deep playground for classical neural networks; building neural networks with Python; walking through Tariq Rashi's 'Make Your Own Neural Network' source code; using 'TensorFlow' and 'PyTorch' machine learning platforms; understanding CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), GNN (Graph Neural Network). Updated in 2020 (Version 1.20) with Deep Playground tutorials.

Table of Contents

About This Book

Deep Playground for Classical Neural Networks

What Is Deep Playground

Simple Model in Playground

Impact of Extra Input Features

Impact of Additional Hidden Layers and Neurons

Complex Model in Playground

Impact of Training Set Size

Impact of Neural Network Configuration

Impact of Learning Rate

Impact of Activation Functions

Building Neural Networks with Python

Python Environment on macOS

NumPy - Python Library for Matrix operations

SciPy - Python Library for Mathematical Functions

Simple Example of Neural Networks

What Is The MNIST Database

"Make Your Own Neural Network" in Python

Walk-Through on Tariq's Code

TensorFlow - Machine Learning Platform

What Is TensorFlow

"tensorflow" - TensorFlow Python Library

"tensorflow" Interactive Test Web Page

Tensor and Tensor Flow Graph

Tensor Operation Properties

TensorFlow Session Class and run() Function

TensorFlow Variable Class and load() Function

Linear Regression with TensorFlow

tensorflow.examples.tutorials.mnist Module

Simple TensorFlow Model on MNIST Database

Commonly Used TensorFlow Funcitons

PyTorch - Machine Learning Platform

What Is PyTorch

Install PyTorch Library

Commonly Used 'torch' Funcitons

CNN (Convolutional Neural Network)

What Is CNN (Convolutional Neural Network)

What Is Convolutional Layer

What Is Pooling Layer

RNN (Recurrent Neural Network)

What Is RNN (Recurrent Neural Network)

RNN Recursive Function

What Is LSTM (Long Short-Term Memory)

What Is GRU (Gated Recurrent Unit)

GNN (Graph Neural Network)

References

Full Version in PDF/EPUB

Keywords: Neural Network, Machine Learning, Artificial Intelligence