This is a collection of papers and projects that interest me
==================================
---------------??? -------------------
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Efficient methods and hardware for deep learning(論文解析)
----- 量化? -------------------
IEEE 754,? fp16,fp32,fp64,int8,int4
----- Compressing and Pruning? -------------------
----- Matrix? -------------------
wiki:
Multiplication Algorithm
Matrix Multiplication Algorithm
divide and conquer algorithm, sub-cubic algorithm, strassen algorithm, coppersmith-winograd algorithm;
The Matrix Calculus You Need For Deep Learning
Matrix Computation(Golub)
----- Optimization? -------------------
Optimization Methods for Large-Scale Machine Learning (pdf)
GEMM(General matrix multiplication)
基本數(shù)學(xué)庫(kù):
Basic Linear Algebra Subprograms
----- 并行計(jì)算? -------------------
----- Baysian? -------------------
Novak,? Baysian deep convolutional networks with many channels are gaussian process
----- 統(tǒng)計(jì)學(xué)習(xí) ---------
(統(tǒng)計(jì)學(xué)習(xí)精要(The Elements of Statistical Learning)課堂筆記)
----- Net ---------
LENET-5, 1986, minist
AlexNet, 2012, ImagNet
GoogleNet, 2014
VGGNet, 2014
ResNet ( ResNet2015, Wide ResNet, ResNetX )
DenseNet, 2016
MobileNet, 2017
ShuffleNet, 2017
超分
SRCNN, FSRCNN, FSRCNN-s, ESPCN, VDSR
----- 強(qiáng)化學(xué)習(xí) ---------
----- 對(duì)抗學(xué)習(xí) ---------
----- 遷移學(xué)習(xí) ---------
(遷移學(xué)習(xí)簡(jiǎn)明手冊(cè))
----- 演化學(xué)習(xí) ---------
----- Tutorial and Survey ---------
Tutorial on Hardware Accelerators for Deep Neural Networks
-------------- Staffs --------------
fengbintu
===== 產(chǎn)業(yè)界 ===============
CPU, FPGA, DSP, GPU, ASIC
----- CUDA ---------
===== 應(yīng)用領(lǐng)域 ===============
----- 圖像分類 ---------
Image Classification
----- 目標(biāo)檢測(cè) ---------
Object Detection
----- 自然語(yǔ)言處理 ---------
Natural Language Processing
===== 基礎(chǔ)知識(shí) ===============
----- 機(jī)器學(xué)習(xí) ---------
吳恩達(dá) Ng
計(jì)算機(jī)視覺與卷積神經(jīng)網(wǎng)絡(luò)基礎(chǔ), standford cs231n
（Learning Semantic Image Representations at a Large scale）by Jia Yangqing
Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning(Sebastian Raschka)
----- CNN ---------
卷積 convolution
激活 activation function
池化 pooling
全聯(lián)接 Full connect / softmax
BP, backpropagation
目標(biāo)函數(shù)與梯度下降函數(shù)（BGD, SGD, RMSprop, Adam）簡(jiǎn)介1?
超參數(shù), 學(xué)習(xí)率,
范數(shù)規(guī)則化, 過擬合, Occam's razor, L0/L1/L2/nuclear norm
Low Rank
魯棒PCA(robust pca), 背景建模推盛，變換不變低秩紋理TILT
