神經(jīng)網(wǎng)絡基礎
1氛改,神經(jīng)元(Neuron)
2,權重(Weights)
3乘碑,偏差(Bias)
4检碗,激活函數(shù)(Activation Function)
常用激活函數(shù):Sigmoid据块,ReLU(整流線性單位)码邻,Softmax
5折剃,神經(jīng)網(wǎng)絡
6,輸入像屋、輸出怕犁、隱藏層
7,MLP(多層感知器)
8己莺,正向傳播(Forword Propagation)
9奏甫,成本函數(shù)(Cost Function)
10,梯度下降(Gradient Descent)
11凌受,學習率(Learning Rate)
12阵子,反向傳播(Back Propagation)
13,批次(Batches)
14胜蛉,周期(Epochs)
15挠进,丟棄(Dropout)
16,批量歸一化(Batch Normalization)
卷積神經(jīng)網(wǎng)絡
17誊册,濾波器(Filters)
18领突,卷積神經(jīng)網(wǎng)絡(CNN)
19,池化(Pooling)
20案怯,填充(Padding)
21君旦,數(shù)據(jù)增強(Data Augmentation)
循環(huán)神經(jīng)網(wǎng)絡
22,循環(huán)神經(jīng)元(Recurrent Neuron)
23嘲碱,循環(huán)神經(jīng)網(wǎng)絡(RNN)
24金砍,消失梯度問題(Vanishing Gradient Problem)
25,激增梯度問題(Exploding Gradient Problem)
參考: 深度學習入門必須理解這25個概念