昨天的結(jié)果中症歇，最好的效果是3層全連接：Train Accuracy:? 1.0，Test Accuracy:? 0.765
4層卷積網(wǎng)絡(luò)
隱藏層：2層卷積層+1層全連接層谭梗，輸出層：Softmax分類器
K = 4 #hindden1的卷積核數(shù)目
L = 8 #隱藏層2的卷積核數(shù)
N = 200 #全連接層的節(jié)點數(shù)
使用了學(xué)習(xí)率衰減：
max_lr = 0.003
min_lr = 0.0001
decay_speed = 2000.0
未使用Droupout忘晤。pkeep:1.0
iter = 800
All cost time:? 1519.3290100097656
Train Accuracy:? 1.0
Test Accuracy:? 0.805
使用卷機網(wǎng)絡(luò)耗時明顯增加
核數(shù)目稍微增多
K = 5 #hindden1的卷積核數(shù)目
L = 10
pkeep:1.0
終于，loss曲線有了很大的改觀
核數(shù)目減少
K = 3 #hindden1的卷積核數(shù)目
L = 5
All cost time:? 1459.0826830863953
Train Accuracy:? 1.0
Test Accuracy:? 0.84
K = 2 #hindden1的卷積核數(shù)目
L = 2
All cost time:? 1211.8775815963745
Train Accuracy:? 1.0
Test Accuracy:? 0.905
第一次上90%激捏！
將全連接層的節(jié)點數(shù)減少
K = 2 #hindden1的卷積核數(shù)目
L = 2 #隱藏層2的卷積核數(shù)
N = 100
All cost time:? 1124.0736384391785
Train Accuracy:? 1.0
Test Accuracy:? 0.76
N=500
All cost time:? 1369.4422793388367
Train Accuracy:? 1.0
Test Accuracy:? 0.765
N=180
All cost time:? 1144.1208844184875
Train Accuracy:? 1.0
Test Accuracy:? 0.95
終于设塔，這個95%還算不錯了
