project checklist
frame the problem
select a performance measure
RMSE:均方誤差根
MAE: 平均絕對誤差
范數(shù)越大對大特征值更有效赋访，會忽略小特征值惠呼，但數(shù)據正態(tài)分布時，RSEM性能更好搂妻。
Download and load the data
Take a quick look at the data strucure
data.head()
data.info()
data[‘attribute’].value_counts()
data.describe()
也可以畫直方圖來了解各個數(shù)字型屬性的分布
data.hist(bins = 50,figsize=(20,15))
create a test set
random select
from sklearn.model_selection import train_test_split
train_set,test_set = train_test_split(data,test_size = 0.2, random_state = 42)
stratified sampling通過對分組屬性進行分層采樣劃分
from sklearn.model_selection import StratifiedShuffleSplit
spliter = StratifiedShuffleSplit(n_splits = 1,test_size = 0.2,random_state = 42)
for train_index,test_index in spliter.split(data,data[‘category’]):
strat_train_set = data.loc[train_index]
start_test_set = data.loc[test_index]
exploring the data:discover and visualize the data to gain insights
visualizing geographical data
housing.plot(kind = ’scatter’,x= ‘longitude’,y = ‘latitude’ ,alpha = 0.4,s = housing[‘population’]/100,label = ‘population’,c = “median_house_value”,camp = plt.get_cmap(“jet”),colorbar = Ture)
plt.legend()
looking for correlations
corr_mattix = housing.corr()
