1服鹅,進入spark shell
./spark-shell
2费就,執(zhí)行以下操作讀取parquet文件
val sqlContext = new org.apache.spark.sql.SQLContext(sc)
val parquetFile = sqlContext.parquetFile("/home/neunntest/hdfs/dataSet/2018-1-2/iris20180102_1514855343/*.parquet")
3棕叫,打印具體內(nèi)容
parquetFile.take(150).foreach(println)