Construction and Experimental Application of Large Data Platform in Colleges

摘要

This paper provides fully analysis to illustrate the potential and importance of big data technologies and its application, as well as the importance and necessity of building big data laboratory at colleges and universities. The paper also discusses the key aspects on building a big data technology laboratory with the open source big data framework and technologies, including Spark, Hadoop, Flink, Mesos, Kafka etc. The construction of platform infrastructure, lab team formation and development, students leaning and development bid data application in this platform also been discussed.