基于Hadoop的校园一卡通数据分析

摘要

This article found the hidden rules of students’ consumption behavior through the analysis on characteristics of the Campus IC Card consumption data. In this paper, the methods of data mining and statistical analysis are used to screen the raw data,in terms of two sides including different grades and different restaurants to considerate and study the consumption habits of different groups. Data processing means to adopt the MapReduce method under the Hadoop framework to get statistical results and visualize them after ifltering the keywords.%文章通过对校园一卡通消费数据特征进行分析，发现学生消费行为背后隐藏的规律。文章采用数据挖掘统计分析的方法对前期获取的原始数据进行筛选，从不同年级、不同就餐地点两个方面考虑，研究不同群体的消费习惯。数据处理是在Hadoop（分布式系统基础架构）框架下采用MapReduce（一种编程模型，映射和化简）方法，通过对关键字过滤之后得到统计结果并将其可视化。