设计模式检测工具有效性评估策略

摘要

To solve the unavailability of standard benchmarks and repeated development problem in design pattern detection tools,this paper discusses the limitations of various tools based on the analysis of existing design pattern tools, classifies the identification method, establishes the filtering rules, and proposes a method for effectiveness evaluation of design pattern detection tools.Focusing on standard benchmark,variant and instance sharing evalua-tion index,the experiment results show the effectiveness of the proposed method,which is compared to nine well-known tools of design pattern detection and eight open source systems by indexes. Finally, this paper summarizes the effectiveness threat of the evaluation work, gives the reasonable suggestions, and provides the perspective of evaluation of design pattern detection tools.%为解决传统设计模式检测工具比较基准缺乏及相似工具重复开发的问题,在分析现有设计模式工具检测结果基础上,按识别方法进行了分类,制订了参与检测工具的筛选规则,探讨了各种工具的局限性,提出了一种设计模式检测工具有效性评估方法.以设计模式实例基准、变体、参与者角色实例共享为主要评估指标,通过对8种检测工具及9种开源系统指标的交叉比较,验证了所提方法的有效性,总结了评估工作的有效性威胁,给出了合理性建议,为设计模式检测工具评估提供了一种新思路.