Annotating a Driving Experience Corpus with Behavior and Subjectivity

摘要

Personality is the important internal framework that we use when we communicate with the others; thus, it is critical for vehicle-driver communication. Evaluating an individual's personality requires associating behavior and subjectivity. To develop the vehicle-driver communication system that will be most applicable to actual driving settings, a corpus is necessary that includes colloquial and daily experiential expressions along with their emotions, polarity, and sentiments. In addition, the corpus must include a wide range of subjective measures, such as human judgements, perceptions, and cognitions during car driving. Thus, we construct a driving experience corpus (DEC) that constitutes 253 blog articles (7,831 sentences) with the following four manually annotated tags: (1) driving experience (DE), (2) other's behavior (OB), (3) self-behavior (SB) and (4) subjectivity (SJ). In this paper, we describe the guidelines, corpus specification and agreement analysis between annotators. We identified three difficulties: the extended self, important information, and voice in mind. We conducted automatic annotation experiment on the corpus using Conditional Random Fields (CRF). The results indicated F-Scores of .768, .478, .534, and .749 for DE, OB, SB, and SJ, respectively, on the test set. Our error analysis reveals difficulties in interpreting nominatives and recognizing facts.