Assembly instruction manual understanding by fusing natural language understanding and technical illustration understanding

摘要

This research aims to understand an assembly instruction manual by fusing the result obtained from understanding technical illustrations (TIU) and that obtained from understanding instructions (IU). In the first version of the system, we assume a TIU and an IU are carried out independently.