Movement situational awareness model learning device, movement situational awareness device, method, and program

摘要

To efficiently extract and combine information from both time series of image data and time series of sensor data and realize highly accurate movement state recognition with a small amount of training data.SOLUTION: A movement state recognition semi-supervised DNN model construction unit 42 is a DNN model for recognizing a movement state of a user and further constructs a DNN model for decoding time series of decoded image data and time series of decoded sensor data. A movement state recognition DNN model unsupervised learning unit 44 learns parameters of the DNN model so that the time series of the decoded image data and the time series of the decoded sensor data coincide with input data. A movement state recognition DNN supervised learning unit 46 learns the parameters of the DNN model so that a movement state recognized by the DNN model coincides with a movement state indicated by an annotation.SELECTED DRAWING: Figure 1