Method and device for detecting vehicle occupancy using passenger's keypoint detected through image analysis for humans' status recognition

摘要

A method for detecting a vehicle occupancy by using passenger keypoints based on analyzing an interior image of a vehicle is provided. The method includes steps of: (a) if the interior image is acquired, a vehicle occupancy detecting device (i) inputting the interior image into a feature extractor network, to generate feature tensors by applying convolution operation to the interior image, (ii) inputting the feature tensors into a keypoint heatmap & part affinity field (PAF) extractor, to generate keypoint heatmaps and PAFs, (iii) inputting the keypoint heatmaps and the PAFs into a keypoint detecting device, to extract keypoints from the keypoint heatmaps, and (iv) grouping the keypoints based on the PAFs, to detect keypoints per passengers; and (b) inputting the keypoints into a seat occupation matcher, to match the passengers with seats by referring to the inputted keypoints and preset ROIs for the seats and to detect the vehicle occupancy.