METHOD OF VISUAL VOICE RECOGNITION BY FOLLOWING-UP THE LOCAL DEFORMATIONS OF A SET OF POINTS OF INTEREST OF THE SPEAKER'S MOUTH

摘要

The method comprises steps of: a) for each point of interest of each image, calculating a local gradient descriptor and a local movement descriptor; b) forming microstructures of n points of interest, each defined by a tuple of order n, with n≧1; c) determining, for each tuple of a vector of structured visual characteristics (d₀ . . . d₃ . . . ) based on the local descriptors; d) for each tuple, mapping this vector by a classification algorithm selecting a single codeword among a set of codewords forming a codebook (CB); e) generating an ordered time series of the codewords (a₀ . . . a₃ . . . ) for the successive images of the video sequence; and f) measuring, by means of a function of the String Kernel type, the similarity of the time series of codewords with another time series of codewords coming from another speaker.