NEURAL MACHINE TRANSLATION APPARATUS AND METHOD OF OPERATION THEREOF BASED ON NEURAL NETWORK LEARNING USING CONSTRAINT STRENGTH CONTROL LAYER

摘要

Disclosed is an operation method of a neural network machine translation apparatus. The operation method of a neural network machine translation apparatus using a constraint influence control layer comprises the steps of: generating a first conceptual density vector for an original text; generating a second conceptual density vector for a translated text corresponding to the original text; determining a distance between the generated first conceptual density vector and the generated second conceptual density vector; determining a predicted text for the translated text based on the original text and determining a cross entropy of the determined predicted text and the translated text; and training a neural network based on a loss function obtained using the determined distance and the determined cross entropy, wherein the first conceptual density vector is obtained by performing affine transformation on the original text and the second conceptual density vector is obtained using the number of unique lexical tokens of the translated text and an embedding vector length.