DECODER FOR DECODING WEIGHT PARAMETERS OF A NEURAL NETWORK, ENCODER, METHODS AND ENCODED REPRESENTATION USING PROBABILITY ESTIMATION PARAMETERS

摘要

Embodiments according to the invention comprise a decoder for decoding weight Parameters of a neural network, wherein the decoder is configured to obtain a plurality of neural network Parameters, e.g., at least one of entries w, of matrix W, b, μ, σ2, σ, γ, and/or β, of the neural network on the basis of an encoded bitstream. Furthermore, the decoder is configured to decode the neural network Parameters of the neural network, e.g., a quantized Version of the neural network Parameters, using a context-dependent arithmetic decoding, e.g., using a context-adaptive binary arithmetic decoding (CABAC). Optionally, probabilities of bin values may be determined for different contexts, wherein, for example, each bin is associated with a context. Moreover, the decoder is configured to obtain a probability estimate, which may, for example, be associated with a context, for a, e.g. arithmetic, decoding of a bin of a number representation of a neural network parameter, e.g. on the basis of one or more previously decoded neural network Parameters or bins thereof, using one or more probability estimation Parameters. In addition, the decoder is configured to use different probability estimation Parameter values for a decoding of different neural network Parameters and/or to use different probability estimation parameter values for a decoding of bins associated with different context models. Further embodiments comprise a decoder configured to use different probability estimation parameter values for a decoding of neural network Parameters associated with different layers of the neural network. Corresponding encoders, methods and encoded representations are also disclosed.