Xavier initialization1

• 

  Xavier initialization Information Xavier initialization, also known as Glorot initialization, is a weight initialization technique used in neural networks. The main goal of Xavier initialization is to set the initial weights of the network in such a way that the variance of the outputs of each layer is approximately equal to the variance of its inputs. The initialization is performed by randomly initializing the weig.. Zettelkasten/Terminology Information 2023. 2. 28.