mathstodon.xyz is one of the many independent Mastodon servers you can use to participate in the fediverse.
A Mastodon instance for maths people. We have LaTeX rendering in the web interface!

Server stats:

2.8K
active users

#riemannian

0 posts0 participants0 posts today
Continued thread

#Language #models. For example, in #NLP, when #training
recurrent #neural #networks, it is useful to constraint the transition #matrix to be #unitary (Arjovsky et al., 2015). The unitary
matrix keeps the #gradient #norm unchanged, and the network
is able to learn long-range dependencies. Unitary matrices
form a #smooth #Riemannian #manifold, and Riemannian #optimization can be easily applied to them.
arxiv.org/pdf/2005.02819

Geodesic Clustering in Deep Generative Models
arxiv.org/abs/1809.04747