Geometric algebra based recurrent neural network for multi-dimensional time-series prediction

Published on December 22, 2022

Imagine you’re trying to understand a complex web of relationships. You can tackle it two ways: by studying each piece in isolation or by considering the connections between them. The same principle applies to multi-dimensional time-series (MTS) prediction. Traditional models treat each dimension independently, losing the inter-relationship and vital information. But fear not! A team of scientists has developed a groundbreaking solution: GA-LSTNet, a network based on geometric algebra (GA), which captures the inherent structures and correlations among dimensions. By using GA multi-vectors, they can holistically process MTS without sacrificing the inter-relationships. This approach elevates LSTM and back-propagation through time to the GA domain. The researchers put GA-LSTNet to the test against six other methods using four renowned MTS datasets. With unmatched prediction accuracy, GA-LSTNet outperforms traditional models, triumphantly addressing the shortcomings in MTS prediction. Ready to dive deeper into this revolutionary breakthrough? Read the full article now!

Recent RNN models deal with various dimensions of MTS as independent channels, which may lead to the loss of dependencies between different dimensions or the loss of associated information between each dimension and the global. To process MTS in a holistic way without losing the inter-relationship among dimensions, this paper proposes a novel Long-and Short-term Time-series network based on geometric algebra (GA), dubbed GA-LSTNet. Specifically, taking advantage of GA, multi-dimensional data at each time point of MTS is represented as GA multi-vectors to capture the inherent structures and preserve the correlation of those dimensions. In particular, traditional real-valued RNN, real-valued LSTM, and the back-propagation through time are extended to the GA domain. We evaluate the performance of the proposed GA-LSTNet model in prediction tasks on four well-known MTS datasets, and compared the prediction performance with other six methods. The experimental results indicate that our GA-LSTNet model outperforms traditional real-valued LSTNet with higher prediction accuracy, providing a more accurate solution for the existing shortcomings of MTS prediction models.

Read Full Article (External Site)

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes:

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>