Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
×
Jun 8, 2020 · Abstract:We examine whether self-supervised language modeling applied to mathematical formulas enables logical reasoning.
We show that self-supervised training on mathematical formulas alone leads to logical reasoning capabilities. 2. We introduce a new skip-tree training task ...
Jan 12, 2021 · The main idea is to develop a skip-tree proxy task (self-supervision) for training the encoder-decoder architecture. The skip-tree method masks ...
Aug 12, 2020 · We introduce a new skip-tree language modeling task that outperforms skip-sequence approaches in our evaluation on the logical reasoning tasks.
It is found that models trained on the skip-tree task show surprisingly strong mathematical reasoning abilities, and outperform modelstrained on standard ...
People also ask
We examine whether self-supervised language modeling applied to mathematical formulas enables logical reasoning. Language Modelling · Logical Reasoning +1.
Apr 4, 2021 · MATHEMATICAL REASONING VIA SELF-SUPERVISED SKIP-TREE TRAINING [Rabe .. ... LIME: LEARNING INDUCTIVE BIAS FOR PRIMITIVES OF MATHEMATICAL REASONING ...
Rabe, Markus Norman, et al. Mathematical Reasoning via Self-Supervised Skip-Tree Training. 2020. paper. Wei, Jason, et al. Chain of Thought Prompting Elicits ...
ผู้เขียนร่วม ดูทั้งหมด ; Mathematical Reasoning via Self-supervised Skip-tree Training. MN Rabe, D Lee, K Bansal, C Szegedy. arXiv preprint arXiv:2006.04757, 2020. 56 ...
... Mathematical Reasoning via Self-supervised Skip-tree Training [PDF] by Markus N. Rabe, Dennis Lee, Kshitij Bansal, and Christian Szegedy. We are super ...