Aug 1, 2021 · In this work, we propose a syntax-aware local attention (SLA) which is adaptable to several tasks, and integrate it with BERT (Devlin et al., ...

Dec 30, 2020 · In this paper, we propose a syntax-aware local attention, where the attention scopes are restrained based on the distances in the syntactic ...

The proposed syntax-aware local attention can be integrated with pretrained language models, such as BERT, to render the model to focus on syntactically ...

Dec 30, 2020 · This work probes BERT based language models trained on spoken transcripts to investigate its ability to understand multifarious properties in absence of any ...

Jan 1, 2021 · In this paper, we propose a syntax-aware local attention, where the attention scopes are restrained based on the distances in the syntactic ...

We propose an efficient BERT-based neural network model with local context comprehension (BERT-LCC) for multi-turn response selection.

Improving BERT with syntax-aware local attention. arXiv preprint. arXiv:2012.15150 (2020). ACM Trans. Asian Low-Resour. Lang. Inf. Process. Page 16. 16 ...

Cao, “Improving BERT with Syntax-aware Local At- tention,” Findings of the Association for Computational. Linguistics: ACL-IJCNLP 2021, 2021. [12] Emma ...

Oct 9, 2024 · To address the problems above, we propose a Dual Syntax aware Graph attention networks with Prompt (DSGP) framework. First, DSGP uses a BERT ...

One way to increase an LLM's awareness of syntactic structure is by adding local syntactic attention [see ... Li, et al., Improving BERT with syntax-aware local ...