Academia.edu no longer supports Internet Explorer.
To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to upgrade your browser.
2019, Historisk tidskrift (S) 139:4 (2019), pp. 818-820
http://www.historisktidskrift.se/fulltext/2019-4/HT_2019_4_811-831_kortrecensioner.htm
Natural Language Processing Journal Volume 7
Enabling action crossmodality for a pretrained large language model2024 •
Natural language processing and vision tasks have recently seen large improvements through the rise of Transformer architectures. The high-performing large language models (LLMs) benefit from large textual datasets that are numerously available online. However, action and bidirectional action-language tasks are less developed, as these require more specific and labeled data. Therefore, we aim at enabling these robotic action capabilities for a pretrained LLM, while maintaining high efficiency with regards to the required training time and data size. To achieve this, we split up a Transformer-based LLM and insert a multimodal architecture into it. Specifically, we split a pretrained T5 LLM between its encoder and decoder parts, to insert a crossmodal Transformer component of a Paired Transformed Autoencoders (PTAE) bidirectional action-language model. The experiments are conducted on a new dataset, consisting of unimodal language translation and crossmodal bidirectional action-language translation. The natural language capabilities of the original T5 are re-established efficiently by training the crossmodal Transformer, which requires only one 5.7 millionth of the T5 model's original training data. Furthermore, the new model, called CrossT5, achieves high accuracy for the vision-and language-guided robotic action tasks. By design, the CrossT5 agent acts robustly when tested with language commands not included in the dataset. The results demonstrate that this novel approach is successful in combining the advanced linguistic capabilities of LLMs with the low-level robotic control skills of vision-action models. The code is available at this URL: https://github.com/samsoneko/CrossT5.
Lecture given at the workshop "Ancient Egyptian Geography between Fiction and Reality" held at the University of Tübigen on 21 May 2024.
edition pro mundis
The Right to Life for Every Person | Lebensrecht für jeden Menschen2000 •
Abtreibung – Euthanasie – Gentechnik: Lebensrecht für jeden Menschen / The Right to Life for every PersonDas Lebensrecht von Menschen am Anfang und am Ende des Lebens gerät europaweit zunehmend in Gefahr. Der Band enthält die Vorträge und Diskussionsbeiträge von Politikern, Ethikern, Juristen und Ärzten, sowie die Vorschläge zur engeren Zusammenarbeit von etwa 100 Lebensrechtsgruppen von Litauen bis Spanien, die sich zum ersten Mal in der Geschichte zu einer spannenden Beurteilung aktueller Konflikte von Ethik und Wissenschaft zusammenfanden.
The Books' Journal
Ιωάννης Ε. Κωτούλας, Η ισλαμιστική τρομοκρατία και η Δύση [book review]2024 •
Ο τόμος Ο κόσμος και η απειλή της τρομοκρατίας μετά την 11η Σεπτεμβρίου (Πεδίο, 2023), υπό την επιμέλεια του Ανδρέα Γκόφα, αποτελεί μία πρωτότυπη και άκρως επίκαιρη συνεισφορά στην μελέτη του φαινομένου της τρομοκρατίας, με την αξιοποίηση της αρχής της διεπιστημονικότητας και διαθεματικότητας. Ο τόμος προσφέρει στον αναγνώστη μία πλήρη επισκόπηση της διεθνούς βιβλιογραφικής έρευνας για την τρομοκρατία, ιστορική και εννοιολογική ανάλυση της τρομοκρατίας ως εσωτερικού και διεθνούς φαινομένου και πολλαπλές πρωτότυπες οπτικές βάσει της αρχής της διεπιστημονικότητας.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.
South African Medical Journal
A prospective study of stroke sub-type from within an incident population in Tanzania2011 •
Journal of Biomolecular Structure & Dynamics
Biospectroscopic analysis of human breast cancer tissue: probing infrared signatures to comprehend biochemical alterations2017 •
2021 •
Tanzanian Economic Review
Determinants of Per Capita Alcohol Consumption in Africa: A Cross-section Approach2023 •
Legal Pluralism and Critical Social Analysis
Cultural Expertise, Hate Speech, and the Far Right: The Slovak Mazurek Case2024 •
Sri Lankan Journal of Infectious Diseases
Salmonella paratyphi: A rare cause for infective spondylitis and psoas abscess2013 •