#

vision-and-language

Here are 253 public repositories matching this topic...

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

deep-learning salesforce image-captioning deep-learning-library vision-framework vision-and-language multimodal-deep-learning multimodal-datasets vision-language-transformer vision-language-pretraining visual-question-anwsering

Updated Nov 18, 2024
Jupyter Notebook

aishwaryanr / awesome-generative-ai-guide

A one stop repository for generative AI research updates, interview resources, notebooks and much more!

awesome awesome-list interview-questions vision-and-language notebook-jupyter large-language-models llms generative-ai

Updated Nov 6, 2024

salesforce / ALBEF

Code for ALBEF: a new vision-language pre-training method

representation-learning weakly-supervised-learning image-text vision-and-language contrastive-learning

Updated Sep 20, 2022
Python

om-ai-lab / OmDet

Real-time and accurate open-vocabulary end-to-end object detection

object-detection vision-and-language zero-shot-object-detection open-vocabulary

Updated Sep 6, 2024
Python

open-mmlab / Multimodal-GPT

Multimodal-GPT

transformer llama gpt flamingo multimodal vision-and-language gpt-4

Updated Jun 4, 2023
Python

dandelin / ViLT

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

vision-and-language

Updated Apr 3, 2024
Python

roboflow / maestro

streamline the fine-tuning process for multimodal models: PaliGemma, Florence-2, and Qwen2-VL

transformers vqa objectdetection captioning fine-tuning multimodal vision-and-language phi-3-vision paligemma florence-2

Updated Nov 25, 2024
Python

om-ai-lab / OmAgent

A Multimodal Native Agent Framework for Smart Devices and More

agent workflow framework vision-and-language large-language-models smart-hardware multimodal-agent gpt-4o

Updated Nov 29, 2024
Python

NVlabs / prismer

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

vqa image-captioning language-model multi-task-learning vision-and-language multi-modal-learning vision-language-model

Updated Jan 17, 2024
Python

yuewang-cuhk / awesome-vision-language-pretraining-papers

Recent Advances in Vision and Language PreTrained Models (VL-PTMs)

bert vision-and-language multimodal-deep-learning pretraining vl-ptms

Updated Aug 19, 2022

Oscar

microsoft / Oscar

Oscar and VinVL

vqa image-captioning oscar vision-and-language pre-training image-text-search vinvl

Updated Aug 28, 2023
Python

YehLi / xmodaler

X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).

image-captioning video-captioning visual-question-answering vision-and-language cross-modal-retrieval pretraining tden

Updated Feb 27, 2023
Python

llm-jp / awesome-japanese-llm

日本語LLMまとめ - Overview of Japanese LLMs

japanese generative-model japanese-language language-models language-model generative-models multimodal vision-and-language vision-language foundation-models large-language-models llm llms generative-ai large-language-model vision-language-model japanese-llm japanese-language-model llm-japanese

Updated Nov 30, 2024
TypeScript

OFA-Sys / ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

representation-learning multimodal vision-and-language contrastive-loss vision-language vision-transformer foundation-models audio-language

Updated Oct 6, 2024
Python

rhymes-ai / Aria

Codebase for Aria - an Open Multimodal Native MoE

multimodal vision-and-language mixture-of-experts

Updated Nov 28, 2024
Jupyter Notebook

26hzhang / DL-NLP-Readings

My Reading Lists of Deep Learning and Natural Language Processing

machine-learning natural-language-processing reinforcement-learning deep-learning robotics paper language-model bibtex-references commonsense vision-and-language source-code-link

Updated Apr 30, 2022
TeX

mbzuai-oryx / groundingLMM

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

vision-and-language lmm foundation-models vision-language-model llm-agent

Updated Nov 23, 2024
Python

ChenRocks / UNITER

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

transformers pytorch vision-and-language pre-training

Updated Jun 30, 2021
Python

jackroos / VL-BERT

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

pytorch representation-learning bert vision-and-language self-supervised-learning pre-training iclr2020 vl-bert

Updated May 22, 2023
Jupyter Notebook

SunzeY / AlphaCLIP

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

machine-learning deep-learning vision-and-language vision-language vision-transformer vision-language-model

Updated Jul 30, 2024
Jupyter Notebook

Improve this page

Add a description, image, and links to the vision-and-language topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vision-and-language topic, visit your repo's landing page and select "manage topics."