Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用
-
Updated
Sep 5, 2024 - Python
#
pretraining
Here are 180 public repositories matching this topic...
Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
prompt chinese image-captioning pretrained-models visual-question-answering multimodal text-to-image-synthesis vision-language pretraining referring-expression-comprehension prompt-tuning
-
Updated
Apr 24, 2024 - Python
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
video chatbot dialogue pytorch transformer llama gpt alpaca visual-recognition multimodal huggingface pretraining gpt4 large-language-models chatgpt instruction-tuning gpt4-api mplug damo mplug-owl
-
Updated
Nov 27, 2024 - Python
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
machine-learning deep-learning graph-mining graph-neural-networks self-supervised-learning pre-training pretraining graph-self-supervised-learning
-
Updated
Feb 2, 2024 - Python
[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"
ssl deep-learning convnet cnn pytorch convolutional-neural-networks object-detection bert iclr mae instance-segmentation mask-rcnn sparse-convolution self-supervised-learning pre-trained-model pretrain pretraining masked-autoencoder masked-image-modeling iclr2023
-
Updated
Jan 23, 2024 - Python
Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
-
Updated
Aug 19, 2022
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
image-captioning video-captioning visual-question-answering vision-and-language cross-modal-retrieval pretraining tden
-
Updated
Feb 27, 2023 - Python
【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
-
Updated
Mar 25, 2024 - Python
Official Repository for the Uni-Mol Series Methods
-
Updated
Dec 26, 2024 - Python
Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper
mixer multi-label-classification downstream pretraining vision-transformer imagenet21k semantic-softmax single-label
-
Updated
Jan 11, 2023 - Python
EntitySeg Toolbox: Towards Open-World and High-Quality Image Segmentation
computer-vision deep-learning cnn pytorch segmentation object-detection pretrained-models image-segmentation semantic-segmentation pretrained-weights instance-segmentation panoptic-segmentation fcos pretraining detectron2 condinst
-
Updated
Nov 30, 2023 - Jupyter Notebook
Best practice for training LLaMA models in Megatron-LM
-
Updated
Jan 2, 2024 - Python
A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs, inspired by awesome-computer-vision, including papers, codes, and related websites
computer-vision robotics navigation benchmarks simulations manipulation scene-graph grasping nerf 3d pointclouds vlm diffusion-models pretraining policy-learning foundation-models llm vision-language-model gaussian-splatting
-
Updated
Nov 4, 2024
PITI: Pretraining is All You Need for Image-to-Image Translation
-
Updated
Jun 2, 2024 - Python
The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models
-
Updated
Nov 29, 2024 - Python
飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
benchmark cloud lightning elastic unsupervised-learning large-scale data-parallelism paddlepaddle model-parallelism distributed-algorithm self-supervised-learning pipeline-parallelism pretraining fleet-api paddlecloud
-
Updated
May 24, 2024 - Python
[ACL 2022] LinkBERT: A Knowledgeable Language Model 😎 Pretrained with Document Links
knowledge transformer question-answering pretrained-models language-model graph-machine-learning biomedical-applications pretraining
-
Updated
Apr 5, 2022 - Python
End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service
nlp pytorch tuning pretrained-models language-model bert azure-machine-learning finetuning bert-model pretraining azureml-bert
-
Updated
Jun 12, 2023 - Jupyter Notebook
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
fine-tuning pipeline-parallelism pretraining model-parallel deepspeed mllm multimodal-large-language-models qwen video-large-language-models video-language-model
-
Updated
Dec 9, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the pretraining topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the pretraining topic, visit your repo's landing page and select "manage topics."