Official repository for the paper Number Cookbook: Number Understanding of Language Models and How to Improve It.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

SC23 Deep Learning at Scale Tutorial Material

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

A template repo for Python packages

Implementation of DiffWave and SaShiMi audio generation models

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

The Abstraction and Reasoning Corpus

The largest KG for material science

Rendered math (MathJax) with Slack's desktop client

Transfer learning for Mutation Effect Prediction

Extracting spatial and temporal world models from LLMs

BuildStockQuery is a python library for querying datasets generated by ResStock™ and ComStock™.

A Library for Advanced Deep Time Series Models.

Train transformer language models with reinforcement learning.

Reference implementations of MLPerf™ training benchmarks

Reference implementations of MLPerf™ training benchmarks

Python version of the amazing Reaction Mechanism Generator (RMG).