Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

Redset is a dataset containing three months worth of user query metadata that ran on a selected sample of instances in the Amazon Redshift fleet. We provide query metadata for 200 provisioned and s…

A playbook for systematically maximizing the performance of deep learning models.

Unified Training of Universal Time Series Forecasting Transformers

Chronos: Pretrained (Language) Models for Probabilistic Time Series Forecasting

An extremely fast Python package and project manager, written in Rust.

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Large-scale pretraining and benchmarking for short-term load forecasting.

Friends don't let friends make certain types of data visualization - What are they and why are they bad.

A Software Framework for Neuromorphic Computing

A build-it-yourself AutoML Framework

Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems

Large scale and asynchronous Hyperparameter and Architecture Optimization at your fingertips.

OpenML AutoML Benchmarking Framework

Lightning ⚡️ fast forecasting with statistical and econometric models.

Time-series machine learning at scale. Built with Polars for embarrassingly parallel feature extraction and forecasts on panel data.

Dataset and modelling infrastructure for modelling "event streams": sequences of continuous time, multivariate events with complex internal dependencies.

Methods for online conformal prediction.

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

A Library for Uncertainty Quantification.

A scikit-learn-compatible module to estimate prediction intervals and control risks based on conformal predictions.

Hackable and optimized Transformers building blocks, supporting a composable construction.

Lightweight, useful implementation of conformal prediction on real data.

A latent text-to-image diffusion model

Fast and Accurate ML in 3 Lines of Code

Extended functionality for univariate probability distributions in PyTorch

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

Paper lists for Temporal Point Process