Skip to content
#

phi

Here are 83 public repositories matching this topic...

High-Performance OpenAI LLM Service: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

  • Updated Feb 23, 2025
  • C++

Improve this page

Add a description, image, and links to the phi topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the phi topic, visit your repo's landing page and select "manage topics."

Learn more