Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

running in developer mode instructions #8563

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

CakeCrusher
Copy link
Contributor

Title

Run litellm in developer mode

Relevant issues

NA

Type

📖 Documentation
🚄 Infrastructure

Changes

  • expose db service
  • documentation on managing prisma db from dev

Copy link

vercel bot commented Feb 15, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 15, 2025 7:55pm

@CakeCrusher CakeCrusher changed the title Cake crusher/developer mode developer instructions Feb 15, 2025
@CakeCrusher CakeCrusher changed the title developer instructions running in developer mode instructions Feb 15, 2025
@@ -457,6 +457,9 @@ If you have suggestions on how to improve the code quality feel free to open an
### Services
1. Setup .env file in root
2. Run dependant services `docker-compose up db prometheus`
3. Install prisma `npm install -g prisma`
4. Run `prisma generate` to generate the prisma client
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there shouldn't be a need to manually run this - we run this automatically as part of the proxy_cli.py script

@CakeCrusher
Copy link
Contributor Author

@krrishdholakia
I see, wasn't familiar with this file the only problem though even with the --debug flag is that it does not reload on changes.

The purpose of the developer mode instructions is for people who may want to quickly iterate on LiteLLM source code.

I think the best solution for this is to add a --dev flag handler on proxy_cli.py which would enable hot reloading among other useful features for developers.

PS: How do you guys go about developing on LiteLLM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants