Skip to content

Outdated Endpoint URL in clients/python/README.md #775

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
4 tasks
kaushikacharya opened this issue May 29, 2025 · 0 comments
Open
4 tasks

Outdated Endpoint URL in clients/python/README.md #775

kaushikacharya opened this issue May 29, 2025 · 0 comments

Comments

@kaushikacharya
Copy link

System Info

In https://github.com/predibase/lorax/tree/main/clients/python#predibase-inference-endpoints
shouldn't the endpoint_url be updated?

Instead of
endpoint_url = f"https://api.app.predibase.com/v1/llms/{llm_deployment_name}"

shouldn't it be as mentioned in
https://loraexchange.ai/reference/python_client/#predibase-inference-endpoints

# You can get your Predibase API token by going to Settings > My Profile > Generate API Token
# You can get your Predibase Tenant short code by going to Settings > My Profile > Overview > Tenant ID
endpoint_url = f"https://serving.app.predibase.com/{predibase_tenant_short_code}/deployments/v2/llms/{llm_deployment_name}"

pypi release with this update would then reflect in https://pypi.org/project/lorax-client/

Information

  • Docker
  • The CLI directly

Tasks

  • An officially supported command
  • My own modifications

Reproduction

This is a README.md bug

Expected behavior

In clients/python/README.md (section: Predibase Inference Endpoints),
endpoint_url should be updated to

# You can get your Predibase API token by going to Settings > My Profile > Generate API Token
# You can get your Predibase Tenant short code by going to Settings > My Profile > Overview > Tenant ID
endpoint_url = f"https://serving.app.predibase.com/{predibase_tenant_short_code}/deployments/v2/llms/{llm_deployment_name}"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant