Verta
Search…
Latest
Overview
Experiment Management
Catalog
Deployment
Quickstart
Concepts
Guides
Creating and retrieving an endpoint
Model deployment
Creating custom models
Creating custom models with dependencies
Updating endpoints with canary
Endpoint autoscaling
Endpoint resources
Endpoint environment variables
Updating endpoint with a configuration file
Querying an endpoint
Exporting metrics for an endpoint
Model deployment with Kafka
Securing endpoints
Monitoring
Collaboration
Tutorials
Administration
Examples
Resources
API Reference
Python
CLI
Powered By GitBook
Endpoint resources
Through an endpoint update, you can configure the limits for compute resources available to the deployment.

Using the client

Endpoint.update() provides a parameter for configuring the endpoint's compute resources. It can be used alongside any update strategy.
from verta.endpoint.update import DirectUpdateStrategy
​
endpoint.update(
model_version, DirectUpdateStrategy(),
resources=resources,
)
resources specifies the computational resources that will be available to the model when it is deployed.
from verta.endpoint.resources import Resources
​
resources = Resources(cpu=.25, memory="512Mi")
In this example, each replica will be provided a fourth of a CPU core and 512 Mi of RAM. For more information about available resources and units, see the update-resources API documentation.
Previous
Endpoint autoscaling
Next
Endpoint environment variables
Last modified 2mo ago
Copy link