Updating endpoint with a configuration file

Search…

Verta's client and CLI support updating Endpoint with JSON or YAML configuration file. This tutorial will show how it can be done, using the client and CLI.
Configuration file
Sometimes, it is more convenient to specify update configuration in a separate, human-readable file, than to have everything in a Python script or a split CLI command.
For example:
{
    "run_id": "<experiment run id>",
    "strategy": "canary",
    "canary_strategy": {
        "progress_step": 0.05,
        "progress_interval_seconds": 30,
        "rules": [
            {"rule": "latency_avg_max", "rule_parameters": [{"name": "threshold", "value": 0.1}]},
            {"rule": "error_4xx_rate", "rule_parameters": [{"name": "threshold", "value": 1}]}
        ]
    },
    "autoscaling": {
        "quantities": {"min_replicas": 0, "max_replicas": 4, "min_scale": 0.5, "max_scale": 2.0},
        "metrics": [
            {"metric": "cpu_utilization", "parameters": [{"name": "target", "value": 0.5}]},
            {"metric": "memory_utilization", "parameters": [{"name": "target", "value": 0.7}]}
        ]
    },
    "env_vars": {"VERTA_HOST": "<Verta host URL>"},
    "resources": {"cpu": 0.25, "memory": "100M"}
}
The JSON representations for endpoint configuration values can be found in their respective Python API documentation entries.
This allows for easier inspection and modification later on. Users can find out more about the fields of the configuration file here.
Updating via client
With the client, instead of using Endpoint.update(), we will use the Endpoint.update_from_config() method, which takes only the path to the configuration file:
endpoint.update_from_config("config_file.json")

Endpoint environment variables

Querying an endpoint

Last modified 2mo ago

Copy link

Outline

Configuration file

Updating via client