Audit logs

Every operation performed in the Verta platform can create an audit log. This includes both API calls and model predictions. The audit log contains the relevant information to help you identify access patterns and potential suspicious activity.

Platform activity audit logs and model (I/O) audit logs can also be configured separately, can be sent to two different locations or you can opt to have platform activity audit logs" without having model audit logs.

Below is an example of a log entry:

{
    "user": {
        "id": "123",
        "email": "[e-mail]"
    },
    "timestamp": "2006-01-02T15:04:05.999999999Z",
    "method": "exampleMethod",
    "requestHeaders": {
        "header1": ["value1"]
    },
    "requestPath": "/example",
    "request": {
        "exampleType": {
            "id": 123
        }
    },
    "requestBase64": "ZXhhbXBsZQo=",
    "response": {
        "exampleOtherType": {
            "id": 123
        }
    },
    "responseBase64": "ZXhhbXBsZQo=",
    "responseHeaders": {
        "header1": ["value1"]
    },
    "returnCode": 500,
    "errorCode": 500,
    "errorMessage": "sampleErrorMessage",
    "requestId": "uuid",
    "versionId": "v1",
    "namespace": "production",
    "modelInfo": {
        "modelName": "my model",
        "modelVersion": "v0",
        "endpointPath": "/example",
        "endpointId": 123,
        "stageId": 456,
        "buildId": 12,
        "revisionId": 45
    }
}

The logs are saved in a configured object store as compressed new-line separated json files.

How to configure Model I/O logs for models with PII data ?

Verta can disable input feature logging for models that ingest PII data.

To configure a model as PII, follow these steps:

• In the Verta Model Catalog, enable the PII tag for the registered model. The PII tag can be toggled on and off using both the web app and client SDK. The default state of the PII tag is always false.

• In the web app, navigate to the edit settings for a registered model. Any user with update access can toggle the PII tag.

• Use the following code with the client SDK to enable the PII tag for a registered model:

registered_model.set_pii(True)

• Once the PII field is toggled on, the system will capture the PII configuration when you deploy a new endpoint. It will not log any input features for that model.

• Note that if you already have a live endpoint in Verta and you toggle the PII field after deployment, you need to update the endpoint to fetch the new configuration. This ensures that the platform avoids logging the input features.

Reach out to us at [e-mail] for any questions on how to consume the logs or to disable audit logs in your account.