Record L-02 · Legal

Terms

The agreement between you and EvalBook.

The service

EvalBook provides projects in which traces, datasets, scorers, evaluation suites, reports, review queues, improvement proposals and impact records are kept and computed on your organization’s behalf. You are responsible for the content you send to it and for what you instruct your scorers and runners to do.

A report is a measurement

A report states what EvalBook measured under the versions it pinned, with the assurance each check carries. It is not an approval, a certification or a warranty. Products and people that act on a report do so under their own rules; EvalBook does not authorize anything.

Runners are yours

An executable scorer runs in a runner you install on your own machine, under a token you created. The runner acts within the authority of the person who created the token, and what it executes is the scorer version you pinned. Keep ground truth that a candidate must not see out of the cases of executable scorers.

Accounts

Access is through your Bookbag account. You are responsible for keeping it secure and for the people you add to your organization. Removing somebody from the organization removes their access to EvalBook.

Model usage

Model calls made on your behalf go through the Bookbag account service and are metered against your organization’s allowance there. EvalBook is free at launch; it enforces the limits of the free plan and reads your plan from the account service only to show it.

Availability and changes

We aim to keep the service available and to give notice of changes that affect how an existing suite or gate behaves. A change to the peer protocol is written down before it ships; anything not written there is not promised.

Termination

You may stop using the service at any time and export or delete your content. We may suspend an account that is being used to attack the service or others through it.

Contact

Questions go to hello@nurobook.com.