Skip to content

Commit 68adf65

Browse files
Version Packages (#66)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
1 parent cf50218 commit 68adf65

File tree

3 files changed

+21
-18
lines changed

3 files changed

+21
-18
lines changed

.changeset/optional-classifier.md

Lines changed: 0 additions & 17 deletions
This file was deleted.

packages/agent-eval/CHANGELOG.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,25 @@
11
# @vercel/agent-eval
22

3+
## 0.6.0
4+
5+
### Minor Changes
6+
7+
- [#65](https://github.com/vercel-labs/agent-eval/pull/65) [`cf50218`](https://github.com/vercel-labs/agent-eval/commit/cf50218fe2f3ec30241809edc91f356ca684e39d) Thanks [@gaojude](https://github.com/gaojude)! - Make classifier feature optional and add feature flag
8+
9+
**Features:**
10+
11+
- Added `isClassifierEnabled()` function to check if classifier is available (requires `AI_GATEWAY_API_KEY` or `VERCEL_OIDC_TOKEN`)
12+
- Classifier is now optional: if neither env var is set, classification is skipped and all results are preserved
13+
- Warning message now displays when classifier is disabled, explaining why the keys are needed
14+
- Updated README to document classifier behavior and environment variable requirements
15+
16+
**Changes:**
17+
18+
- CLI skips entire classification block when classifier is disabled
19+
- Housekeeping no longer removes non-model failures when classifier is disabled (only removes incomplete/duplicate results)
20+
- All tests updated to properly enable classifier for tests that require it
21+
- Added test case for disabled classifier behavior
22+
323
## 0.5.0
424

525
### Minor Changes

packages/agent-eval/package.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
22
"name": "@vercel/agent-eval",
3-
"version": "0.5.0",
3+
"version": "0.6.0",
44
"description": "Framework for testing AI coding agents in isolated sandboxes",
55
"repository": {
66
"type": "git",

0 commit comments

Comments
 (0)