You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: packages/agent-eval/CHANGELOG.md
+20Lines changed: 20 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,25 @@
1
1
# @vercel/agent-eval
2
2
3
+
## 0.6.0
4
+
5
+
### Minor Changes
6
+
7
+
-[#65](https://github.com/vercel-labs/agent-eval/pull/65)[`cf50218`](https://github.com/vercel-labs/agent-eval/commit/cf50218fe2f3ec30241809edc91f356ca684e39d) Thanks [@gaojude](https://github.com/gaojude)! - Make classifier feature optional and add feature flag
8
+
9
+
**Features:**
10
+
11
+
- Added `isClassifierEnabled()` function to check if classifier is available (requires `AI_GATEWAY_API_KEY` or `VERCEL_OIDC_TOKEN`)
12
+
- Classifier is now optional: if neither env var is set, classification is skipped and all results are preserved
13
+
- Warning message now displays when classifier is disabled, explaining why the keys are needed
14
+
- Updated README to document classifier behavior and environment variable requirements
15
+
16
+
**Changes:**
17
+
18
+
- CLI skips entire classification block when classifier is disabled
19
+
- Housekeeping no longer removes non-model failures when classifier is disabled (only removes incomplete/duplicate results)
20
+
- All tests updated to properly enable classifier for tests that require it
21
+
- Added test case for disabled classifier behavior
0 commit comments