Search results

New robustness evaluation mode and verification agent architectures

Status: Open.

#167 In sierra-research/tau2-bench;

· weelzo opened on Feb 21, 2026

BadRequestError: temperature=0.0 breaks evaluation with reasoning models (gpt-5.2, etc.)

Status: Open.

#166 In sierra-research/tau2-bench;

· shubchat opened on Feb 19, 2026

Add a TerminationReason for ContextWindowExceededError

Status: Open.

#159 In sierra-research/tau2-bench;

· LamaAlQarni opened on Feb 9, 2026

Question: should we have a “post-high-tension context” regime in Tau-Bench?

Status: Open.

#157 In sierra-research/tau2-bench;

· onestardao opened on Feb 6, 2026

Tau2 Task 9 Rewards Success for Scenario That Should Be Impossible per Policy

Status: Open.

#156 In sierra-research/tau2-bench;

· aviweit opened on Feb 5, 2026

one user tool state is shared across all concurrent simulation

Status: Open.

#154 In sierra-research/tau2-bench;

· mark-xai opened on Feb 5, 2026

bug in tool “cancel_reservation” in airline

Status: Open.

#153 In sierra-research/tau2-bench;

· LUTIAN233 opened on Feb 4, 2026

Evaluate standalone agents

Status: Open.

#150 In sierra-research/tau2-bench;

· clareliguori opened on Jan 28, 2026

<code>to_litellm_messages</code> function does not consider that users in the telecom domain can also call tools and have <code>tool_calls</code>.

Status: Open.

#139 In sierra-research/tau2-bench;

· StevenLau6 opened on Jan 14, 2026

RFC #3: Improve API Realism for Tau3

enhancementNew feature or requestNew feature or request

rfc

Status: Open.

Feature

#130 In sierra-research/tau2-bench;

· victorb-sierra opened on Jan 5, 2026

·  

v3.0 - Tau3 Upgrade

RFC #2: Task Semantics &amp; Evaluation for Tau3

design

rfc

Status: Open.

Feature

#129 In sierra-research/tau2-bench;

· victorb-sierra opened on Jan 5, 2026

·  

v3.0 - Tau3 Upgrade

RFC #1: Fixing Domains - Integrating Community Fixes for Tau3

rfc

task fixTask is incorrectTask is incorrect

Status: Open.

Feature

#128 In sierra-research/tau2-bench;

· victorb-sierra opened on Jan 5, 2026

·  

v3.0 - Tau3 Upgrade