-
Notifications
You must be signed in to change notification settings - Fork 0
Labels
refineIssues with this tag needs refinement by team. Typically used to brain dump issues that pop upIssues with this tag needs refinement by team. Typically used to brain dump issues that pop up
Description
Summary
I realise we don't have the splitting functionality in the dataset yet, but should not forget to implement this in the benchmark when possible.
Current examples do not take a split dataset, they take the full dataset and set this to the supervise/zero-shot benchmark.
Motivation
To avoid confusion we should only utilize:
- train, validation, test datasets in supervised.
- test dataset in zero-shot.
Proposed solution
Depends on execution of ProteinGym/proteingym-base#294
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
refineIssues with this tag needs refinement by team. Typically used to brain dump issues that pop upIssues with this tag needs refinement by team. Typically used to brain dump issues that pop up