Skip to content

Question: Application to LLaVA-OV and Qwen2vl #13

@arsoyul

Description

@arsoyul

Thank you for sharing your great work!

I want to experiment on the LLaVA-OV and Qwen2VL. If you have a similarity threshold on this model, can you share me? I found Qwen2VL's threshold is 0.5 in your example code. Is it correct?
Also i want to ask about how to select the similarity threshold on other models.
In your paper,

Since Similarity distributions vary across models, we set Sthreshold to match the median of similarity at the first model layer under typical input cases, such as 128 samples from the VideoMME dataset.

Then, the mean of median similarity across all VideoMME samples is the similarity threshold?

Metadata

Metadata

Assignees

Labels

help wantedExtra attention is needed

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions