local reranker model support?

[skmanzg]

Hi. I would like to know if I can use customized local reranker model in FlashRank? or... is there any documentaion regarding this? I would like to know how to use local model in FlashRank. I wonder if flashRank supports registered models only?

[paulinetheitgirl]

I ran into a similar need, and dug into the code flashrank/Ranker.py. You can try a combination of model_name and cache_dir to solve this. The README has examples. Because of these lines:

self.model_dir: Path = self.cache_dir / model_name
...
if not self.model_dir.exists():
            self.logger.info(f"Downloading {model_name}...")

if the directory cache_dir/model_name exists, flashrank will use files from there instead of trying to download.