Skip to content

tinyllava/training_recipe/lora_recipe.py使用lora时,并没有真正使用lora #197

@LuShuaie

Description

@LuShuaie

tinyllava/training_recipe/lora_recipe.py中

if model.peft_config is None:
log("Adding LoRA adapters...")
model = get_peft_model(model, lora_config)

这个会直接跳过吧,应该把if model.peft_config is None:进行注销

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions