Skip to content
This repository was archived by the owner on Jan 8, 2025. It is now read-only.
This repository was archived by the owner on Jan 8, 2025. It is now read-only.

positional embeddings not linked to the encoder ? #1

@chaiban

Description

@chaiban

Hi,
the model is very well written thanks for sharing.

I did not find the usage of positional embeddings in encoder layer (although it is written as additional script).

Correct me if I am wrong but shouldn't the postional embeddings be used with inputs ?

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions