Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

rfc: graph: propose to support Grouped-query Attention #2018

Open
wants to merge 5 commits into
base: rfcs
Choose a base branch
from
Open

rfc: graph: propose to support Grouped-query Attention #2018

wants to merge 5 commits into from
+358 −0

Commits on Jul 31, 2024

  1. rfcs: graph: propose to support Grouped-query Attention

    @gyhintel
    gyhintel committed Jul 31, 2024
    Configuration menu
    Copy the full SHA
    7c3caf5 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. rfcs: graph: add recommended option

    @gyhintel
    gyhintel committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    48aedf7 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. rfcs: graph: add more descriptions for the option 3

    @gyhintel
    gyhintel committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    9099287 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. rfcs: graph: fix the pytorch GQA implementation description

    @gyhintel
    gyhintel committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    509d1b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. rfcs: graph: fix the shape in the description

    @gyhintel
    gyhintel committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    5b57d70 View commit details
    Browse the repository at this point in the history