Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[GPU] Enable dynamic quantization gs32 as default for non-systolic #27119

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

[GPU] Enable dynamic quantization gs32 as default for non-systolic #27119

wants to merge 3 commits into from
+15 −9

Conversation

isanghao
Copy link
Contributor

Details:

  • It is applied only to int4 compressed model, non-systolic path
  • Though it is a global configuration, systolic hardware will ignore it

Tickets:

  • 151708

@isanghao
[GPU] Enable dynamic quantization gs32 as default for non-systolic
c3c8fcd 
* It is applied only to int4 compressed model
* Though it is a global configuration, systolic hardware will ignore it
@isanghao
lint fix
22278dc
@isanghao isanghao requested review from a team as code owners October 18, 2024 08:01
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Oct 18, 2024
@geunhwan geunhwan added this to the 2024.5 milestone Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jade-cho jade-cho jade-cho approved these changes

Assignees
No one assigned
Labels
category: GPU OpenVINO GPU plugin Code Freeze priority: high High piority
Projects
None yet
Milestone
2024.5
Development

Successfully merging this pull request may close these issues.
3 participants
@isanghao @jade-cho @geunhwan