Skip to content

Issue/243:支持w4a16 awq fp16推理#249

Merged
wooway777 merged 2 commits intomainfrom
Issue/243
Mar 11, 2026
Merged

Issue/243:支持w4a16 awq fp16推理#249
wooway777 merged 2 commits intomainfrom
Issue/243

Conversation

@qinyiqun
Copy link
Contributor

@qinyiqun qinyiqun commented Mar 2, 2026

Support w4a16 awq fp16 inference

@qinyiqun qinyiqun requested review from a team, whjthu and wooway777 March 2, 2026 08:08
@qinyiqun qinyiqun linked an issue Mar 2, 2026 that may be closed by this pull request
Copy link
Collaborator

@wooway777 wooway777 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image

@wooway777 wooway777 merged commit 5fb56f9 into main Mar 11, 2026
@wooway777 wooway777 deleted the Issue/243 branch March 11, 2026 09:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DEV] 支持awq w4a16(fp16)模型推理

2 participants