You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I work on InvarLock, a verification/evidence tool for comparing an edited subject checkpoint against a fixed baseline. We have two optional integration examples that use GPTQModel, and I would appreciate a quick sanity check on a compatibility shim plus our GPTQ/AWQ wording.
In the v0.12.1 examples, InvarLock calls _patch_gptqmodel_transformers_hub_compat() before importing GPTQModel. The helper patches the current Transformers / Hugging Face Hub environment like this:
if transformers.utils.hub.create_repo is missing, set it from huggingface_hub.create_repo
if transformers.utils.hub.list_repo_tree is missing, set it from huggingface_hub.HfApi().list_repo_tree
We added this because our current integration environment could otherwise fail during GPTQModel import/load under newer Transformers/Hub combinations.
The examples intentionally use tiny deterministic checkpoints rather than realistic model-quality examples. The goal is to keep the integration evidence cheap to rerun in CUDA/container CI and easy to inspect.
Questions:
Is this compatibility shim expected in current GPTQModel + Transformers/Hub environments, or is there a better way we should handle it?
Is "GPTQModel AWQ flow" the right way to describe the AWQ example?
Are there GPTQModel/AWQ metadata fields you would recommend capturing in external_edit_summary.json, checkpoint_refs.json, or backend_inventory.json for downstream reviewers?
What InvarLock is not claiming:
not a benchmark of GPTQModel quality or speed
not a production quantization recipe
not upstream endorsement
not deployment approval
The intended claim is narrower: "this subject checkpoint was produced by the external backend, loaded through the relevant adapter path, compared against the baseline, and packaged with verifier/report/runtime evidence."
Happy to adjust any wording that reads like endorsement or over-claiming.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Hi GPTQModel maintainers,
I work on InvarLock, a verification/evidence tool for comparing an edited subject checkpoint against a fixed baseline. We have two optional integration examples that use GPTQModel, and I would appreciate a quick sanity check on a compatibility shim plus our GPTQ/AWQ wording.
Version / scope:
gptqmodel>=7.0.0Examples:
GPTQModel example:
https://github.com/invarlock/invarlock/tree/v0.12.1/examples/integrations/gptqmodel
AWQ example:
https://github.com/invarlock/invarlock/tree/v0.12.1/examples/integrations/awq
The concrete compatibility question:
In the v0.12.1 examples, InvarLock calls
_patch_gptqmodel_transformers_hub_compat()before importing GPTQModel. The helper patches the current Transformers / Hugging Face Hub environment like this:transformers.utils.hub.create_repois missing, set it fromhuggingface_hub.create_repotransformers.utils.hub.list_repo_treeis missing, set it fromhuggingface_hub.HfApi().list_repo_treeWe added this because our current integration environment could otherwise fail during GPTQModel import/load under newer Transformers/Hub combinations.
What the examples do:
GPTQModel path:
tiny deterministic Llama-style HF baseline -> GPTQModel quantization -> materialized GPTQ subject checkpoint -> InvarLock comparison through our
hf_gptqadapterAWQ path:
tiny deterministic Llama-style HF baseline -> GPTQModel AWQ flow -> materialized AWQ subject checkpoint -> InvarLock comparison through our
hf_awqadapterThe examples intentionally use tiny deterministic checkpoints rather than realistic model-quality examples. The goal is to keep the integration evidence cheap to rerun in CUDA/container CI and easy to inspect.
Questions:
external_edit_summary.json,checkpoint_refs.json, orbackend_inventory.jsonfor downstream reviewers?What InvarLock is not claiming:
The intended claim is narrower: "this subject checkpoint was produced by the external backend, loaded through the relevant adapter path, compared against the baseline, and packaged with verifier/report/runtime evidence."
Happy to adjust any wording that reads like endorsement or over-claiming.
Beta Was this translation helpful? Give feedback.
All reactions