Interface: QuantizationConfig

Properties

bits

• Optional bits: number

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:590

---

config _ groups

• Optional config_groups: Record<string, { format?: string ; targets?: string[] ; weights?: { num_bits?: number } }>

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:595

---

format

• Optional format: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:594

---

ignore

• Optional ignore: string[]

compressed-tensors names its exclusion list ignore rather than modules_to_not_convert, using the same re:-prefixed target syntax as config_groups[].targets.

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:600

---

load _ in _ 4bit

• Optional load_in_4bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:591

---

load _ in _ 8bit

• Optional load_in_8bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:592

---

modules _ to _ not _ convert

• Optional modules_to_not_convert: string[]

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:589

---

quant _ method

• Optional quant_method: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:588

Update on GitHub