Interface: QuantizationConfig

Properties

bits

• Optional bits: number

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:565

---

config _ groups

• Optional config_groups: Record<string, { format?: string ; targets?: string[] ; weights?: { num_bits?: number } }>

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:570

---

format

• Optional format: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:569

---

ignore

• Optional ignore: string[]

compressed-tensors names its exclusion list ignore rather than modules_to_not_convert, using the same re:-prefixed target syntax as config_groups[].targets.

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:575

---

load _ in _ 4bit

• Optional load_in_4bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:566

---

load _ in _ 8bit

• Optional load_in_8bit: boolean

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:567

---

modules _ to _ not _ convert

• Optional modules_to_not_convert: string[]

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:564

---

quant _ method

• Optional quant_method: string

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:563

Update on GitHub