[**@isdk/ai-tool-llm**](../README.md)

***

[@isdk/ai-tool-llm](../globals.md) / AIModelQuantType

# Enumeration: AIModelQuantType

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:27](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L27)

## Enumeration Members

### BF16

> **BF16**: `32`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:60](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L60)

***

### F16

> **F16**: `1`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:29](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L29)

***

### F32

> **F32**: `0`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:28](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L28)

***

### GUESSED

> **GUESSED**: `1024`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:65](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L65)

***

### IQ1\_M

> **IQ1\_M**: `31`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:59](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L59)

***

### IQ1\_S

> **IQ1\_S**: `24`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:52](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L52)

***

### IQ2\_M

> **IQ2\_M**: `29`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:57](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L57)

***

### IQ2\_S

> **IQ2\_S**: `28`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:56](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L56)

***

### IQ2\_XS

> **IQ2\_XS**: `20`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:48](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L48)

***

### IQ2\_XXS

> **IQ2\_XXS**: `19`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:47](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L47)

***

### IQ3\_M

> **IQ3\_M**: `27`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:55](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L55)

***

### IQ3\_S

> **IQ3\_S**: `26`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:54](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L54)

***

### IQ3\_XS

> **IQ3\_XS**: `22`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:50](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L50)

***

### IQ3\_XXS

> **IQ3\_XXS**: `23`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:51](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L51)

***

### IQ4\_NL

> **IQ4\_NL**: `25`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:53](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L53)

***

### IQ4\_XS

> **IQ4\_XS**: `30`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:58](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L58)

***

### Q2\_K

> **Q2\_K**: `10`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:38](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L38)

***

### Q2\_K\_L

> **Q2\_K\_L**: `1027`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:69](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L69)

***

### Q2\_K\_S

> **Q2\_K\_S**: `21`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:49](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L49)

***

### Q3\_K\_L

> **Q3\_K\_L**: `13`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:41](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L41)

***

### Q3\_K\_M

> **Q3\_K\_M**: `12`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:40](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L40)

***

### Q3\_K\_S

> **Q3\_K\_S**: `11`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:39](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L39)

***

### Q3\_K\_XL

> **Q3\_K\_XL**: `1026`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:68](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L68)

***

### Q4\_0

> **Q4\_0**: `2`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:30](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L30)

***

### Q4\_0\_4\_4

> **Q4\_0\_4\_4**: `33`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:61](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L61)

***

### Q4\_0\_4\_8

> **Q4\_0\_4\_8**: `34`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:62](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L62)

***

### Q4\_0\_8\_8

> **Q4\_0\_8\_8**: `35`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:63](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L63)

***

### Q4\_1

> **Q4\_1**: `3`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:31](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L31)

***

### Q4\_1\_SOME\_F16

> **Q4\_1\_SOME\_F16**: `4`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:32](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L32)

***

### Q4\_K\_L

> **Q4\_K\_L**: `1025`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:67](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L67)

***

### Q4\_K\_M

> **Q4\_K\_M**: `15`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:43](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L43)

***

### Q4\_K\_S

> **Q4\_K\_S**: `14`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:42](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L42)

***

### Q5\_0

> **Q5\_0**: `8`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:36](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L36)

***

### Q5\_1

> **Q5\_1**: `9`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:37](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L37)

***

### Q5\_K\_M

> **Q5\_K\_M**: `17`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:45](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L45)

***

### Q5\_K\_S

> **Q5\_K\_S**: `16`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:44](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L44)

***

### Q6\_K

> **Q6\_K**: `18`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:46](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L46)

***

### Q8\_0

> **Q8\_0**: `7`

Defined in: [@isdk/ai-tools/packages/ai-tool-llm/src/llm-settings.ts:35](https://github.com/isdk/ai-tool-llm.js/blob/d6d9893dfd318ddf757b21ff3f422c985e852178/src/llm-settings.ts#L35)