Nous-Hermes¶

latest13b7b70b-llama2-q4_070b-llama2-q4_170b-llama2-q5_070b-llama2-q5_170b-llama2-q2_K70b-llama2-q3_K_S70b-llama2-q3_K_M70b-llama2-q3_K_L70b-llama2-q4_K_S70b-llama2-q4_K_M70b-llama2-q5_K_M70b-llama2-q6_K70b-llama2-fp1613b-llama213b-q4_013b-q4_113b-q5_013b-q5_113b-q8_013b-q2_K13b-q3_K_S13b-q3_K_M13b-q3_K_L13b-q4_K_S13b-q4_K_M13b-q5_K_S13b-q5_K_M13b-q6_K13b-fp1613b-llama2-q4_013b-llama2-q4_113b-llama2-q5_013b-llama2-q5_113b-llama2-q8_013b-llama2-q2_K13b-llama2-q3_K_S13b-llama2-q3_K_M13b-llama2-q3_K_L13b-llama2-q4_K_S13b-llama2-q4_K_M13b-llama2-q5_K_S13b-llama2-q5_K_M13b-llama2-q6_K13b-llama2-fp167b-llama27b-llama2-q4_07b-llama2-q4_17b-llama2-q5_07b-llama2-q5_17b-llama2-q8_07b-llama2-q2_K7b-llama2-q3_K_S7b-llama2-q3_K_M7b-llama2-q3_K_L7b-llama2-q4_K_S7b-llama2-q4_K_M7b-llama2-q5_K_S7b-llama2-q5_K_M7b-llama2-q6_K7b-llama2-fp16

拉取模型
```
ollama run nous-hermes
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	4bfb8ab0bd02 · 3.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	e6251854aa4c · 7.4GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	4bfb8ab0bd02 · 3.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:70b-llama2-q4_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 4-bit	cadbb9c53eca · 39GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-q4_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 4-bit	440fbf2182c3 · 43GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-q5_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 5-bit	122da3aab28d · 47GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-q5_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 5-bit	b654542cc786 · 52GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-q2_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 2-bit	9c6cf2f685c9 · 29GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q3_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 3-bit	18e62dbb016a · 30GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q3_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 3-bit	32c31c64cdbf · 33GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q3_K_L

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 3-bit	c872f2a366df · 36GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q4_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 4-bit	12421faf08d0 · 39GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q4_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 4-bit	21314c236bdf · 41GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型

ollama run nous-hermes:70b-llama2-q5_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 5-bit	7add3f814c3c · 49GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-q6_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization 6-bit	110cec2e283d · 57GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:70b-llama2-fp16
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 65B quantization F16	1da6e95d6cea · 138GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"num_gqa":8,"stop":["### Instruction:","### Input:"]}`	54B

拉取模型
```
ollama run nous-hermes:13b-llama2
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	e6251854aa4c · 7.4GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q4_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	61fe5b2ccd82 · 7.4GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q4_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	a651d3847eac · 8.2GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q5_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	eeb742832a51 · 9.0GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q5_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	038fe176c480 · 9.8GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q8_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 8-bit	46d4bb81ee05 · 14GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q2_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 2-bit	5049c9c4bc2a · 5.4GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q3_K_S
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	88a44838868d · 5.7GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q3_K_M
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	541fa538fcc0 · 6.3GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q3_K_L
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	da82ae0a2f34 · 6.9GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q4_K_S
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	dfdcc8b0cb9b · 7.4GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q4_K_M
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	a89c261261df · 7.9GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q5_K_S
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	9168dcc08386 · 9.0GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q5_K_M
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	00a91bb87bab · 9.2GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-q6_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 6-bit	d13a63be6cce · 11GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-fp16
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization F16	83e200dff28c · 26GB
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q4_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	e6251854aa4c · 7.4GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q4_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	52cf8c8c1f43 · 8.2GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q5_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	aa60531ab05e · 9.0GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q5_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	301d1bce8506 · 9.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q8_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 8-bit	7c6c80693fd9 · 14GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q2_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 2-bit	351d072134ee · 5.4GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q3_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	12fcbf2adcd7 · 5.7GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q3_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	ed2a0543a4f2 · 6.3GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q3_K_L

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 3-bit	55510b4db076 · 6.9GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q4_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	26f1237d26d7 · 7.4GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q4_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 4-bit	2baf9b8ebbbc · 7.9GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q5_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	499c44fdcbf9 · 9.0GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:13b-llama2-q5_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 5-bit	f712a98ac03c · 9.2GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-q6_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization 6-bit	eedd114c4d95 · 11GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:13b-llama2-fp16
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 13B quantization F16	0e2f44eb0773 · 26GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	105B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	4bfb8ab0bd02 · 3.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q4_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	4bfb8ab0bd02 · 3.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q4_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	52cda9e6f6da · 4.2GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q5_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 5-bit	c6a3388bcc53 · 4.7GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q5_1
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 5-bit	3c0e1768c975 · 5.1GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q8_0
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 8-bit	a512e84c0ad5 · 7.2GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q2_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 2-bit	4968fef8e8b9 · 2.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q3_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 3-bit	5969474f335c · 2.9GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q3_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 3-bit	70cf80e138af · 3.3GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q3_K_L

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 3-bit	e6a435b97b57 · 3.6GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q4_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	8040a0492349 · 3.9GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q4_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 4-bit	ab3cdd3e85cd · 4.1GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q5_K_S

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 5-bit	2b05878efeb9 · 4.7GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型

ollama run nous-hermes:7b-llama2-q5_K_M

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 5-bit	177be89aeec9 · 4.8GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-q6_K
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization 6-bit	e9913ad528c9 · 5.5GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B

拉取模型
```
ollama run nous-hermes:7b-llama2-fp16
```

模型信息 (model)

Manifest	Info	Size
model	arch llama parameters 7B quantization F16	38afafe3e533 · 13GB
system	`Below is an instruction that describes a task. Write a response that appropriately completes the request.`	106B
template	`### Instruction: {{ .Prompt }} {{- if .System }} ### Input: {{ .System }} {{- end }} ### Response:`	101B
params	`{"stop":["### Instruction:","### Input:","### Response:"]}`	58B