Update README.md
Browse files
README.md
CHANGED
|
@@ -172,22 +172,22 @@ Assuming that you already have GGUF files downloaded. Here is how you can use th
|
|
| 172 |
```
|
| 173 |
wget https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7.3/llamafile-0.7.3
|
| 174 |
```
|
| 175 |
-
2. **Run the model with
|
| 176 |
|
| 177 |
|
| 178 |
```markdown
|
| 179 |
-
|
| 180 |
```
|
| 181 |
|
| 182 |
|
| 183 |
```
|
| 184 |
-
./llamafile-0.7.3 -ngl 9999 -m
|
| 185 |
```
|
| 186 |
|
| 187 |
3. **Run with a chat interface:**
|
| 188 |
|
| 189 |
```
|
| 190 |
-
./llamafile-0.7.3 -ngl 9999 -m
|
| 191 |
```
|
| 192 |
|
| 193 |
Your browser should open automatically and display a chat interface. (If it doesn't, just open your browser and point it at http://localhost:8080)
|
|
|
|
| 172 |
```
|
| 173 |
wget https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7.3/llamafile-0.7.3
|
| 174 |
```
|
| 175 |
+
2. **Run the model with prompt:**
|
| 176 |
|
| 177 |
|
| 178 |
```markdown
|
| 179 |
+
public class HelloWorld {\n public static void main(String[] args) {
|
| 180 |
```
|
| 181 |
|
| 182 |
|
| 183 |
```
|
| 184 |
+
./llamafile-0.7.3 -ngl 9999 -m NT-Java-1.1B_Q4_K_M.gguf --temp 0.6 -p "public class HelloWorld {\n public static void main(String[] args) {"
|
| 185 |
```
|
| 186 |
|
| 187 |
3. **Run with a chat interface:**
|
| 188 |
|
| 189 |
```
|
| 190 |
+
./llamafile-0.7.3 -ngl 9999 -m NT-Java-1.1B_Q4_K_M.gguf
|
| 191 |
```
|
| 192 |
|
| 193 |
Your browser should open automatically and display a chat interface. (If it doesn't, just open your browser and point it at http://localhost:8080)
|