-
|
I just noticed "WizardLM 13B Uncensored" appeared in the wild But I'm still trying to work out the correct process of conversion for "pytorch_model.bin" in to GGML (while I continue reading through all docs and experiment) EDIT: |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
|
Simply run the |
Beta Was this translation helpful? Give feedback.
Simply run the
convert.pypointing to the directory you put the files.then run the
qunatizeexecutable for the desired quantization.done.