How can I do summarization

[testplop]

I'm trying to make something like https://platform.openai.com/examples/default-notes-summary

But it fails, I tried with gpt4all, llama and alpaca 7B. Maybe I should ajust the prompt ?

[Topping1]

I tried a prompt like this:
summarize the text in brackets [text to summarize]
with some good and not so good results. Sometimes the model hallucinates parts of the summary. I think you can avoid this by setting the temperature low (like 0.2 for example). Also is useful to increase the context length to 2048.
I hope someone fine tunes Llama with summarization datasets already existing in Hugginface. It could be really useful.