Repetitive Output
I have been playing around with the mt0 models and smaller bloomz models. Currently I am running bloomz-1b1 and my output gets really repetitive. Is there any way to fix this other than post-processing the text to cut out duplicate text?
Example input (I took prompt suggestion from the docs):
Write a fairy tale about a troll saving a princess from a dangerous dragon. The fairy tale is a masterpiece that has achieved praise worldwide and its moral is "Heroes Come in All Shapes and Sizes". Story (in Spanish):
Output:
A un troll le gustaba mucho la vida. Él era un hombre muy feliz. Él tenía un gran jardín y una hermosa princesa. Él tenía un gran jardín y una hermosa princesa. Él tenía un gran jardín y una hermosa princesa. Él tenía un gran jardín y una hermosa princesa. Él tenía un gran jardín y una hermosa princesa. Él tenía un gran jardín y una hermosa princesa.
As you can see, the last sentence keeps repeating as much as the max_length i set allows. This happens with other prompts too. Any advice?
Yes you can increase temperature; Maybe you're doing greedy atm