Feature Request - add support for beam search
#30
by
miguelcarv
- opened
I don't think I'm the only one that is interested in this feature
beam is model agnostic. check your infer framework.
@diegomontoya I tried generating with the .generate(**inputs, num_beams=3) and some error was thrown, something to do with reorder cache... have you tried it and is it working for you?
Hello @diegomontoya and @miguelcarv !
This will be added once we integrate the Phi-based repositories with HF code base.
Best regards,
Gustavo.
gugarosa
changed discussion status to
closed
Is this already done?