Llama 2 Streaming (ELYZA-japanese-Llama-2-7b-fast-instruct)

Tried out streaming output with ELYZA-japanese-Llama-2-7b-fast-instruct.

Most of code was from:
https://zenn.dev/platina/articles/e6aa6e96373c09
by Plat

コメント