fix: fix the chat stuck in infinite loop

[zoe27]

Relates to:

the chat stuck in infinite loop when using model_local #1213

Risks

Low

Background

What does this PR do?

This PR aim to fix the loop chat of the ai agent self when using the model_local

What kind of change is this?

modify the way of response generate in llama.ts

before this PR:

use the sequence.evaluate to generate the response

in this PR:

adjust to use the chatsession to generate the response

investigation step:

• using LLAMALOCAL and HEURIST, issue for LLAMALOCAL but HEURIST works wells. which means maybe something wrong with LLAMALOCAL
• using discord and direct client, HEURIST works well and LLAMALOCAL not well, which means no business with client but on the model
• https://github.com/withcatai/node-llama-cpp reference to the git and use node-llama-cpp to load local model According to the guidance, it works well, which means the model self is OK

- write a simple demo to test the model by using the `sequence.evaluate` , loop issue raised - reference to the node-llama-cpp code and adjust the code like in this PR, fix the issue

have not go to deeply to see what is the exactly different between sequence.evaluate and chatsession, maybe can fix loop bug first, and for now, have not found any risk.

Documentation changes needed?

Testing

Where should a reviewer start?

Detailed testing steps

Before
it loop the response and sometimes, the response is hard to understood

After
seems in a normal way to chat

[github-actions]

Hi @zoe27! Welcome to the ai16z community. Thanks for submitting your first pull request; your efforts are helping us accelerate towards AGI. We'll review it shortly. You are now a ai16z contributor!

[marcellodesales]

@zoe27 The PR is failing with the check against the main branch... Change it to develop to clean the PR checks!

https://github.com/elizaOS/eliza/actions/runs/12597379513/job/35110258487?pr=1755#step:2:8

[odilitime]

seems like functionality we'd want to keep, is this critical to remove to fix the infinite loop functionality?

[zoe27]

No, updated it and keep the function

[odilitime]

definitely need it to pay attention to temperature

[zoe27]

updated it, and keep the temperature in the generating function