Integration of web searches

[rthwm]

Love Koboldcpp and how it works! I was needing a means to have the AI access live/current data from the web. After installing text-generation-webui with the extension "LLM_Web_search", I was able to get it to work almost perfectly. I just really don't like the UI and much prefer KoboldCPP. Just curious if there might be a way to integrate this feature into a future release.

[LostRuins]

Now Added in 1.81

[LostRuins]

You need to make sure it's enabled in Kcpp, and then toggled on in the correct menu.

It will make a query to DuckDuckGo with your instruction, scrape the top 3 results and include them in the context.

[VL4DST3R]

I mentioned that it did work (i.e. I have properly enabled it) when using your example, but I'm not sure how/what to prompt to make it do it again, for other topics. Or if it is supposed to work every time/prompt after enabling it, it did not work for me on any subsequent messages.

[LostRuins]

Please run it in debugmode and take a look at what is displayed in the terminal.

[LostRuins]

You can see the search query triggered, and the result embedded into the prompt

[rthwm]

First off, thank you for the integration! I am experimenting with it and it does appear to be working (I can see the web sources in the logs that it is pulling information from). Will need to experiment with the output's a little bit. When I tried to get it to tell me the current date and/or current time, I can see the sources that it is pulling from, but the information that is given in the response doesn't match what the sources are actually telling it. ex: "what is today's date in central united states". Logs shows it did a search and found answers on 24timezones.com and timeanddate.com, which both sites do give the correct date/time information, but the LLM is returning the wrong date/time from what the sources are telling it.