35 points | by masonhsu 5 hours ago
4 comments
Funny, i did this myself some months ago - its actually not that tricky to run a llm in your browser. Tho, the problem is that the models fitting in there are well relativly "tiny" in my opinion.
Cool idea tho to make it as accessible (:
One click agent run on browser, What can go wrong :)
Yeah. What possibly can go wrong? I literally can't think of a single risk for this.
What models have you been able to run with this?
Funny, i did this myself some months ago - its actually not that tricky to run a llm in your browser. Tho, the problem is that the models fitting in there are well relativly "tiny" in my opinion.
Cool idea tho to make it as accessible (:
One click agent run on browser, What can go wrong :)
Yeah. What possibly can go wrong? I literally can't think of a single risk for this.
What models have you been able to run with this?