Hacker Newsnew | past | comments | ask | show | jobs | submit | ithkai92's commentslogin

Thanks for the headstart, I saw hf also has PQ2_0 and able to finetune the command and in a MBA M4 24GB averages around 10t/s with the command.

./llama-prism-b10685-7dffb15/llama-server \ -m Ternary-Bonsai-2-27B-PQ2_0.gguf \ --port 8331 -ngl 99 -fa on -c 65536 --jinja \ --temp 1.0 --top-p 0.95 --top-k 20 --min-p 0.0


Do we know which website? Were the Agents GDPR compliant ;-)?


DseWiki

Dataset and analysis on https://collusion.wiki/


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: