I was checking a tool i did to monitor the latest models on huggingface (if you wish to use it i published it here https://miero.ai/ModelsList, it updates hourly).
I hope this becomes a good method for decreasing model’s requirements, eventhough I find Q8 to be good.
💬 Discussion r/LocalLLaMA (5 points, 1 commentaires) 🔗 Source