wuphysics87@lemmy.ml to Privacy@lemmy.ml · 27 days agoCan you trust locally run LLMs?message-squaremessage-square22fedilinkarrow-up168arrow-down16file-text
arrow-up162arrow-down1message-squareCan you trust locally run LLMs?wuphysics87@lemmy.ml to Privacy@lemmy.ml · 27 days agomessage-square22fedilinkfile-text
I’ve been play around with ollama. Given you download the model, can you trust it isn’t sending telemetry?
minus-squarestink@lemmygrad.mllinkfedilinkEnglisharrow-up1·27 days agoIt’s nice but it’s hard to load unsupported models sadly. Really wish you could easily sideload but it’s nice unless you have a niche usecase.
minus-squareEmberleaf@lemmy.mllinkfedilinkarrow-up2·27 days agoI’m not sure what you mean by ‘hard to load’. You find the model you want, you download it, then load it up to chat. What’s the issue you’re having?
minus-squarestink@lemmygrad.mllinkfedilinkEnglisharrow-up1·27 days agoAt parents for the week but IIRC I had some sort of incompatible extension with a model I downloaded off huggingface
It’s nice but it’s hard to load unsupported models sadly. Really wish you could easily sideload but it’s nice unless you have a niche usecase.
I’m not sure what you mean by ‘hard to load’. You find the model you want, you download it, then load it up to chat. What’s the issue you’re having?
At parents for the week but IIRC I had some sort of incompatible extension with a model I downloaded off huggingface