SmokeyDope@lemmy.worldMEnglish · edit-210 hours agoHow to calculate cost-per-tokens output of local model compared to enterprise model API accessplus-squarelemmy.worldimagemessage-square8linkfedilinkarrow-up124arrow-down10
arrow-up124arrow-down1imageHow to calculate cost-per-tokens output of local model compared to enterprise model API accessplus-squarelemmy.worldSmokeyDope@lemmy.worldMEnglish · edit-210 hours agomessage-square8linkfedilink
brokenlcd@feddit.itEnglish · edit-220 hours agoneed help understanding if this setup is even feasible.plus-squaremessage-squaremessage-square6linkfedilinkarrow-up19arrow-down11
arrow-up18arrow-down1message-squareneed help understanding if this setup is even feasible.plus-squarebrokenlcd@feddit.itEnglish · edit-220 hours agomessage-square6linkfedilink
robber@lemmy.mlEnglish · 3 days agoNew, promising MoE model "Hunyuan" by Tencentplus-squarehuggingface.coexternal-linkmessage-square0linkfedilinkarrow-up114arrow-down11
arrow-up113arrow-down1external-linkNew, promising MoE model "Hunyuan" by Tencentplus-squarehuggingface.corobber@lemmy.mlEnglish · 3 days agomessage-square0linkfedilink
wise_pancake@lemmy.caEnglish · 14 days agoAre you using any MCP servers? If so, what?message-squaremessage-square9linkfedilinkarrow-up129arrow-down10
arrow-up129arrow-down1message-squareAre you using any MCP servers? If so, what?wise_pancake@lemmy.caEnglish · 14 days agomessage-square9linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-213 days agoHomelab upgrade WIPplus-squarelemmy.worldimagemessage-square4linkfedilinkarrow-up127arrow-down11
arrow-up126arrow-down1imageHomelab upgrade WIPplus-squarelemmy.worldSmokeyDope@lemmy.worldMEnglish · edit-213 days agomessage-square4linkfedilink
robber@lemmy.mlEnglish · 15 days agoDo you quantize models yourself?plus-squarelemmy.mlimagemessage-square7linkfedilinkarrow-up124arrow-down10
arrow-up124arrow-down1imageDo you quantize models yourself?plus-squarelemmy.mlrobber@lemmy.mlEnglish · 15 days agomessage-square7linkfedilink
Womble@lemmy.worldEnglish · edit-216 days agoAny recomendations for a text editor with good AI integration (not code editor)plus-squaremessage-squaremessage-square11linkfedilinkarrow-up118arrow-down13
arrow-up115arrow-down1message-squareAny recomendations for a text editor with good AI integration (not code editor)plus-squareWomble@lemmy.worldEnglish · edit-216 days agomessage-square11linkfedilink
splendoruranium@infosec.pubEnglish · edit-227 days agoLocal Voiceover/Audiobook generationplus-squaremessage-squaremessage-square6linkfedilinkarrow-up126arrow-down10
arrow-up126arrow-down1message-squareLocal Voiceover/Audiobook generationplus-squaresplendoruranium@infosec.pubEnglish · edit-227 days agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-229 days agoMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiexternal-linkmessage-square4linkfedilinkarrow-up137arrow-down13
arrow-up134arrow-down1external-linkMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiSmokeyDope@lemmy.worldMEnglish · edit-229 days agomessage-square4linkfedilink
10001110101@lemm.eeEnglish · 30 days agoCurrent best local models for tool use?plus-squaremessage-squaremessage-square8linkfedilinkarrow-up115arrow-down11
arrow-up114arrow-down1message-squareCurrent best local models for tool use?plus-square10001110101@lemm.eeEnglish · 30 days agomessage-square8linkfedilink
pebbles@sh.itjust.worksEnglish · 1 month agoI'm excited for dots.llm (142BA14B)!plus-squaregithub.comexternal-linkmessage-square3linkfedilinkarrow-up112arrow-down10
arrow-up112arrow-down1external-linkI'm excited for dots.llm (142BA14B)!plus-squaregithub.compebbles@sh.itjust.worksEnglish · 1 month agomessage-square3linkfedilink
HumanPerson@sh.itjust.worksEnglish · edit-21 month agoWhat to Integrate With My AIplus-squaremessage-squaremessage-square6linkfedilinkarrow-up118arrow-down13
arrow-up115arrow-down1message-squareWhat to Integrate With My AIplus-squareHumanPerson@sh.itjust.worksEnglish · edit-21 month agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-21 month agoUpdated guidelines for c/LocaLLama (new rules)plus-squaremessage-squaremessage-square8linkfedilinkarrow-up128arrow-down10
arrow-up128arrow-down1message-squareUpdated guidelines for c/LocaLLama (new rules)plus-squareSmokeyDope@lemmy.worldMEnglish · edit-21 month agomessage-square8linkfedilink
ikt@aussie.zoneEnglish · 1 month agoAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comexternal-linkmessage-square15linkfedilinkarrow-up135arrow-down10
arrow-up135arrow-down1external-linkAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comikt@aussie.zoneEnglish · 1 month agomessage-square15linkfedilink
ikt@aussie.zoneEnglish · edit-21 month agoMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comexternal-linkmessage-square15linkfedilinkarrow-up123arrow-down114
arrow-up19arrow-down1external-linkMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comikt@aussie.zoneEnglish · edit-21 month agomessage-square15linkfedilink
WalnutLum@lemmy.mlEnglish · 1 month agoDespite record gaming revenues, Nvidia reportedly plans to cut RTX 50 series production to allocate it to new AI hardwareplus-squareoverclock3d.netexternal-linkmessage-square5linkfedilinkarrow-up117arrow-down10
arrow-up117arrow-down1external-linkDespite record gaming revenues, Nvidia reportedly plans to cut RTX 50 series production to allocate it to new AI hardwareplus-squareoverclock3d.netWalnutLum@lemmy.mlEnglish · 1 month agomessage-square5linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 1 month agoNoob experience using local LLM as a D&D style DM.plus-squaremessage-squaremessage-square17linkfedilinkarrow-up127arrow-down14
arrow-up123arrow-down1message-squareNoob experience using local LLM as a D&D style DM.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 1 month agomessage-square17linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 1 month agoDon't overlook llama.cpp's rpc-server feature.plus-squaremessage-squaremessage-square6linkfedilinkarrow-up119arrow-down10
arrow-up119arrow-down1message-squareDon't overlook llama.cpp's rpc-server feature.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 1 month agomessage-square6linkfedilink
thickertoofan@lemm.eeEnglish · 1 month agoLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgexternal-linkmessage-square10linkfedilinkarrow-up112arrow-down11
arrow-up111arrow-down1external-linkLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgthickertoofan@lemm.eeEnglish · 1 month agomessage-square10linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-21 month agoDeepSeek just released updated r1 models with 'deeper and more complex reasoning patterns'. Includes a r1 distilled qwen3 8b model boasting "10% improved performance" over originalplus-squarehuggingface.coexternal-linkmessage-square9linkfedilinkarrow-up129arrow-down12
arrow-up127arrow-down1external-linkDeepSeek just released updated r1 models with 'deeper and more complex reasoning patterns'. Includes a r1 distilled qwen3 8b model boasting "10% improved performance" over originalplus-squarehuggingface.coSmokeyDope@lemmy.worldMEnglish · edit-21 month agomessage-square9linkfedilink
