ikt@aussie.zoneEnglish · 1 day agoETH Zurich and EPFL will release a large language model (LLM) developed on public infrastructure. Trained on the “Alps” supercomputer at the Swiss National Supercomputing Centre (CSCS)plus-squareethz.chexternal-linkmessage-square1linkfedilinkarrow-up126arrow-down10
arrow-up126arrow-down1external-linkETH Zurich and EPFL will release a large language model (LLM) developed on public infrastructure. Trained on the “Alps” supercomputer at the Swiss National Supercomputing Centre (CSCS)plus-squareethz.chikt@aussie.zoneEnglish · 1 day agomessage-square1linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-23 days agoHow to calculate cost-per-tokens output of local model compared to enterprise model API accessplus-squarelemmy.worldimagemessage-square11linkfedilinkarrow-up128arrow-down11
arrow-up127arrow-down1imageHow to calculate cost-per-tokens output of local model compared to enterprise model API accessplus-squarelemmy.worldSmokeyDope@lemmy.worldMEnglish · edit-23 days agomessage-square11linkfedilink
brokenlcd@feddit.itEnglish · edit-24 days agoneed help understanding if this setup is even feasible.plus-squaremessage-squaremessage-square16linkfedilinkarrow-up110arrow-down12
arrow-up18arrow-down1message-squareneed help understanding if this setup is even feasible.plus-squarebrokenlcd@feddit.itEnglish · edit-24 days agomessage-square16linkfedilink
robber@lemmy.mlEnglish · 6 days agoNew, promising MoE model "Hunyuan" by Tencentplus-squarehuggingface.coexternal-linkmessage-square1linkfedilinkarrow-up115arrow-down11
arrow-up114arrow-down1external-linkNew, promising MoE model "Hunyuan" by Tencentplus-squarehuggingface.corobber@lemmy.mlEnglish · 6 days agomessage-square1linkfedilink
wise_pancake@lemmy.caEnglish · 17 days agoAre you using any MCP servers? If so, what?message-squaremessage-square9linkfedilinkarrow-up129arrow-down10
arrow-up129arrow-down1message-squareAre you using any MCP servers? If so, what?wise_pancake@lemmy.caEnglish · 17 days agomessage-square9linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-217 days agoHomelab upgrade WIPplus-squarelemmy.worldimagemessage-square4linkfedilinkarrow-up128arrow-down11
arrow-up127arrow-down1imageHomelab upgrade WIPplus-squarelemmy.worldSmokeyDope@lemmy.worldMEnglish · edit-217 days agomessage-square4linkfedilink
robber@lemmy.mlEnglish · 18 days agoDo you quantize models yourself?plus-squarelemmy.mlimagemessage-square7linkfedilinkarrow-up124arrow-down10
arrow-up124arrow-down1imageDo you quantize models yourself?plus-squarelemmy.mlrobber@lemmy.mlEnglish · 18 days agomessage-square7linkfedilink
Womble@lemmy.worldEnglish · edit-219 days agoAny recomendations for a text editor with good AI integration (not code editor)plus-squaremessage-squaremessage-square11linkfedilinkarrow-up118arrow-down13
arrow-up115arrow-down1message-squareAny recomendations for a text editor with good AI integration (not code editor)plus-squareWomble@lemmy.worldEnglish · edit-219 days agomessage-square11linkfedilink
splendoruranium@infosec.pubEnglish · edit-21 month agoLocal Voiceover/Audiobook generationplus-squaremessage-squaremessage-square6linkfedilinkarrow-up126arrow-down10
arrow-up126arrow-down1message-squareLocal Voiceover/Audiobook generationplus-squaresplendoruranium@infosec.pubEnglish · edit-21 month agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-21 month agoMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiexternal-linkmessage-square4linkfedilinkarrow-up137arrow-down13
arrow-up134arrow-down1external-linkMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiSmokeyDope@lemmy.worldMEnglish · edit-21 month agomessage-square4linkfedilink
10001110101@lemm.eeEnglish · 1 month agoCurrent best local models for tool use?plus-squaremessage-squaremessage-square8linkfedilinkarrow-up115arrow-down11
arrow-up114arrow-down1message-squareCurrent best local models for tool use?plus-square10001110101@lemm.eeEnglish · 1 month agomessage-square8linkfedilink
pebbles@sh.itjust.worksEnglish · 1 month agoI'm excited for dots.llm (142BA14B)!plus-squaregithub.comexternal-linkmessage-square3linkfedilinkarrow-up112arrow-down10
arrow-up112arrow-down1external-linkI'm excited for dots.llm (142BA14B)!plus-squaregithub.compebbles@sh.itjust.worksEnglish · 1 month agomessage-square3linkfedilink
HumanPerson@sh.itjust.worksEnglish · edit-21 month agoWhat to Integrate With My AIplus-squaremessage-squaremessage-square6linkfedilinkarrow-up118arrow-down13
arrow-up115arrow-down1message-squareWhat to Integrate With My AIplus-squareHumanPerson@sh.itjust.worksEnglish · edit-21 month agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-21 month agoUpdated guidelines for c/LocaLLama (new rules)plus-squaremessage-squaremessage-square8linkfedilinkarrow-up128arrow-down10
arrow-up128arrow-down1message-squareUpdated guidelines for c/LocaLLama (new rules)plus-squareSmokeyDope@lemmy.worldMEnglish · edit-21 month agomessage-square8linkfedilink
ikt@aussie.zoneEnglish · 1 month agoAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comexternal-linkmessage-square15linkfedilinkarrow-up135arrow-down10
arrow-up135arrow-down1external-linkAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comikt@aussie.zoneEnglish · 1 month agomessage-square15linkfedilink
ikt@aussie.zoneEnglish · edit-21 month agoMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comexternal-linkmessage-square15linkfedilinkarrow-up123arrow-down114
arrow-up19arrow-down1external-linkMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comikt@aussie.zoneEnglish · edit-21 month agomessage-square15linkfedilink
WalnutLum@lemmy.mlEnglish · 1 month agoDespite record gaming revenues, Nvidia reportedly plans to cut RTX 50 series production to allocate it to new AI hardwareplus-squareoverclock3d.netexternal-linkmessage-square5linkfedilinkarrow-up117arrow-down10
arrow-up117arrow-down1external-linkDespite record gaming revenues, Nvidia reportedly plans to cut RTX 50 series production to allocate it to new AI hardwareplus-squareoverclock3d.netWalnutLum@lemmy.mlEnglish · 1 month agomessage-square5linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 1 month agoNoob experience using local LLM as a D&D style DM.plus-squaremessage-squaremessage-square17linkfedilinkarrow-up127arrow-down14
arrow-up123arrow-down1message-squareNoob experience using local LLM as a D&D style DM.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 1 month agomessage-square17linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 1 month agoDon't overlook llama.cpp's rpc-server feature.plus-squaremessage-squaremessage-square6linkfedilinkarrow-up119arrow-down10
arrow-up119arrow-down1message-squareDon't overlook llama.cpp's rpc-server feature.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 1 month agomessage-square6linkfedilink
thickertoofan@lemm.eeEnglish · 1 month agoLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgexternal-linkmessage-square10linkfedilinkarrow-up112arrow-down11
arrow-up111arrow-down1external-linkLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgthickertoofan@lemm.eeEnglish · 1 month agomessage-square10linkfedilink
