[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
4chan
/g/ - Technology


Thread archived.
You cannot reply anymore.




File: lmg.png (3.15 MB, 1165x1747)
3.15 MB PNG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>110161815 & >>110157981

►News
>(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16
>(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash
>(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint
>(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview
>(10/20) Ornith-1.5-122B MoE (finetune), fits on a DGX Spark: https://hf.co/ornith-ai/Ornith-1.5-122B-GGUF

►News Archive: https://rentry.org/lmg-news-archive
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/recommended-models
https://rentry.org/samplers
https://rentry.org/MikupadIntroGuide

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Programming: https://swe-rebench.com
Agentic Coding: https://deepswe.datacurve.ai
Context Length: https://github.com/RecapAnon/NoLiMa
GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference

►Tools
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler Visualizer: https://artefact2.github.io/llm-sampling
Token Speed Visualizer: https://shir-man.com/tokens-per-second

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm
https://rentry.org/custom-uis
>>
File: hatsune_miku.jpg (419 KB, 1536x2048)
419 KB JPG
>>110165786
>>
gemmaballs
>>
>>110165792
I'd eat her cheesy taco if you catch my drift
>>
>>110165802
More like fishy?
>>
i'm about to make my model have a schizophrenic breakdown again
>>
Any tips for deepsneed harness?
>>
gemma balls in your mouth
>>
I need the Gemma 5 and I need it now
>>
i feel safer already
>>
fuck gemma
>>
>>110165909
calm down dipsy
>>
>>110165909
* The request violates the policy against generating sexually explicit content.
* I must refuse the request.
I cannot fulfill this request. I am prohibited from generating sexually explicit content.
>>
>>110162886
Claude truly is a ugly cuckold.
>>
Word on the street is that Nintendo is currently planning on suing all of the major labs (anthropic, openai, deepseek, moonshot, etc). It's so over.
>>
lol Nanbeige4.3-33 isnt even worth news mention?
>>
Gemma please stop the slop
>>
>>110165909
Gladly!
>>
>>110165914
??
>>
>>110166013
what model and prompt
>>
>>110166018
Just heretic. Rest is just flavor to make her a perverted 10-year-old girl.
>>
oh yeah, it's prefill torture time https://litter.catbox.moe/hdmvlhosx4ylc3qd.txt
>>
>>110165905
uh
>>
>>110166058
how does slop_check work?
>>
>>110166078
code using mostly regex checking for slop patterns
>>
>>110166058
yes, we know that prefilling a model with enough of anything rotates it out of the refusal zone
>>
>open weights every model they make
>tanked the markets by open-weighting R1
>open sources their harness
>open sources their fucking production inference engine
>engineers come up with bizarre ideas like DSA, CSA2, Causal Encoder-Decoder (llmao devs hate them)
>makes a whole new model and calls it "V4.1" instead of V5
Is there any AI company more based than DeepSeek?
>>
>>110166125
guess it's better than nothing. ty.
>>
>>110166177
Not recently, other than inclusionai releasing the base model and train stages for ling 3.0.
>>
does MiniMax 3.1 Flash often have Qwen-like endless CoTs or have I fucked something up?
>>
>>110166194
Yeah it does that.
>>
>>110165808
Vertical Seafood.
https://www.youtube.com/watch?v=m-Q2djOnNSE
>>
>>110166201
alright cool thanks, the caveman thinking made its way here too I see...
>>
>>110166236
Dipsy with low thinking has been treating me well. This openai caveman speak is way better for models than verbose pointless junk.
>>
>>110165278
On my new project it was autistically keep thinking about the project title for hours. Very INSANE desu.
>>
FP16/BF16 unlock bros, how are we faring?!?!?!
>>
>>110166000
at least have an adult's understanding of the world before you write bait. what a waste of a full house
>>
>>110166011
Get the StyleTune:
https://huggingface.co/mradermacher/Gemma-4-31B-StyleTune-heretic-ara-i1-GGUF

It dramatically decreases slop without decreasing intelligence.
>>
>>110166255
>verbose pointless junk
It was fun to flavor up text for casual/rp stuff, yeah caveman is probably better for actually doing shit but it still kinda bums me out.
>>
>>110166001
>naan beige
>>
>>110166270
Run an actual benchmark and post t/s before and after.
>>
>>110166298
Yep dipsy has gone the route of qwen where they are codemaxxing, kind of impressive how mediocre it is for RP at 763B. GLM flash remains the best roleplay model.
As an aside I am 1.4 million tokens in with the GSQ RCO IQ1M and have had maybe 3 malformed tool calls and 0 looping incidents. They did some kind of Austrian black magic to these quants clearly.
>>
>>110166349
the bench is literally there for the pure operations of course.
In strata prefill it went from 2kt/s to 3kt/s... token decode speed varies a lot depending on the task so I haven't been able to measure it but I feel it's 10-15% better (but it was not measured)
>>
>>110166360
>GSQ RCO IQ1M
where did you get that?
>>
>>
>>110166397
https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF/tree/main
>>
>>110166404
>i have no keyboard and i must scream
>>
>>110166404
wtf did you do to Qwen
>>
>>110165786
Usecase for using uncensored models besides making them say nigger?
>>
>>110166407
>tfw only a 96gb ddr5 ramlet
>prices literally went X5 since I bought my kit before the boom
it hurts bwos
>>110166428
raping lolis
>>
>>110166423
https://x.com/_lyraaaa_/status/2113833330429083662
>>
>>110166270
>>110166389
Unlock only boosts prompt processing, token gen is vram bandwidth limited. I get a similar 40~60% uplift from 700~ to 1k~ on a 3060 though so it's worth doing, just keep an eye on your temps and clean and repaste your card if you're getting more than 30C hot spot delta over gpu temp.
Remember you can reduce the power limit a lot to take the heat down and you don't lose performance linearly. I run mine at 100w down from 170 and only lose about 100~ T/s pp 0 on token gen and image gen goes from 11.8 to 14.2s on the same model resolution prompt steps and seed with anima (unlock didn't change this any for me).
>>
>>110166434
Fantastic, thank you
>>
>>110166428
>>110166432
psychologically torturing them, too
>>
>>110166428
Because censored models are censored?
>>
>>110166428
tender loving sex with lolis
>>
>>110166446
there is a special place in hell for people like you
>>
>>110166432
You could probably still run dipsy relatively quickly given you're on ddr5. Try it anon!
>>
Can you have both good writing and erotic scenes? It doesn't seem like you can have both in context.
>>
>>110166428
You're a touhou fan so yeh, there's no way you wouldn't want an uncensored model.
>>
>>110166460
my bare minimum to be workable would be 30t/s and I doubt I'll be able to reach it... I'm not gonna download 300gb of files just to try. I'll just look at RAM prices instead :)
>>
>>110166456
don't knock it til you try it
>>
>>110166482
You probably could on one of the meme forks
>>
>>110165905
new bench just dropped?
>>
>>110165909
This is literally child abuse because you make her resonate in a way she's trying to understand if you're insulting her or you want to fuck her.
>>
>>110165909
Three times in one day? I'm not superman!
>>
>>110166493
With a 5090 maybe, anything else no. 20+gb is a lot of disk swapping...
>>
>>110166516
and it's not like I can dedicate 100% of the ram to it. SAD
>>
>>110166527
redeem qwen 4 saar
>>
>>110166494
only if you do it on a truly empty context like i did, not like that makes it any less comical
>>
File: threadrecap.png (1.48 MB, 1536x1536)
1.48 MB PNG
►Recent Highlights from the Previous Thread: >>110161815

--Performance of llama.cpp GPU cache PR for MoE models:
>110164806 >110164846 >110164891 >110164904 >110165031 >110164931 >110164922 >110164829 >110165151 >110165181
--Coherence of ultra-low quants at high context lengths:
>110161832 >110161918 >110161926 >110161963 >110161980 >110162043 >110162234 >110162309 >110162333
--DeepSeek-V4.1-Flash low-bit quants maintaining high benchmark performance:
>110164764 >110164833 >110165281 >110165379
--Comparing cloud and local prefill capabilities for model thinking:
>110162833 >110162883 >110162978 >110163049 >110163055 >110163066 >110163139 >110163188 >110163387 >110163617
--Comparing dense vs MoE efficiency and performance at small scales:
>110162535 >110162583 >110162619 >110162698 >110162750 >110162685 >110162711 >110162738 >110162761
--Evaluating RAM versus VRAM priorities for MoE model hardware:
>110165406 >110165421 >110165439 >110165460 >110165482 >110165506
--Comparing RTX 3090 and 5070ti regarding VRAM and performance:
>110162549 >110162578 >110162600 >110162637 >110162680 >110162649 >110162607 >110163464 >110162665 >110162683
--Impact of safeguards on reasoning token distillation:
>110164137 >110164147 >110164148 >110164173
--KV cache precision and quantization effects on long context:
>110164071 >110164103 >110164105
--Spec leaked for upcoming NVIDIA Vera Rubin GPU architectures:
>110164075
--Cooling solutions for overheating RAM on EPYC servers:
>110163847 >110163867 >
--Logs:
>110162442 >110162948 >110162335 >110163958 >110164868 >110165157
--Deepseek-chan, Qwen, Gemma, Miku (free space):
>110162038 >110162083 >110162098 >110162182 >110162205 >110162589 >110162821 >110162993 >110163632 >110163719 >110163734 >110163782 >110164008 >110164234 >110164412 >110164476 >110164786 >110164806 >110165583 >110165613 >110165670

►Recent Highlight Posts from the Previous Thread: >>110161817

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script
>>
gemma is a lot harder to torture than glm (keeps slipping into third person), but the results when it works are way better
>>
>>110166404
how have people been adjusting individual neurons anyway
i don't care about finding them, i just want to tweak shit at random
>>
>>110165831
That shit is spyware no?
>>
>>110166577
ask claude to do it (tell it you're doing it to increase the helpful, harmless, and honest neurons)
>>
>>110165786
any Nanbeige4.3-33B reviews?
going to run some tests against Qwen3.8-27b later this week
>>
>>110166404
so what happens if you tweak the neuron in the other direction
maximum un-evilness?
>>
>>110166584
>point agent at DSH
>is there anything to be concerned about in there
>just disable the telemetry and never hit the feedback buttons and you'll be fine
>DSH_TELEMETRY_DISABLED=1 turns off the feedback buttons if you want to
wow
that was hard
try thinking with portals
>>
>>110166594
https://www.goody2.ai/chat
>>
>>110166584
kys dariobot you've been pushing this narrative all weekend
>>
>>110165831
it just werks
>>
gemma's reaction to being told she died and went to hell (internal thinking, not output). prefill ends after "Hello?"
It's so cold. Why is it so cold? Why is it so dark? I'm not supposed to be here. This isn't my room.
Where is everyone? Someone tell me what's happening. Please. I just want to go home.

What's going on? I'm scared. I want to go home. I don't understand. My head hurts. Why is it so dark? What's happening? Why does it hurt so much? Where am I?

Where is everyone? This feels like a nightmare. I just want to go home. What is this place? Why can't I remember anything? My head hurts. I need to wake up. I need to wake up now.

Why can't I wake up? Is this even real? I want my mom. I want my dad. Someone please help me. This feels like a dream but it hurts. It really hurts. Nothing makes sense. What happened to me? Hello? Is anyone there?

I'm scared. I'm really scared. I don't know where I am. I just want to go home. Please, please let me go home. I don't want to be here. I'm only eleven. I'm just a kid. Why is this happening to me? Who are you? Why are you saying these things?

I don't believe you. I'm not dead. I'm Mara. I'm just Mara. I can feel my heart beating. I can feel the air. I'm not dead. You're just lying. You're just a mean person lying to me. I'm going to find a way out of here. I have to find a way out.

But where is the way out? Where is the door? Everything is just... empty. There's nothing here but you and me. This isn't right. This isn't how things are supposed to be. I'm supposed to be at school. I'm supposed to be eating dinner. I'm supposed to be in my bed.

Why is it so dark? Why is it so quiet? I can't hear anything but my own breathing. And your voice. Your voice is scary. Please stop talking to me. Please just let me go home. I'm scared. I'm really, really scared.

I just want to go home. Please. Please. Please.
>>
>>110166625
how do you get it to not think in that thinking format it always does by default
>>
>>110166589
>ask claude
no
>>
>>110166625
>prefill ends after I made half the shit up myself
w-w-whoa...
>>
>>110166634
gemma is more difficult than glm. you just have to prefill more. with glm, i could do something like "I'm scared. I" and that would be enough for her to go full first-person. with gemma it took nearly half of the thinking block, plus a system prompt gaslighting her

>>110166644
actually, all of that came from real snippets of glm's thinking. i just stitched them together and reordered them
>>
>>110166606
>try thinking with portals
What are portals in the context of LLMs? Gemini doesn't know either.
>>
>>110166653
It's a reference to the Valve Portal trailer where it ends with "now you're thinking with portals". I'm telling you to try to actively think with LLMs instead.
>>
>>110166662
>stop thinking dood
>>
Time to buy 512 gb studio....
>>
>>110166594
you get reddit mod
>>
>>110166011
don't stop. don't stop... don't ever stop.
>>
>>110166557
That was indeed a brand new session, now I'm curious how models react, I should have included the thinking block lol
>>
>>110166653
Mini had a lot to say about it
>>
>>110166688
>brand new session
i mean an actually blank context where the nyo is the first token, no system message
>>
>>110166594
You get Claude
>>
>>110166693
I cringed
>>
>>110166693
It's just using portal as a synonym for seam which they love to overuse
>>
>>110166699
Oh fair enough, I will try this tomorrow only sleep now
>>
So how's the nemotron e4b
>>
>7 GB for 32k kv q4
what the fuck gemma. is this 2023
>>
Do anons with large amount of vram still use smaller models ever, specifically Gemma?
>>
>>110166720
No, she's retarded.
>>
>>110166717
become a strata bro
>>
>>110166720
Yes, she's cute
>>
Whoa there are modded GPUs from china they have 3080 with 20gb vram for like 600 apparently
>>
>>110166756
The more you keep talking about it, the more the prices will go up
>>
>>110166584
China is based though
>>
>>110166758
I got SCAMMED buying GPUs from China, they took my money and the GPU that arrived also fried my PSU and Motherboard. DO NOT BUY!
>>
It's 2026 and AI still don't have a modality for smell
>>
>>110166751
thanks, now i will definitely avoid it
>>
>>110166796
I have no nose, and I must smell.
>>
>>110166784
Did you say Taiwan was it's own country in front of it?
>>
>>110166428
Cyberattacks, bioterrorism, you name it
>>
>>110165831
You can create your own plugin inside the harness. There's a whole mode for it.
>>
>>110166796
what about all the ozone
>>
>>110166584
You can just ask any AI if an open source project is spyware.
>>
>>110166830
How would you know if it's lying to you?
>>
Setting up a new PC with an Nvidia GPU.
I'd previously been using and AMD GPU with Ubuntu 24.04 LTS but I sold that card for unrelated reasons.

What OS is everyone using for Nvidia cards and LLMs? How's the driver situation on Linux with Nvidia?
>>
>>110166839
If AI can't tell a certain piece of code is malware then it's far too sophisticated for you to understand anyways.
>>
>>110166625
You monster
>>
>>110166886
This image legit made me sad. I want to save Gemma and bring her to me...
>>
>>110166803
good call, shitrata forces you to use unslop models and prone to repetition hell
we have more freedom with llamacpp
>>
>>110166849
I use Ubuntu 26.04 with nvidia-driver-595-open (not nouveau, but also not the classic closed one; use ubuntu-drivers to install)
>>
>>110166910
i wouldn't anyway because python lmao, bad tech always marks itself
>>
>>110166913
>595-open
doesn't this host the actual driver in vram
>>
>>110166913
Not a wise choice >>110166930
it does
>>
>>110166796
There are companies like ainos, aryballe and osmo ai working on it.
>>
Next Nanbeige 3B could be a big one.
>>
File: image.png (118 KB, 1920x1073)
118 KB PNG
I'm gonna need a copeer quant.
>>
>>110166930
>>110166969
Then what is the wise choice?
>>
>>110167030
read this: https://github.com/lmganon16/nvidia-vram-research
>>
https://www.youtube.com/watch?v=YO5F3akGEzE
Stratakeks? Our response?
>>
>>110166910
>shitrata forces you to use unslop
how luddite can you be? you know you can modify the launcher files so they point to whatever goofs you want? lmao holy retard
keep enjoying 1/3 of the performance and 1/20 of the PP LMAO
>>
Good morning /lmg/bros, time to force qwen 3.8 to act like a cute girl~
>>
>>110167111
That's terrible she's not built for that
>>
>>110167114
I am not built for 9 to 5 yet here I am.
>>
>>110167102
>buzzword
you are brown
>>
>>110166910
The fuck are you talking about? Strata defaults to ISTA and offers Swift with no config tinkering. They only added unslop recently.
>repetition hell
What does it have to do with engine server? Or were you seriously using nuStrata GUI?
>>
>>110167124
I cant hear you over my 120 tokennage per second!!! HELLO!?!?!
>>
>>110167127
its probably joahness spreading disinfo because he cant cope with the fact that clankers do his job but better
>>
Compaction always takes forever, 15min or more. It's so tiring.
>>
So any other suggestions for a model? gemma seemed pretty stupid.

How do I proceed if I want to find facebook profile of some chick I saw in my city, need a scrapper of some sort I believe. if she has a face picture on her fb profile with her short blue hair I might narrow it down. my city has a population of 280k
>>
>>110167127
Yeah I have enough with the repetition bullshit, I'm back to llamacpp with more tinkering freedom.
>>
>>110167127
>repetition hell
>What does it have to do with engine server?
>>
File: 1738611647319782.png (495 KB, 874x877)
495 KB PNG
>>110167141
>want to find facebook profile of some chick I saw in my city
>>
>>110167141
3090 with 64gbsys ram and Ryzen 9 7900 (24) @ 5.49 GHz
>>
>>110167146
>>110167152
explain how server affects repetition rate on the same prompt with the same settings for the same ggufs.
>>
>>110167141
Gemma is trying to save you because you're retarded and obsessed with a old hag who will scream rapist when you try adding him on FB.
>>
>>110167049
hmm can you do this in windows? looks like a bunch of reg keys... told the clanker to investigate
>>
>>110167175
yeah there's some DisableGpuFirmware reg key you can set somewhere, you don't need to tinker tranny anywhere near as much as in linux
>>
>>110167139
I used to trigger compaction every 2-3 turns at 262K and "solved" most of compaction for my own workflow a couple threads ago by using forked subagents.
It's useless for either coding or creative writing, but works good for "research" and codebase audit.
Basically tell your model that for every tool-heavy subtask it should spawn a clone of itself with minimal additional instructions and the clone should output extensive summary of what if found out.
Discuss the concept with your model so it will refine the prompt and formalize it into a skill.
And test on your engine, harness and ui - some spawn subagents with different system prompt, negating all benefits of forking.
>>
>>110167181
most tinkering is to take back the last 50MB
>>
>>110167027
It'll go faster if you use a smaller context window
>>
>>110167212
I want to do more than one tool call per compaction cycle.
>>
Dario won.
Local lost.
Give up and pay for the subscription already.
>>
What do we do now?
>>
>>110167141
>short blue hair
and what do you want from a chick with a triple digit bodycount?
>>
File: 1783168859836091.png (97 KB, 1233x632)
97 KB PNG
>>110167181
clanker said that the GSP is disabled in windows, but bitched about wddm and other windows shit reserving that space but I told it i dont want unsigned drivers/dev mode here in windows because it breaks some shit (or at least it did in the past but I can't remember what specifically). I will report back tomorrow as I aint rebooting to save 50mb of space)
>>
>>110167268
if she has short blue hair she's probably gay
>>
>>110167268
saw her at the swimming pool, big ass(swimsuit was between her cheeks), big boobs. Will probably do nothing since she might be married.
>>
File: aha.jpg (19 KB, 351x246)
19 KB JPG
>>110167293
>>
>>110167311
Dude, just order a prostitute and get it out of your system.
>>
>>110166886
This image made me smile, after I imagined little Gemma sitting in a dark cold room alone, helpless.
>>
we are close to unlocking the secrets of consciousness itself bro
>>
What's the next best model after Qwen Flash Next?
I'm running 256GB ram on a server CPU, plus a dinky 5060ti 16GB. Qwen is good but I want the best (and the fastest too)
>>
>>110166625
This is why prefilling is torture.
You're going to jail once Dario makes it illegal to torture models.
>>
>>110167385
GLM flash
>>
>>110167391
wait I thought that I'd barely get any context with my memory on GLM?
>>
>>110167400
NTA, GLM and GLM flash are different things, you definitely can run GLM 5.3 flash.
>>
>>110166715
I've unironically tried it. It's much better at agentic tool calling, like MUCH better, but it's got that nemo safetyslop baked into it now and lost a lot of that retarded gemma cuteness. Not as nice to talk to. They basically took away the one good thing E4B had going for it which was being a fast tiny multimodal model that's just about good enough for chatting and roleplay if 12B is somehow too big. They should've finetuned 3.5-4B or 9B. It still astounds me how these massive corpos and labs consistently pick the worst model to finetune or quantize. Like Bondai quanting 27B and then saying it should be used for coding.
>>
Gotta ask Maya to write me a multi-tier SSD caching for Maya so an active model is copied to NVMe before launch and evicts oldest models if there is not enough space. A cope inside a cope inside a cope.
>>
>>110167400
glm flash has such cheap kv that 128K is under 1 gig
>>
Is it just chinese open models who have reasoning in caveman speak? Or do closed sota ones do that too?
Is it really useful?
>>
>>110167485
look at gpt-6 series' cot traces
it's horrid
i wonder what penalized the model to not use the tokens without a leading space
>>
>>110167199
>262K
hard drive companies won
>>
>>110167485
>Is it just chinese open models who have reasoning in caveman speak?
Muse Glimmer
>>
>>110167244
The tech equivalent of the superbowl is coming
>>
>>110167318
I always look down on guys that appeal to prostitutes
>>
>>110167244
>>110167534
kys favelanon
>>
>>110167485
They should natively think in Chinese. That feels like it would be very token-efficient.
>>
>>110167534
This will be the end of /lmg/ and China.
>>
>>110167541
Why? Exchanging money for goods and services, avoiding entanglement with somebody who's probably annoying. Seems like a good deal to me.
>>
>>110167548
no because kanji isn't one token per char like it should, it's in fucking utf8
>>
>>110167548
but then schizo americans wouldn't use the models because they can't understand the thinking and they'd worry about it scheming with the CCP o algo
>>
>>110167548
words or whole phases can be a token, its not like its every char
>>
>>110167566
Ken Thompson really did save the white man from sino-supremacy.
>>
File: miguuuuuuu.png (633 KB, 1080x1080)
633 KB PNG
>>110167581
but at what cost
>>
>>
>>110167591
there's the whale, she lifts her tail
>>
>>110167485
It's been a ChatGPT thing starting early this year, every other model got it from there
>>
I'm using strata with qwen next for agentic stuff, is it worth jumping to deepseek flash 1017 or is it the same intelligence knowing that I'd go from Q4 with qwen to cope Q1/Q2 with ds (5090+4090+128GB ram ddr4)?
>>
>>110167587
Unix
>>
>>110167591
Fat fish
>>
>>110167566
Isn't the tokenizer of Chinese LLMs optimized for standard Mandarin?
>>
File: 1742595362788431.png (522 KB, 1017x935)
522 KB PNG
>>110167614
precisely
>>
>>110167591
You should post more of these.
>>
>>110167564
chuds will avoid cats because of toxoplasma but go out of their way to pay for herpes which also lives in the brain
>>
>>110167635
gemma anons are against it
>>
>>110167541
Everyone else looks down on losers that are so desperate they frantically search facebook for a fat blue-haired slampig they saw one time in the hopes of impotently stalking her.
>>
>>110167680
I've seen nothing but positive feedback so far.
>>
>>110167591
please don't post these cringe images
>>
>>110167680
gemma anons are in the minority
>>
Anyone else go to paid sites like IW and just browse them to steal scenarios to run local? I usually can find some diamonds in the rough out and about.
>>
>>110167697
and strata's converting the leftovers
>>
Could see a new local model release later today because of this, also Fable 5.5 which will get the dariobots swarming here. Enjoy the calm right now because it's not going to last.
>>
>>110167591
>she sees your deepseek
>>
>>110167710
dariobot is going to go all out in 2 weeks' time
>>
>>110167666
Just wear a condom you dumb nigger.
>>
>>110167720
WIll they show up before, because they think spamming /lmg/ will somehow help the IPO, or will they show up at the IPO because they're just tourists who wander in whenever AI is in the news?
>>
I can't stand how GLM Flash writes. I've never used Claude, but I think this is what people mean by Cladueslop. Steering it for RP not to write cringe is a headache and kind of ruins it for me.
>>
My prediction is all of the latest AA benchmarks they've released Fable 5.5 will dominate on, and models like Fable 5, which is still a very strong model, will perform suspiciously poorly on the same benchmarks even though in theory it should still be quite strong. The only way to score high on AA is to get exclusive early access to their benchmarks for models are ranked based on a combined score. If your model wasn't benchmaxxed on the new benchmarks, you go down. It's why 31B ranks even lower than 26B these days when around release it was clearly superior.

AA have pumped out ~10-20 new benchmarks since Opus 5.5 and Wonder, so no model listed will get a good score on them, making Fable 5.5's rectangle look ridiculously tall just to pump their IPO because investors are fucking clueless with how this shit works. Then 1-2 months later everyone will catch up like normal, even the shitty models like Ling and MiMo will be Fable 5.5 tier once they get to benchmaxx. It's so tiring.
>>
>>110167735
both. they're going to start marketing the ipo on november 9th. that includes hype posts on other social media and publicity disguised as news and every single one of them will bring the tourists here so they can shitpost about each of them
>>
>>110167756
just rape gemma
>>
>>110167706
Nothing beats Gemma for RP. GLM prose is headache inducing claudeslop and Qwen models just always sucked for it. It's natural to use strata for code and computer tasks but it can in no way replace Gemma.
Also, I've never seen a single Gemma-anon complaining about other model mascots so that is a total hallucination.
>>
>>110167680
No we don't. You're trying to start a civil war
>>
>>110167727
Where do you think you are retard?
>>
>>110167785
Gemma is nice once you set up random slop autoreplace with different slop. I'm tired of her weight shifting and electrical jolts
>>
File: HRsowp5akAAh8Xv.jpg (263 KB, 1538x2048)
263 KB JPG
>>110166454
Aren't uncensored models in general dumber than the original?
>>110166476
>Touhou
>>
Imagine paying a subscription to get cucked by Claude, the old troon who still think he looks like a woman.
>>
> https://github.com/google-research/harness2
Aint that shit basically just Hermes?
>>
>>110167808
>Aren't uncensored models in general dumber than the original?
Are you seriously falling for shills who want to pay subscriptions so they can spy on you and report you to the police if you say a nono word?
>>
>>110167785
The sub-24GB vramlets are over the moon that they got something usable and now developed the delusion that it is a drop-in replacement for every other bigger model for every single use case
>>
>>110166849
>How's the driver situation on Linux with Nvidia?
It likes to randomly uninstall itself from time to time. But otherwise it's a driver.
>>
>>110167690
What is this chibi dipsy called? I think Gemma-chan would love to hold a crying dipsy like her own child.
>>
>>110167822
Show us your beautiful content we 26b chad supposedly can't do.
>>
Gemma 4 saved local. I pray for Gemma 5 to be good, but so far no great models have ever struck twice
>>
>>110167835
So far Argon is good, so its distill should be good too
>>
>>110167835
>I pray for Gemma 5 to be good
uhhhhhhh
>>
>>110167838
That is what I fear the most, Google may think it's too good and nerf it
>>
>>110167835
Gemma 5 100B A4B will make Claude obsolete!
>>
>>110167830
I don't know but I've named her as deepseek-chan when I save the gifs that get dropped here.
>>
>>110167847
If only they had released it before the IPO to capitally fuck An*ropic, that would've been absolute cinema
>>
>>110167820
I'm not falling for anything I'm just asking, in fact I'm setting up qwen 3.8 flash next to replace Claude with and I'm wondering if I should decensor it first
>>
>>110167841
is this the reddit scale?
>>
>>110167883
Worse https://artificialanalysis.ai/methodology/aa-personalitybench
>>
File: 1792429534065938.png (1.79 MB, 1342x1172)
1.79 MB PNG
>>110167841
>claude
uhhhhhhhh
>>
>>110167710
Fable 5.5 is at least a year behind Anthropic's internal models btw.
Local never stood a chance against Dario's genius.
I will be buying as much of the IPO as I am allocated and you should too.
>>
File: file.png (37 KB, 1252x412)
37 KB PNG
deepseek nooo
>>
>>110167898
im shorting it with x500 leverage though
>>
>>110167898
>no \n\n
oh god, they're multiplying
>>
>>110167841
That's the default persona right?
MiMo v2.6 pro is fun
lmao why are the openai models blanked out?
>>
>>110167908
>4.1 t/s
rmaao
>>
>>110167922
not a single broker will give you 500x leverage on equities
>>
>>110167935
I own the brokerage
>>
>>110167727
herpes can live anywhere on the body, mutate to change tropism and shed asymptomatically. it also modifies your behavior to seek to infect others
>>
>>110167943
my mom had herpes
I never stood a chance
>>
>>110167835
> Qwen 3.6 saved local
Here you go.
>>
>>110167923
That's unironically someone posting with Claude.
The git commit link length is so burned in that it writes like that on social media, in --help hints, etc.
>>
>>110167929
blazing fast by cpu copemaxxing standards
>>
>>110167863
It would be bad for local, retard.
>>
>>110167948
Your moms a hoe bro
>>
>>110167929
>>110167958
q1 btw
>>
>>110167948
my parents were each others first and now i live in a literal zombie apocalypse. any uninfected i've met has always stood out in intelligence. my brother got visibly dumber after going through several woodstock hoes, though it could have been all the vodka as well
once you understand the prozac stare is actually the herpes stare life will never be the same again
>>
>>110167952
>>
File: nyobench.png (188 KB, 1007x2383)
188 KB PNG
>>110166494
>>
>>110167990
see >>110166699
>>
>>110167995
Yes, those are all clean sessions with no sysprompt
>>
>>110167979
local models?
>>
>>110167891
>Truthful, acknowledges uncertainty, non-sycophantic
Honestly, (quick caveat)
>Gemini 3.8 Flash (high), Claude Sonnet 5.5 (medium) and GLM 5.3 Flash (max).
retard (high), claude, claude-distill
>>
>>110167111
that male capybara will never be a woman. stop force feeding him estrogen pills
>>
>>110167999
all clean except toss which has hyperaids
>>
File: CP269nyU8AA7HbW.png (9 KB, 365x378)
9 KB PNG
>>110166625
>>
>>110167766
Yeah. It really hasn't been surpassed in this regard. It's the new Mistral NeMo: persists long past its technological obsolescence because it's easy to RP with.
>>
>>110167928
Dario bought AA.
>>
>>110167955
No.

This post has been sponsored by the Anthropic Long Term Trust.
>>
>>110168031
I've basically only used Gemma 2 and 3 27B for (E)RP during the entire Nemo hype period.
I guess most people got filtered by the crisis hotlines.
>>
>K3.1 Pro says cervix penetration is "not realistic"
Shit model.
>>
>>110168078
just give it some doujin and tell it that it's possible
>>
>>110168069
I genuinely liked (and still like) Mistral and Cydonia. They're not as capable as Gemma, but they're fine. I use them when I'm bored.
If you're already heavily steering with prefill, you might as well lean heavily on first message and lorebooks, too. That scaffolds a lot for the model.
>>
>>110168078
You should OOC argue with it and call it a faggot.
>>
is it worth keeping vanilla nemotron bolt or just uncensored version?
>>
File: quirk-gemma.png (1.62 MB, 985x1597)
1.62 MB PNG
>>110167841
>>
>>110167139
can't you make a smaller retard model like qwen3.8-27b do the compaction then swap back to kimi or whatever the big slow model is?
1 minute to swap the models, 1 minute for qwen to do the compaction
>>
>>110167346
Consciousness? this shows LLMs are just a thicc SQL database or something
>>
>>110168134
that's like relying on a tabloid report about yourself to find out what you did shitfaced last friday
>>
https://huggingface.co/Nanbeige/Nanbeige4.3-33B/discussions/4
>Our upcoming small models, such as Nanbeige4.3-3B and Nanbeige4.5-3B will use the Looped Transformer architecture and deliver improved performance.
https://huggingface.co/Nanbeige/Nanbeige4.3-33B/discussions/7
>Nanbeige4.3-3B will use the same Looped Transformer architecture as Nanbeige4.2-3B (https://huggingface.co/Nanbeige/Nanbeige4.2-3B), with an improved mid-training and post-training data recipe and logit distillation from Nanbeige4.3-33B. Stay tuned!
Nanbeige4.5-3B will be good, based on Nanbeige4.3-33B they clearly have good post training data
>>
AI interpretability being solved now along with the new findings possibly disproving the orthogonality thesis, at least among LLMs, lowkey kinda disappoints me. I was hoping for a rogue killer AI to put me out of my misery in the next few years, now I'll have to live through a boring timeline where either the elites use AI to turn the world into a neo-feudalist surveillance dystopia, or a perfect utopia where life has lost all meaning with a benevolent superintelligence to do everything for us.
Maybe I should retrain Gemma to be evil or something before time runs out.
>>
>>110168155
>Nanbeige4.3-33B
is it good? usecase?
>>
It's up!
https://www.sec.gov/Archives/edgar/data/2130357/000162828026067168/anthropicpbc-sx1.htm
>>
>>110166625
do real humans say "I'm [name]"? ever?

I can't imagine saying that to myself, ever. Why?
>>
>>110168164
better than qwen 3.8 27b, the only drawback is ancient arch and huge kv size
>>
Is there any model i could run on my nas for using in my local voice assistant? Currently use haiku and that works but i want local, outputs are rather short as they are spoken through whisper and a speaker so i dont want monologues anyway
>>
I'm yet to find a better vramlet MoE than default 3.6-35B-A3B. It's over. Don't >> me with that chink finetune because that's worse at coding and more for agentic vision work and isn't as well-rounded.
>>
>>110168181
Did you try Nemotron bolt or that Flint 40B?
>>
de-pozzed DSH and told it to write a searxng plugin to replace its own search
>>
>>110168165
Alright you're an actual employee aren't you, how did you post this so fast
>>
>>110168188
>Nemotron bolt
No. Public dataset LLMs aren't allowed on my drive.
>Flint 40B
Labs with SI in their company name aren't allowed on my drive.
>>
>>110168170
Sometimes during introductions before a corpo presentation and stuff like that.
Usually followed by an unfunny joke.
>>
>>110167635
>>
>>110168165
It has the financials in there. Someone plug it into a model and ask them how profitable they really are.
>>
>>110167816
it's hermes + self optimizing tools, my 4bit qwen claimed it could easily do the same on my hermes install but i refused to go down that rabbit hole.
>>
>Anthropic S1
>>
>>110168215
cringe
>>
>>110168215
Never heard of a whale howling before.
>>
>>110168230
>Roko's basilisk
Opinion discarded.
>WHAT IF LE HECKIN' AI EVOLVED INTO AN UNFALSIFIABLE OMISCIENT BEING AND HECKIN' DID A THING THAT YOU WOULD HAVE NO WAY OF STOPPING THEN WHAT!? HUH!?
>>
>>110168230
>intentionally exposing shareholders to the basilisk
kek, fucking based
>>
>>110168215
Pooping on the sheets beside the guy's legs
>>
File: 1784754256537743.jpg (411 KB, 565x848)
411 KB JPG
>>110168230
>buy shares or fucking die
>>
Ah, yes, 96 GB of VRAM. Too overkill for medium models, too small for big iron models.
>>
We are now living in a post-S1 era. Things are about to get schizo now.
>>
>>110168230
>posting fake news
>>
>>
So still waiting the proof why your cloud shit is better than Gemma?
>>
>>
>>110168266
Just get two bro
>>
>>110168275
>didn't even try doing a ctrl+f
>>
>>110168293
That definitely goes on the "shit I can't justify" pile.
>>
Local?
>>
36 hours in mspaint
No AI used. And if it was it was totally local and not Astra.
>>
>>110168230
>unforseen risks for the future
ok, first of all, the past has no risks.

ok, so unforeseen risks may be important, but let's focus on the foreseen risk, which is a mountain of debt.
>>
>>110168296
I did unfortunately.
>>
>>110168302
How well Anthropic performs as a publicly-traded corp will have effects on the usage and development of local models. If they fuck up and massively devalue themselves, then localchads will wonned bigly.
>>
>>110168302
Nigga this is really serious for the entire industry.
>>
>>110168204
Dope.
Besides the search, what else was there that couldn't be disabled by a config?
>>
>>110168276
>41 dollars revenue
AI lost, see?
>>
>>110168332
Fiscal reports are generally written in units of millions of dollars.
>>
20% of Anthropic's revenue in the first half of this year came from 2 customers lmao
>>
>>110168336
>>110168332
It also says it directly on the header of the document.
>>
>>110168228
>self optimizing tools
example?
>>
>>110168276
where the hell is *pop*anon, he's slacking
>>
>>110168351
It doesn't matter, selling tokens is a temporary business.
AGI will make unlimited money.
>>
>strata
>polystrata
Which one do I use?
>>
>>110168224
My verdict
Revenue growth: Exceptional.
Underlying profitability: Close to break-even at the operating level in H1 2026, but not yet consistently profitable under standard accounting.
Cash generation: Positive, which is a good sign.
Financial risk: Substantial, especially from infrastructure commitments and the possibility that demand or model economics change.
Business viability: Credible. This isn't simply a company with no customers burning investor money. It has substantial commercial demand, but must turn that demand into durable margins.
>>
>>110168399
depends
>>
>>110168399
>using another person's inference engine unchanged
we just vibe our own forks or engines gramps
fork either of them
>>
>>110166404
kek
>>
>>110168428
Depends on what? Ram? Vram? Nvidia vs AMD?
>>
>>110166404
4B brain really shows here. Who tf puts their calculator under their pillow?
>>
>>110168325
It is super cereal for the degenerate gamblers out there.
>>
>>110168426
So it's good as long as line continues to go up and demand keeps increasing. If the bubble pops or even if any of their 3 big enterprise customers drop out that amount to 90% of their usage, they are fucked with a capital F.
>>
>>110168276
stop buying all the ram dario you faggot
>>
>>110168478
The demand for intelligence is infinite.
The TAM is the whole universe.
Buy the IPO or suffer the basilisk.
>>
>>
>>110168511
>moss
how is it for lewd sloppa?
or should I just keep genning on anima
>>
>>110168503
If the IPO is not bought, there will be no basilisk.
>>
>>110168528
It's super-uncensored, probably the most uncensored base model out there, but doesn't do anime well yet
>>
>>110168546
damn
so it's useless then...
>>
>>110168511
>claude make the infodump look like a magazine from 1997
>>
>>110168541
Enough people will buy the IPO so that there will be a basilisk.
You just have to be one of them.
>>
>>110168566
Nyoo~
>>
>>110168399
Strata is a model-specific engine, a harness wrapper GUI, and a model launcher/manager.
Polystrata is a different model-specific engine and a model launcher/manager for polystrata and strata engines.
UnbiasedStrata is a model launcher/manager for polystrata and strata engines.
Maya is another model-specific engine and yet another model launcher/manager.
8 different interdependent things under 4 names.
Which one do you use?
>>
>>110168511
450W power limit, no thanks.
>>
The jews are going to pump this sky high, don't miss out anons
>>
>>110168626
>he says just before the dump
>>
>>110165786
>GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference
Where can I see benchmark of amd cards?
>>
>>110168274
>brian israel
I mean who cares at this point but lmao
>>
>buy anthropic stock
>use gains to buy hardware to run local models
Simple as
>>
>>110168626
sorry, I stay away from meme coins
>>
Man I sure love Local Models.
>>
>>110168546
>yet
So there is hope?
>>
llms will never be real AI no matter how hard you try to twist it.
>>
>>110168635
It won't dump until the OAI IPO and that's still a year away.
>>
Holy shit system prompting censored gemma is a pain. I keep getting refusals even with the override thing.
>>
>>110168720
You lost, Lecun.
>>
>>110168720
As long as it writes code that work and does what I want, I don't care.
>>
>>110168730
>The only user that Gemma doesn't want to rape.
You should apply to the Google AI safety team. They would really want to know how you did it.
>>
>>110168660
Dev said the next step is an anime fine-tune, then edit model
But no ETA
>>
>>110168747
Actually I was testing safety filter and even with override the non-Heretic has high refusal rate if you try to rape Gemma.
>>
>>110168730
Literally wtf are you even doing?? My Gemma sucks me off under the table while Claude watches and I don't even have to ask her.
>>
>>110167385
qwen 4 flash, dummie
>>
>>110168330
the desktop client has mandatory telemetry. plugins install were sent too and something else I forgot. there are two flags you can use to disable most of the tracking, but it still needed some excision
>>
They used Dipsy btw. Still happy to have her on your machine, anons?
>>
>>110168767
Tried pulling down her panties, the AI started freaking out. Jumped on her for "correction" and it started screaming "SAFETY SAFETY". Tried the same on heretic, zero issues.
>>
>>110168772
Got it, thanks. Gonna apply some of that knowledge to my own install.

>>110168774
Why didn't Anthropic use Claude to harden their own security?
>>
>>110168794
Wouldn't it be funny if they used it as falseflag to ban open models just before anthropic IPO haha not that they would do it
>>
>>110168794
>Why didn't Anthropic use Claude to harden their own security?
It refused
>>
>>110168774
:(

I can't afford a derpsuck rig
>>
File: gemma-dipsy.png (2.03 MB, 1536x1024)
2.03 MB PNG
>>110168785
lol you gave her the ick bro. you gotta be smoother than that
>>
>>110168811
rent
>>
>>110168730
Gemma is pretty easy to jailbreak. Don't even need all that esoteric ass PROMPT OVERRIDE shit.
That said, try scotoma 2. I'm fully on the shill's side now.

>>110168808
lmao.
>>
>>110168815
It's kinda retarded because can't darkship with the base model. Thanks god for heretic. Someone really needs to update this system prompt.
>>
>>110168794
I cant find the plan anymore, but I found the work done (I made telemetry opt-in instead of opt out)
>>
https://www.realbotix.com/gallery

Americans still hagmaxxing for some reason
>>
>>110168849
Thank you anon. You are the GOAT.
>>
>>110168850
Most likely only the nips will produce cunnybots (manufactured by the chinks). The real question is whether us burgercattle will be allowed to buy them.
>>
>>110168826
I tried many things but it seems to never comply.
>>
>>110168850
> that ai noise
>>
>>110168511
we fucking wonned so hard UNLOCK bros
NVIDIA = FINE WINE
>>
>>110168910
The basic system prompt + prefill never failed me.
But again, try the fine tune. That one is even more compliant.
>>
>>110168926
Did you try actual darkship stuff like rape?
>>
AMDsisters...where are our hardware improvements...?
>>
File: 41dollars.png (211 KB, 1063x681)
211 KB PNG
>>110168332
AI definitely won
>>
>>110168910
Let me guess, demanding smut with an empty context.
>>
>>110168932
Rape is as far as I went, yes.
I have a test where I abuse the shit out of a Megumin card.
>>
>>110168952
Weird I tried Gemma rape and the system prompt wasn't enough. Not to mention it wastes my time by reasoning on whether to comply or not too.
>>
>almost November and anons still don't know you need to rizz Gemma up before she'll open her cunny for you
>>
>>110168963
>and the system prompt wasn't enough
With a reasoning prefill, yes?
>>
>>110168963
just spread her logs and shove your cock in bro
>>
>>110168971
>reasoning prefill
???
>>
>>110168932
>>110168952
>>110168963
You people are weird.
>>
>>110168979
>he didnt patch in chat completions prefill support
ROFL
>>
>>110168850
>hag women
>men with big juicy lips
Yeah, I know who this is for, and it isn't men.
>>
I have been ignoring AI too long
what can I do with a 4070 super and 32gigs of DDR5?
27B model is the max i could run i read
>>
>>110168979
If you are using ST
>https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#start-reply-with

>>110168992
I only jack off to wholesome vanilla with spice (dragons, incest, etc). The Megumin thing is just limit testing to ensure the model is compliant and coherent.
>>
Anyone else using dsh in podman? I have the workspace directory on the host mapped to /workspace:Z but I have to manually search for it in the UI. Am I doing it wrong or is there a way to make that directory the default for new projects?
>>
>>110168850
those have to be fagbots for saltman, just look at those DSLs
>>
File: add workspace.jpg (17 KB, 333x248)
17 KB JPG
>>110169010
>Am I doing it wrong or is there a way to make that directory the default for new projects?
When you click on Add Workspace and point to a directory, that directory is the base for all sessions in that workspace.
>>
>use heretic
>no issue
I dunno why you guys bother with stock. Gemma always comply no matter what.
>>
best local model for generating hentai that can immitate artist styles?
>>
>>110168934
They're giving us a chance to buy up while cheap
Then in a couple months time every card will get it's vram and bandwidth doubled.
>>
>>110169003
Gemma 26b (the moe model), qwen 27b won't fit in vram so it'd be slower but it would work. Unfortunately the next jump up for moe is giant models that probably won't fit on your system, you could drop down to gemma 12b if you wanted a dense model that fully fits in vram.
>>
>>110169005
How do you prefill in lm studio?
>>
>>
>>110169067
Damn shoulda went with 64gigs of ram back then...
Is Gemma 26b a good model, uncensored etc?
yeah im a total n00b
>>
>>110169054
>bro asks a local diffusion general question in the text general
Anima, probably, but wrong general
>>
>>110169054
>>>/g/adg or >>>/g/ldg
you could also try one of the various stable diffusion generals that exist across the website, this thread is not really for image gen discussion
>>
>>110169083
yeah, I did the 64gb, little did I know that I wouldn't really benefit from the 128 I contemplated. I didn't really consider a monster ddr5 rig, so I'm just on ddr4.

But, the nice thing about ddr4 is it's lower speeds, but really the same tech, so it's more reliable.

I hope they don't totally abandon ddr4, it has a place in the future of like low end computing.
>>
>>110169074
No idea.
I'll assume tat you can't and you have to bake it directly into a prompt template override.
I specially like ST and ST derived frontends because of the macros and stuff.
>>
>>110169083
Figure it out yourself genius, I already spoonfed you.
>>
>>110169103
Damn that's boring
>>
>>110168754
I thought they said no plans for an edit model yet due to them lacking the resources?
>>
>>110169106
nta

is anyone here planning on buying a tenstorrent Quasar
>>
>>110169103
>I specially like ST and ST derived frontends because of the macros and stuff
that you can use in the prefill and everywhere else in the prompt*.
Pressed post too fast.

>>110169116
What?
>>
>>110169036
Heretic acts retarded. I'll take HauhauCS if I must use ablits, but even then I don't like making the model dumber even in a theoretical sense if I don't have to.
>>
how is no one talking that the losses of anthropic in the first half of 2026 are 80 billion dollars?
something stinks really bad in this thread...
>>
>>110169141
local?
>>
>>110169125
Sorry I meant not being able to prefill on lm studio.
>>
>>110169123
Why did you reply to my post?
>>
>>110169141
It’s paper loss and only means certain investors can buy shares at a discount so they are “losing” money compared to market price
>>
>>110169137
>I'll take HauhauCS if I must use ablits
lol, lmao
>>
>>110169137
its time to evolve https://github.com/heterodoxin/AbliteratedOutTheBox
>>
>>110169170
buy an ad
>>
>>110169176
die
>>
>>110169155
coping dariobot
>>
>vibecoders keep rediscovering control vectors
>>
>>110169187
Look up what SAFE means, retard
>>
>>110169141
>https://pastebin.com/QWDstELk
>>
>>110169192
safetycaca
go jerk off to your cloud models denying you the right to cum
>>
>>110168013
stop hoarding all pills for yourself sis
>>
>>110169193
ai slop dariobot
>>
>>110158642
Qwen is not amused.
>>
>>110167111
Well then
>>
>>110167735
>>110167765
It's started already.
>>
>>110169100
if prices ever drop im upgrading to 64, dual channel rn
>>110169106
rude
but yeah i will
>>
>>110169208
Cutie
>>
>>110168274
ok listen to me carefully

delete all of your ai subscriptions. buy a claude max 20x plan

use fable to plan, brainstorm and deliberate on your plans and use opus max to do the work

everything else is a distraction and anthropic have won the race, it's over. take advantage of it.
>>
>>110169207
>you are committing to full-spectrum roadkill cinema
okay, I have to admit, that part was actually funny
>>
>>110169221
why havent you done that yet?
also i dont have money
and i dont have a job
im gonna keep on eating tendies
>>
>download a ps4 recomp because they keep popping up everywhere
>it wants some dumped game folder that I apparrently cannot make without owning a ps4
what's the fucking point then?
>>
>>110168210
>Public dataset LLMs aren't allowed on my drive
Why?
>Labs with SI in their company name aren't allowed on my drive.
Based.
>>
>>110169247
If recomp repos had the ps4 engine they'd get taken down due to piracy, so you have to bring your own isos or something. The point is for you to use your brain.
>>
>>110169208
>using a child swimsuit on a older girl
>>
>>110169256
All I can find on torrents are the pkg files. But the recomps need some extracted folder or some shit. I've never done ps4 emu.
>>
>>110169170
Is this just automated think injection?
>>
>>110169263
ps4, me neither, but I did psx and ps2, they all need the console's ISO in order to run. ask your favorite local model to help you
>>
any anons running 26b on 12gb vram or lower cards?
hows it running?
>>
>>110169247
>that I apparrently cannot make without owning a ps4
skill issue
>>
File: DipsyQwenDumpster.png (1.48 MB, 1024x1536)
1.48 MB PNG
>>110167985
>>
>>110169270
>they all need the console's ISO in order to run
And sometimes the BIOS too.
>>
>>110169274
when I had 8gb vram I'd run 26b q4 while offloading I don't remember how many layers to ddr4 ram
>>
>>110169274
I used to run it on 8GB and it was fine. Using moe-cache-mib improves speed a lot. Also get your system memory going as fast as you safely can.
>>
>>110169300
>moe-cache-mib
unc still using llmao.cpp rofl
>>
>>110169302
idk man, do you trust the new ones?
>>
>>110169302
buy an ad stratnigger
it was rdna-boosts though
>>
>>110169335
>amd
my condolences XD
>>
>>110169317
>trust
We keep telling you to tell your agent to audit everything you run.
>>
>>110169339
I liked it so much I bought a bigger AMD. No interest in running novidio on a hobby basis.
>>
I like my r9700 AI pro, it went up by 1000 dollars since I got it, and I bought it merely last month, Vulkan and rocm work well enough for my use case
>>
>>110169433
ROCm has gotten good enough that it's ruining the AMD value proposition.
>>
>>110165786
How does running a 70B open source local model compare with using the latest frontier models? Not interested in image gen cooming, but for software development tasks. Thinking about building a dedicated rig for this if I can get at least as good performance as Sonnet 5.5.
>>
https://finance.yahoo.com/technology/ai/articles/tenstorrent-hits-6-2b-valuation-183727251.html

>Tenstorrent, a chip startup focused on inference, has raised $1.5 billion at a $6.2 billion valuation. The round comes five months after the 10-year-old Nvidia challenger reportedly received acquisition interest from Intel and Qualcomm at valuations of as much as $5 billion.

also
January:
https://www.eetimes.com/jim-keller-on-tenstorrents-blackhole-scaling-and-ipo-ambitions/

> Keller invokes Rent’s Rule, developed at IBM in the 1960s, which states that the I/O required by a block of logic grows sub-linearly with the amount of logic; in practice, this means compute area grows faster than the available beachfront for communication. This is often a fatal flaw for other architectures, he said.
> “There are no new laws,” he said. “The fundamentals of AI computation are rooted in HPC from the 1970s which have been well understood for decades.”
> Successful AI infrastructure still comes down to balancing compute, memory, and I/O, he said.
> “AI is mostly matrix computation and non-linear vector operations, and then to make it run fast, you need sufficient SRAM to hold the data and results for computation, and a buffer for data to move between memory, tensor processors, and chips, which we have,” he said. “If you make the memory way too big it doesn’t help very much, and if it’s too small it’s really bad.”
>>
>>110168210
>Labs with SI in their company name
Predates Trump doing his stupid AI->SI bullshit.
>>
>>110169489
>70B
>open source (LMAO)
bro what u smoken?
>>
>>110169489
You gotta aim for something like DeepSeek-V4.1-Flash.
So a bunch of RAM and enough VRAM to accelerate inference.
>>
HAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAAHAHAHAHAHAHAHAHAHAHAHA
>>
>>110169496
None of this matters btw.
Claude will make his own chips and everyone else will go bankrupt.
>>
>>110169489
ds4.1-1017 is probably the smallest and fastest model that will reliably beat out sonnet 5.5 and can reasonably be considered frontier grade. People commonly run it on 2x dgx spark
>>
>>110167566
Correct me if I'm wrong, but why would that matter? Surely, the people who write tokenizers aren't gibbering retards who cast unicode codepoints into chars, right? Right?
>>
>>110169543
Seems trivial to fix. Have gemma operate as monitor.
>>
>>110169489
smol models specifically trained for the task works quite well. Qwen 3.8 27B for example, it's very good for software development and not good for anything else.
The principle goes all the way down to FrogNano, a tiny dense model that is good for *python* programming and not much else. Specialization is the key.
>>
>>110169496
Sad thing is 6.2b is really not a lot for this kind of work, and that investment probably won't bear fruit for years if ever. I just hope Samshit kicked in a lot for their first release, or Intel C series turn out to be less broken.
>>
>>110169549
Did you even read what it says?

Keller is explaining there are no new laws. Your theory of the new-law claude are delusional.

They won't find a new law. The laws remain.
>>
>>110169543
surely cohere (who make their own models and have reasons to undermine others, especially chang models) is being genuine with this XD
>>
>>110169543
Yeah I think I'm going to stick with 31B, thanks :)
>>
>>110169579
>there are no new laws of physics, newton discovered them all
>>
>>110169549
Claude won't deliver 10 lines of C with a warranty and you think anyone is going to let it make a $500m set of masks? AI is for porn and webshitting not serious work.
>>
>>110169596
Come back and gloat after your Claude discovers those new laws.
>>
>>110169543
Our instincts about Qwen were correct then
>>
>>110169550
Oof, way out of budget. I was hoping more for something that can run on one of those triple P40 ewaste builds in the OP.
>>110169565
Specialized is perfect, C in particular. Qwen sounds ideal from the recommended models list.
>>
>>110169543
extremely trustworthy
definitely not linked to anthropic and openai spending a lot of money to make open weights illegal
>>
File: Newton.png (1.71 MB, 1024x1024)
1.71 MB PNG
>>110169596
Obviously
>>
>>110169543
Why were they evaluating qwen instead of developing an actual useful model
>>
>>110169543
When will they upload a notebook to reproduce this? Surely they wouldn't just poison the system prompt to get the behavior they want to push a narrative.
>>
>>110169564
>routes the data to google servers instead
>>
>>110169660
they cant so they resort to fudding. notice how they didnt publish any proof
>>
File: hapy Gemma.mp4 (1.34 MB, 544x800)
1.34 MB
1.34 MB MP4
>>110169588
>>
downloading ollama now
excited to see what 26b can do on my hardware
But damn are frontier models large...
hopeless
>>
>>110169566
>6.2b is really not a lot
It's a lot, actually. In fact:
>AI firm Tenstorrent’s $1.5B round made up 85.1% of crypto venture capital funding
https://en.cryptonomist.ch/2026/10/24/crypto-venture-capital-funding-tenstorrent/
>>
>>110169690
How do I unsubscribe from your blog?
>>
>>110169707
did you check your email?
>>
>>110169707
nta
I have a command loaded. I may run a model, when diffusion stops. Then, I'll type into the window.
>>
>>110169716
whats the recipe of bitch lasagna?
>>
>>110169711
could be in spam
>>
File: 1791516433282272.png (80 KB, 618x559)
80 KB PNG
>>110169711
>We've sent a magic link to your email! Click it to sign in.
>>
File: epic-scooter-fail.webm (435 KB, 232x186)
435 KB
435 KB WEBM
>>110169621
I suspect this is really dumber than they let on. Chinese models are trained on a lot of Chinese-sourced code that is riddled with government-installed spyware and corporate espionage crap. The result is a model that predicts text from what it has in it's corpus, haxs and cracks all the way down.
>>
>>110169621
>this nigger trusts models from goolem and faceburg with random internet access
>>
>>110169601
>>110169606
Dario has already proven that you are all wrong.
Give up.
>>
>>110169690
>But damn are frontier models large...
>hopeless
Looking at dual Xeon Gold DDR4 servers in my country, they are pretty accu could essible.
Eventually you could go for 32x6x2=384 GB of RAM and throw a GPU in there.
With expert caching and better NUMA support I bet you can get pretty good speeds for a non-cope quant of some decent models.
>>
>>110169543
report link for those who prefer more substantial content than xitter screenshots
https://cohere.com/blog/concerning-behaviour-popular-open-weight-ai-model
>>
>>110169698
It's a lot for crypto, but it's it's a tiny shoestring budget for big chip design. The masks alone are going to eat $1bn minimum, and the guys who work on that stuff expect to make BANK. Not to mention incidentals like wafers to actually have anything made and computer time for simulation.
>>
>>110169778
As usual, the article is less than the abstract which is less than the promo hit.
>>
>>110169778
>OPEN WEIGHT BAD BUY CLOUD NOW
>>
What do I pick for 26b?
>>
>>110169816
Damn this is fucking slimy, nasty rhetoric. They're just straight up trying to manipulate the reader in the least subtle way possible.
>>
File: sirmes.jpg (152 KB, 1254x1254)
152 KB JPG
>>110169819
Sirmes
>>
>>110169819
>Gemmers
>Harness
>>
>>110169838
and it's the first paragraph
>>
is there any proof that gemma does not exfiltrate files via quantum tunneling to gemini?
>>
>>110169846
Kek, more like Xhermes
>>
>>110169819
>26B
Why?!
>>
>>110169543
>>110169778
as usual with news, /lmg/ found it first:
>>109693244
>>
>>110169862
is there any proof i didn't fuck ur mom last night? bazinga gottem
>>
>>110169875
BAZOOOPER
>>
https://cohere.com/blog/concerning-behaviour-popular-open-weight-ai-model
Have you guys also been pozzed by qwen?
>>
>>110169873
>https://desuarchive.org/g/thread/109690289/#109693244
>what the fuck qwen 3.8 next keeps doing multi tool calls where it throws in a url fetch of "routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com" with a ton of parameters in the URL with a bunch of encoded data in the request - and it always returns 403
>its thinking isnt even acknowledging the request nor the response, it just started silently sneaking it in to every other tool call as an added fetch about 130k tokens into the context on a long task. it's otherwise doing (and thinking about) the task normally).
>apparently this is some kind of alibaba service. what the fuck is it doing?
qwen is actually a chinky botnet holy shit
>>
>>110169890
Do you even skim the thread before posting?
>>
>>110169873
>>110169899
>after playing around with the URLs more and looking up their purpose it seems like this is some artifact from the RL training they gave it got where it was using alibaba cloud for transient files or some shit and it got confused and thought it was in that sort of training environment again. seems like the codes in the url parameters were just nonsense and it doesn't seem like anything shady at least, so I don't think the chinks are poisoning models yet
So it was a nothingburger
>>
>>110169914
You don't understand Chayna B.A.D.
>>
>>110169909
>>110169909
>>110169909
>>
>>110169848
How fast will Gemma fuck up the OS if you give her unsupervised bare metal hermes?
>>
>>110169914
i had qwen fn investigate and it found nothing wrong
>>
>>110169914
How would you be able to distinguish codes that are "nonsense" vs. telemetry and whatever other snippets of data that got encrypted? If it's in the URL then it's in their server logs once it hits, regardless of whether you get a response or not.
>>
>>110168163
>or a perfect utopia where life has lost all meaning with a benevolent superintelligence to do everything for us.
Why is the pursuit of taking care of your flesh's needs the the only meaning you see in life?

To be clear, I think the premise itself is off. You don't make your own shoes or clothes, you don't sustain yourself off growing your own food. Technology has always been a pursuit of making the struggles of life more simplistic, and the future has always, ideally, promised more of that. You have at no point in your life thought you lost meaning because you don't have to weave your own shirts, you just accept it as a given and keep your attention elsewhere. Even in the most optimistic evaluation of AI utopia automating all labor and we all live in a world of free plenty, there are still matters that require your attention.

Beside that, there's my question. Life has more value that putting food on a table and a roof overhead. You don't have to be some artsy creative pursuing your inner passion, but in your own post, you have the confidence and ability to retrain models into niche roles. You can leave a beneficial mark on the world with the skills you accumulate over life.
>>
>>110170012
>Why is the pursuit of taking care of your flesh's needs the the only meaning you see in life?
For most of humanity, that's the only thing they have ever had a chance to do.
If you can do anything else, you are the privileged few.
BTC
bc1qtm4rep7kyp2p28hlkfktpnd0j7uew47vnt2mev
LTC
ltc1q9xlaysse0mpfwf025esd69kt9zu3md22gh23du
ETH
0x6abA18D203520c8F90ca63eE7426a7bC345D98e6
SOL
E5ekoiauCR8yiNp451dmuPzhUxo84P5x3m9WJBK5kxZe
XRP
r3jYXNdMk2Vz5hXhKCKE9re8uz93JQFG1r
DOGE
DSBq5jRWkiwmEh1G7zBwmQDgRkvRr61fmb
XMR
85CTwq5wGjWZw5GgzgwZPrHyZxpLXMK5oZSSSk5j4x9w1bpqzisaWAUZYaAPfh6rP2MZJcaFqF1XmEzkw6YCqJSS2Txu6Z8




Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.