92 points tejaskumar__ 3 hours ago 67 comments
sajithdilshan 2 hours ago | parent
Then what does it good at? Sending faxes?
skrebbel 1 hour ago | parent
sajithdilshan 57 minutes ago | parent
moooo99 40 minutes ago | parent
stogot 1 hour ago | parent
mhitza 1 hour ago | parent
m00dy 56 minutes ago | parent
pettijohn 31 minutes ago | parent
martianvoid 1 hour ago | parent
Its speed is pretty good on the other hand with only 3B active parameters I am getting around 170 tkn/s on fp8
gizajob 1 hour ago | parent
Yeah. It’s a German model.
rubyfan 1 hour ago | parent
sajithdilshan 58 minutes ago | parent
hypfer 50 minutes ago | parent
dudefeliciano 42 minutes ago | parent
tzatzikyyy 45 minutes ago | parent
9dev 1 hour ago | parent
gchamonlive 48 minutes ago | parent
What matters is to have good sovereign models in 5, 10, 20 years time.
roncesvalles 41 minutes ago | parent
hypfer 40 minutes ago | parent
The next thought is culture-specific workflows, requirements etc that are best trained into weights by people that actually understand those needs.
gchamonlive 38 minutes ago | parent
Society can't depend on the whims of the private sector.
HotHotLava 28 minutes ago | parent
But I don't see why this needs to be done on a state-by-state level, a sovereign EU model seems to be much more realistic in terms of funding.
stefs 22 minutes ago | parent
HarHarVeryFunny 16 minutes ago | parent
Not all needs are going to be met by using or finetuning general purpose models, so ability to build your own SOTA ML models (LLMs or not) is also important.
mistrial9 11 minutes ago | parent
9dev 36 minutes ago | parent
KronisLV 34 minutes ago | parent
I mean, given the fuel prices it would be very nice, alongside more charging infrastructure in the EU. :(
Not to detract from the overall point, though to be honest, it's probably worthwhile to do improvements and refinements with the current technology, even if the future holds something vastly different. Both cause of gaining expertise and also maybe an improvement or two along the way, that might carry forward.
Like I haven't seen many steam locomotives around and for me the difference between saturated steam engines and superheated ones isn't very material in regards to transportation, but the latter is used in modern turbines.
gchamonlive 33 minutes ago | parent
mmasu 30 minutes ago | parent
HotHotLava 24 minutes ago | parent
HarHarVeryFunny 11 minutes ago | parent
AI is here to stay - will be around for hundreds/millions of years. Whether company A is a few years ahead of company B is irrelevant. In 10 years time company A, who started the industry, may be gone completely - also irrelevant.
rjzzleep 12 minutes ago | parent
driverdan 54 minutes ago | parent
Lucasoato 49 minutes ago | parent
This means that it’s always on time, it uses acronyms for everything and when there’s a decision to be made, it sets up a committee.
stymaar 31 minutes ago | parent
Tell that to Deutch Bahn.
sbinnee 19 minutes ago | parent
hliyan 15 minutes ago | parent
rererereferred 4 minutes ago | parent
api 49 minutes ago | parent
One of humanity’s biggest problems here is we don’t know how to do moderation.
We have two modes. One is a brick taped to the accelerator and damn all consequences, driven by national pride or corporate greed or egos. The other is a brick taped to the brake driven by histrionic doomers and anti-everything pessimists.
The extremes are loud and fit in a tweet. Nuance is quiet and contemplative and usually requires an essay or a book. It’s also dynamic. Nuanced positions evolve over time as new things are learned. Extremes tend to be fixed and rigid. All this, I think, gives them higher memetic fitness in the discourse.
I don’t think this is new. Look at nuclear power, a largely pre-Internet example. You had pro nukes who minimized and hand waved away any risk and anti nukes that wanted it utterly outlawed. Nobody said “hey this is a great zero carbon source of energy but we really need to think it through carefully and manage it well.” Or if they did they were drowned out by the loud screaming extremes.
x1watt 45 minutes ago | parent
flohofwoe 35 minutes ago | parent
veryfancy 22 minutes ago | parent
hypfer 17 minutes ago | parent
But anyway. I think the main oversight when dismissing this is that not every use-case is coding a SV-style startup app. That market is quite saturated, so it would make sense to create something locally for the use-cases currently underserved by LLMs.
We will probably learn more about what this can really do once quants become available that can be run by people without an SV salary (and the biases that come with that).
spijdar 17 minutes ago | parent
I get that doesn't invalidate the real "point" of the model, but...
niemandhier 10 minutes ago | parent
Right now one could run an open model for most government applications and it would be good enough, you just cannot trust any of these.
So having a sovereign controlled model audit the first one would basically act like a “trust adapter”.
If the second model is cheap and fast enough, there is a business model.
You don’t even need to audit all the intermediate steps, just tool calls and end results.
holaysuns 7 minutes ago | parent
Since no individual buyer cares that much about geostrategic issues, it's almost impossible to get some random European company to think about buying anything other than 'whatever US or China' are making.
There has to be very concerted push to make a difference.
Legal mandates around sovereignty (be very careful here) could make a difference.
But there will also be market reaction: US/China companies will bend on some level and provide things like 100% EU hosted and even comply with some data source stuff.
The only real path is to be more competitive as a continent.
CorezIoOfficial 9 minutes ago | parent