Microsoft rebuilds kernel switching from C++ to Rust. " to prevent programs from accidentally accessing unintended data from a computer’s memory." Switching to Rust without performance loss.
I jumped to Technofeudalism and agree with the copyright point, but what he says here is contradicted by the Google leaked memo:
If producing a LLM is not so complex, why aren’t we all training our own models? The reason is that training a model like GPT-3 (the engine behind ChatGPT) needs about 355 years on a single NVIDIA Tesla V100 GPU4, so if you want to do this in something like several weeks you need a lot of machines and a lot of electricity. And who has the money to do that? The big tech companies.
What the Google memo says is that the above is being left behind since the model developed by Meta was released and rather than training new models, it’s much more effective and possible to adapt that, using a single laptop in a few hours.
Who is right I don’t know. I’m guessing David will be poking around with this stuff when he gets the time.
Who was it recommended living in interesting times?
40 years ago I was on a project to harden the electronics around laser ring gyro nav systems for the RAF. I left before they got the weight problem sorted - if they ever did.
Very nice, thanks for tipping me off to your previous share, I’d missed it. I hadn’t seen this happening and am particularly happy to see it:
Cheers to that Google employee, and cheers to (the diminishing remnants of) French socialism; 3 million euro of public money was invested in this.
And yes, I agree, the article I shared tends towards caricature, I think the author is excited to make their point and gets a tad carried away. Given the context of all the inflated hype and the sort of tech-bro amnesia when it comes to these kinds of things, I found that to be relatively forgiveable.