Monolith, the in-house cluster researchers can SSH into

From Is NVIDIA’s Moat a Psyop? 28x More Efficient AI Chips on Deeptech Decoded, with Elias Almqvist.

Transcript

Elias Almqvist
Elias Almqvist· Zettascale

Anyone doing any sort of frontier edge AI research? the most people I'm talking to is like, I'm doing this like, and then like biology, like research stuff, whatever. And they're like, ⁓ I'm trying to run this new kind of a model. And it's not really running well because I'm doing this crazy thing. Could you please like, can I try it on your thing? Like people who really need the versatility to be able to scale their models. So most of the like the AI researchers.

Nihal Kurth
Nihal Kurth

Mm.

Elias Almqvist
Elias Almqvist· Zettascale

everyone's doing all these sort of like toy problems and what the missing key part is being able to scale the model to such a like a scale of literal like volume scale in parameters but to a scale where it's actually useful. like chat GPT started off at like GPT like that sort of something like can I can honestly useless but then sort of like someone figured out how to scale it on GPUs and then wow cool now we have

Nihal Kurth
Nihal Kurth

Yeah

Elias Almqvist
Elias Almqvist· Zettascale

a multi-billion dollar, like trillion dollar industry, believe, soon, from that direction alone. And there's, like, this is one direction. There's like hundreds to thousands of new, like, AI papers out there that's yet to be written, yet to be scaled. And those are the sort of people, like, we like partnering with. So yeah, we basically have a list of, like, everyone who's, like, want to test it out.

Nihal Kurth
Nihal Kurth

Mm.

Elias Almqvist
Elias Almqvist· Zettascale

We have our own cluster. We call it the monolith from 2001, that movie, with our prototypes in it. So what we usually do is send us your SSH pop key and just try it.

Nihal Kurth
Nihal Kurth

Have you ever said, we are not a good match? Like, folks reach out to you or you had the conversation and then you realize this is gonna be more like a, loving us rather than contributing.

Elias Almqvist
Elias Almqvist· Zettascale

Yeah, there's been some people like, I'm training this Frontier SLM model. And it's like, yeah, I guess that's cool, but we really want you to be weird and try to do something novel and new. In reality, we do have limited capacity. We have one server rack and we have limited power. So we can't serve a hundred people at the same time until we build our data center, spoiler alert, but.

Nihal Kurth
Nihal Kurth

Hmm. you

Elias Almqvist
Elias Almqvist· Zettascale

That is not to me like, we have to be bit picky. It's... Yeah.

Nihal Kurth
Nihal Kurth

Can you walk us through what exactly, I know you can't reveal everything, but at least if I am today, let's simulate the environment that we are having a conversation, and then you ask me to give it a chance to the scale. Why would I do this? Why would I leave my setup? I have my frustrations, of course, but then there is the over the switch costs. What is the problem that you give me? And also what is the reasoning behind your product that is gonna step by step just get better?

Full transcript

Pull up a chair.

Reason out loud with us.