Monolith, the in-house cluster researchers can SSH into
From Is NVIDIA’s Moat a Psyop? 28x More Efficient AI Chips on Deeptech Decoded, with Elias Almqvist.
Transcript

Anyone doing any sort of frontier edge AI research? the most people I'm talking to is like, I'm doing this like, and then like biology, like research stuff, whatever. And they're like, ⁓ I'm trying to run this new kind of a model. And it's not really running well because I'm doing this crazy thing. Could you please like, can I try it on your thing? Like people who really need the versatility to be able to scale their models. So most of the like the AI researchers.
Mm.

everyone's doing all these sort of like toy problems and what the missing key part is being able to scale the model to such a like a scale of literal like volume scale in parameters but to a scale where it's actually useful. like chat GPT started off at like GPT like that sort of something like can I can honestly useless but then sort of like someone figured out how to scale it on GPUs and then wow cool now we have
Yeah

a multi-billion dollar, like trillion dollar industry, believe, soon, from that direction alone. And there's, like, this is one direction. There's like hundreds to thousands of new, like, AI papers out there that's yet to be written, yet to be scaled. And those are the sort of people, like, we like partnering with. So yeah, we basically have a list of, like, everyone who's, like, want to test it out.
Mm.

We have our own cluster. We call it the monolith from 2001, that movie, with our prototypes in it. So what we usually do is send us your SSH pop key and just try it.
Have you ever said, we are not a good match? Like, folks reach out to you or you had the conversation and then you realize this is gonna be more like a, loving us rather than contributing.

Yeah, there's been some people like, I'm training this Frontier SLM model. And it's like, yeah, I guess that's cool, but we really want you to be weird and try to do something novel and new. In reality, we do have limited capacity. We have one server rack and we have limited power. So we can't serve a hundred people at the same time until we build our data center, spoiler alert, but.
Hmm. you

That is not to me like, we have to be bit picky. It's... Yeah.
Can you walk us through what exactly, I know you can't reveal everything, but at least if I am today, let's simulate the environment that we are having a conversation, and then you ask me to give it a chance to the scale. Why would I do this? Why would I leave my setup? I have my frustrations, of course, but then there is the over the switch costs. What is the problem that you give me? And also what is the reasoning behind your product that is gonna step by step just get better?


