Thumbnail for Gemma 4 on the iPhone (local AI, no internet required) by NetworkChuck

Gemma 4 on the iPhone (local AI, no internet required)

NetworkChuck

2m 3s418 words~3 min read
Auto-Generated

[0:00]Okay, you can now run local AI models on your phone. Watch this. We're gonna go in airplane mode. And we're going to launch the AI Edge gallery from Google. It's from this app that we can actually download and run Gemma 4. Now, what is that? This is Google's new open source AI models, completely local. And while they do have some bigger ones, they made some models that can run on a phone, the effective 2 billion and 4 billion models. Let's try them out. Now, I'm running on an iPhone here, and I did download these before putting myself into airplane mode, and we can ask it a question. Now, that's crazy fast, and with the craziest part about this is that there's no internet happening here. It's not talking out to any server. All this inference, all this compute is happening on my phone. We'll try a bigger model, the effective 4B. And this is just as fast. Now, this is not the craziest thing you can do here. If I go back here a bit, I can do images, like check this out. We'll do the effect of 4 billion for this one. I'll add an image. For example, I'm in Japan right now, and let's see if it can tell me what this is.

[1:03]Haha. Okay, so just think about that for a second. You arrive in Japan, foreign country, don't have internet on your phone, don't have cellular service, but you have a local AI model, and you can just simply do this. There's no internet happening. You can also do audio. I haven't tried this yet. Hey, I'm recording some audio to test some things. Do you work? Okay.

[1:24]It does. And this one's a little creepy. They have a mobile actions model, which is not related to Gem of 4. But watch this. Turn on my flashlight. Haha. Turn it off. So I don't know about you, but this gets me so excited about edge AI computing, where we can actually run real AI models that can actually do things that aren't useless on our phones. Have you tried this yet? Seriously, go download the Google AI Edge gallery. I'm not sure what you need as far as phone hardware to run it. This is an iPhone, latest model, but I'm seriously impressed by this. And if you want to learn more about local AI models and how to host more yourself, subscribe. I talk about this stuff all.

Need another transcript?

Paste any YouTube URL to get a clean transcript in seconds.

Get a Transcript