the picture of that GPU installed on the side of the firewall tunnel reminded myself and my husband of a gadget they would have shown off in the original Batman series.
"Golly gee whilikers Batman, what is this high tech contraption?"
"It's a car tracker my good lad, see how sleek and easy to hide it is?"
I'm surprised that it's pretty much the same as the adapters you can get on aliexpress. Not even a case to protect it from feet in the passenger footwell. Especially compared to the windshield-mount unit, which looks like a very slick product. I suppose they can always improve it if there is interest in this first version.
Very much my own opinion, but this continues comma’s extremely cavalier attitude towards safety. PCIe connectors and GPUs are not vibration rated. What happens when you hit a bad pothole?
Soft disengage -- if the GPU fails it continues to drive via on-device model, alerts the user, and then disengages.
More generally, Comma's safety is handled by a microcontroller. The microcontroller limits steering torque commanded to a safe range for level 2 driver assistance and acts as a watchdog for the rest of the stack. Failure of openpilot causes it to disengage and sound an audible alarm.
I had a similar thought, but I suppose they decided to prioritize price on the assumption that initial adopters are handy enough to fashion an enclosure if they’d like one. Not a terrible assumption.
It’s an incredibly dumb implementation and it feels like yet another case of “AI startup gettin’ while the gettin’s good”. It’s the dotcom bubble all over again. Do anything with AI and people will buy what you’re selling.
The RX 9060 has a TDP of 160W, but that’s the high end of what you can continuously draw from the 12v DC plug in a car, so it looks like they cap it at 100W. It has to be on the floor or under the passenger seat because it has to plug into that 12v outlet that’s usually in the front.
Things will get caught by the fan blades, and passengers will inadvertently kick it. Hopefully suddenly losing connection to the GPU won’t cause the car to hit a pedestrian or anything like that.
wouldn't you also need to worry about the voltage spikes when you're running on battery vs starting the car if you're running an ICE? and would you need to unplug it if you, say, need a jump? feels like you'd also need to install a whole UPS on the other side too if you care about the hardware longevity (not factoring in the sheer amount of dirt/leaves/etc that'll just get caught up in the card itself)
I find comma.ai’s work pretty fascinating compared to the bigger fish in the self-driving world. There’s something quite human about it versus the Waymo’s and Tesla’s of the world.
I’m impressed by tinygrad. Full-featured deep-learning framework with ZERO dependencies, fully hackable, and orders of magnitude fewer LoC than PyTorch.
Want to run Qwen3.8 27B? Download the quantized model from HF, git clone tinygrad, then run `DEV=METAL python3 -m tinygrad.llm --max_context 8192 -m <GGUF File>`. Read the code and experiment - takes 1 minute.
Compare that with PyTorch (great, but almost impossible to comprehend and modify, IMO) or Mojo/MAX (complex and not even fully open source, not to mention that the Modular folks aren’t particularly nice). Tinygrad is a breath of fresh air.
If you're like me and also wondered "huh, what's tinygrad up to?" apparently they now let you place $100,000 USD pre-orders on a $10M shipping container full of GPUs which they say will ship (literally it seems) in 2027.
Did they have an actual metal container sitting outside their office building in San Diego? I would love to see it on the inside kinda like a walk-in tour you get from real estate listings
he bought an empty container and he's looking for someone to build it out.
i ran 7MW and 20,000 gpus in containers in WA for mining eth for many years. it is a bad idea that he's trying to do. but george is george and the hype is real...
Do you have a write-up of this? I enjoy seeing these Playstation/ASIC/GPU mining installations which are usually some combination of incredibly clever engineering and duct tape.
I had my C3X audio device fail a month or so past warranty. It literally couldn't detect the sound card anymore. My car is not supported, and I've been on a fork since the beginning. Few line of code changes to get it working again and it's almost two years in use. And yes, I tried flashing any and all available releases/forks. The sound hardware was not visible in the kernel on all.
I've given up on the latest models and don't bother with the automatic cruise control. But just the lane centering is extremely helpful.
When people ask me about the device, I tell then it's the next version of power steering. And if one has never driven a car without power steering, one may not understand how much easier it makes the drive.
Thought about upgrading to the C4 as the original owner I could trade mine in for a discount. But the first thing I noticed on reddit threads were the C4 H/W failures, and that made me not want to bother figuring out what's needed to get the C4 running on my car. Wish they figured out how to bulletproof the device, would love to add the GPU.
This bridge - does it actually support host PCIe->thunderbolt->PCIe device - my reading of it is that it's just handling USB commands that the bridge is turning into separate PCIe commands to the GPU?
I wonder if it's possible to do link aggregation for x8 lanes to GPU. I have two thunderbolt connections available, each x4. x8 has minimal losses for gaming.
What I tried was based on theory (I haven't seen real device),
bought Oculink dock, connected Oculink to M.2 connector, USB4 M.2 SSD Enclosure to connect to thunderbolt, whole thing costed 150euros :)
Huh intersting that that they don't support any of the european Stellantis brands at all, wonder what they do differently that makes them incompatible.
Probably because they use a bus that's harder to on-the-fly rewrite or because they sign commands.
comma openpilot do its thing by faking stock self driving unit talking to actuators over the in-vehicle network; a modern car is like a bunch of Pi on a LAN hosting microservices, but on a car specific network standard, usually the one called CAN bus, instead of the 802.3 we're familiar with. The manufacturer stock units is usually a camera unit integrated CPU sitting behind a hump behind the rearview mirror. comma devices tap into the cable going in there, sending out fake commands to other computers handling cruise control, brake, steering, blinker... etc.
This can break two ways: some communication standards like FlexRay are harder to tamper and fake, or some newer cars have tightened security clearly in response to comma doing its thing too well, many following the new EU cybersecurity standards which require commands to be signed and/or each of those Pi-like modules to be crypto paired against each others.
I think Stellantis car always had the first of those two issues of having something difficult that are not strictly anti-hacker hostile architecture. But could be both or I could be wrong altogether. The comma devteam seem to like 2015-2019ish hybrids from such brands as Honda, Subaru, Hyundai and Toyota for the presence of the remote control features in the actuator modules && lack of security getting in the way.
From what I understood, when I looked into it a while ago, some car makers use an encrypted ODB2 (needed by Comma.ai to communicate driving instructions).
See for example: https://autel.us/security-gateways/, 'Automakers with security gateways installed include Stellantis (Dodge, Chrysler, Ram, Alfa Romeo, FIAT, and Maserati), Nissan and Infinity, Mercedes-Benz, and Volkswagen and Audi.'
Toyota TSS3 is in fact encrypted; openpilot users who have TSS3 have to manually extract decryption keys from their cars to be able to talk on the CAN bus.
Two things: 1. they have a cheap fuse (cents on the dollar) that’s not automotive-grade so your windshield mounted device fails in hot weather and doesn’t last past the hardware warranty. Known issue, doubt they ever fixed it.
2. 1B parameter model to stay between two lines. Why. Waste of time. Their product hasn’t actually changed in several years because they will never advance past lane keeping SAE Level 2.
I suspect for what they’re selling for $1,000+ these days, could you find a way to do for half? Less than that?
I mean after all, it still runs off a Snapdragon 845.
Nice tech, disappointing limitations and too expensive. The world moved on, Tesla is bad but a Waymo competitor would be more serious than this.
You're not paying $1,000 for a cut down Android when you buy a Comma Four.
What you're buying is an entry ticket to Comma-land — where dozens of car models are supported, pre-made harnesses are just a buy button away, and everything is open source.
If George had chosen to go the closed source route, you might be paying $200 for a locked-down device and $200 every month for a mandatory subscription.
Which one makes you feel better? Comma as a business needs to be able to pay their employees.
> 2. 1B parameter model to stay between two lines. Why. Waste of time. Their product hasn’t actually changed in several years because they will never advance past lane keeping SAE Level 2.
Maybe... you're answering your own question there?
> I suspect for what they’re selling for $1,000+ these days, could you find a way to do for half? Less than that?
Genuine question: does anyone else anywhere sell something like this? An all-in-one retrofitable level 2 self-driving gadget?
the picture of that GPU installed on the side of the firewall tunnel reminded myself and my husband of a gadget they would have shown off in the original Batman series.
"Golly gee whilikers Batman, what is this high tech contraption?"
"It's a car tracker my good lad, see how sleek and easy to hide it is?"
https://blog.comma.ai/img/chestnut/install_footwell.png
The direct eGPU link if you're curious https://comma.ai/shop/chestnut
I'm surprised that it's pretty much the same as the adapters you can get on aliexpress. Not even a case to protect it from feet in the passenger footwell. Especially compared to the windshield-mount unit, which looks like a very slick product. I suppose they can always improve it if there is interest in this first version.
Very much my own opinion, but this continues comma’s extremely cavalier attitude towards safety. PCIe connectors and GPUs are not vibration rated. What happens when you hit a bad pothole?
Soft disengage -- if the GPU fails it continues to drive via on-device model, alerts the user, and then disengages.
More generally, Comma's safety is handled by a microcontroller. The microcontroller limits steering torque commanded to a safe range for level 2 driver assistance and acts as a watchdog for the rest of the stack. Failure of openpilot causes it to disengage and sound an audible alarm.
I had a similar thought, but I suppose they decided to prioritize price on the assumption that initial adopters are handy enough to fashion an enclosure if they’d like one. Not a terrible assumption.
Yeah, of all the parts to leave a out, sorting out a little enclosure is certainly the easiest and most likely to require customization.
It’s an incredibly dumb implementation and it feels like yet another case of “AI startup gettin’ while the gettin’s good”. It’s the dotcom bubble all over again. Do anything with AI and people will buy what you’re selling.
The RX 9060 has a TDP of 160W, but that’s the high end of what you can continuously draw from the 12v DC plug in a car, so it looks like they cap it at 100W. It has to be on the floor or under the passenger seat because it has to plug into that 12v outlet that’s usually in the front.
Things will get caught by the fan blades, and passengers will inadvertently kick it. Hopefully suddenly losing connection to the GPU won’t cause the car to hit a pedestrian or anything like that.
wouldn't you also need to worry about the voltage spikes when you're running on battery vs starting the car if you're running an ICE? and would you need to unplug it if you, say, need a jump? feels like you'd also need to install a whole UPS on the other side too if you care about the hardware longevity (not factoring in the sheer amount of dirt/leaves/etc that'll just get caught up in the card itself)
I find comma.ai’s work pretty fascinating compared to the bigger fish in the self-driving world. There’s something quite human about it versus the Waymo’s and Tesla’s of the world.
If you liked that, you should look into tinygrad
I’m impressed by tinygrad. Full-featured deep-learning framework with ZERO dependencies, fully hackable, and orders of magnitude fewer LoC than PyTorch.
Want to run Qwen3.8 27B? Download the quantized model from HF, git clone tinygrad, then run `DEV=METAL python3 -m tinygrad.llm --max_context 8192 -m <GGUF File>`. Read the code and experiment - takes 1 minute.
Compare that with PyTorch (great, but almost impossible to comprehend and modify, IMO) or Mojo/MAX (complex and not even fully open source, not to mention that the Modular folks aren’t particularly nice). Tinygrad is a breath of fresh air.
"Zero dependencies" except Python, which is a pretty huge dependency.
If you're like me and also wondered "huh, what's tinygrad up to?" apparently they now let you place $100,000 USD pre-orders on a $10M shipping container full of GPUs which they say will ship (literally it seems) in 2027.
They're claiming a lot, but don't have much to show for it
Did they have an actual metal container sitting outside their office building in San Diego? I would love to see it on the inside kinda like a walk-in tour you get from real estate listings
he bought an empty container and he's looking for someone to build it out.
i ran 7MW and 20,000 gpus in containers in WA for mining eth for many years. it is a bad idea that he's trying to do. but george is george and the hype is real...
Do you have a write-up of this? I enjoy seeing these Playstation/ASIC/GPU mining installations which are usually some combination of incredibly clever engineering and duct tape.
i ran 20k of those bc-250's too... but those were in a real dc. nice to see them getting use again.
sorry, no writeup other than what i've posted already.
This article triggered my AI sensitivity. Had to skip the second half.
I had my C3X audio device fail a month or so past warranty. It literally couldn't detect the sound card anymore. My car is not supported, and I've been on a fork since the beginning. Few line of code changes to get it working again and it's almost two years in use. And yes, I tried flashing any and all available releases/forks. The sound hardware was not visible in the kernel on all.
I've given up on the latest models and don't bother with the automatic cruise control. But just the lane centering is extremely helpful.
When people ask me about the device, I tell then it's the next version of power steering. And if one has never driven a car without power steering, one may not understand how much easier it makes the drive.
Thought about upgrading to the C4 as the original owner I could trade mine in for a discount. But the first thing I noticed on reddit threads were the C4 H/W failures, and that made me not want to bother figuring out what's needed to get the C4 running on my car. Wish they figured out how to bulletproof the device, would love to add the GPU.
This bridge - does it actually support host PCIe->thunderbolt->PCIe device - my reading of it is that it's just handling USB commands that the bridge is turning into separate PCIe commands to the GPU?
I wonder if it's possible to do link aggregation for x8 lanes to GPU. I have two thunderbolt connections available, each x4. x8 has minimal losses for gaming.
What I tried was based on theory (I haven't seen real device), bought Oculink dock, connected Oculink to M.2 connector, USB4 M.2 SSD Enclosure to connect to thunderbolt, whole thing costed 150euros :)
Huh intersting that that they don't support any of the european Stellantis brands at all, wonder what they do differently that makes them incompatible.
Probably because they use a bus that's harder to on-the-fly rewrite or because they sign commands.
comma openpilot do its thing by faking stock self driving unit talking to actuators over the in-vehicle network; a modern car is like a bunch of Pi on a LAN hosting microservices, but on a car specific network standard, usually the one called CAN bus, instead of the 802.3 we're familiar with. The manufacturer stock units is usually a camera unit integrated CPU sitting behind a hump behind the rearview mirror. comma devices tap into the cable going in there, sending out fake commands to other computers handling cruise control, brake, steering, blinker... etc.
This can break two ways: some communication standards like FlexRay are harder to tamper and fake, or some newer cars have tightened security clearly in response to comma doing its thing too well, many following the new EU cybersecurity standards which require commands to be signed and/or each of those Pi-like modules to be crypto paired against each others.
I think Stellantis car always had the first of those two issues of having something difficult that are not strictly anti-hacker hostile architecture. But could be both or I could be wrong altogether. The comma devteam seem to like 2015-2019ish hybrids from such brands as Honda, Subaru, Hyundai and Toyota for the presence of the remote control features in the actuator modules && lack of security getting in the way.
From what I understood, when I looked into it a while ago, some car makers use an encrypted ODB2 (needed by Comma.ai to communicate driving instructions).
See for example: https://autel.us/security-gateways/, 'Automakers with security gateways installed include Stellantis (Dodge, Chrysler, Ram, Alfa Romeo, FIAT, and Maserati), Nissan and Infinity, Mercedes-Benz, and Volkswagen and Audi.'
None of those busses are encrypted (at least not the majority I am familiar with). The security gateway is just a firewall.
Toyota TSS3 is in fact encrypted; openpilot users who have TSS3 have to manually extract decryption keys from their cars to be able to talk on the CAN bus.
How abhorrent and disgusting of Toyota! >:^(
Presumably it is just that no one has tried to do it all the way yet.
But i know there is some experimental work out there.
https://x.com/comma_ai/status/1956879764829995394
They boast a "one year hardware warranty" (EU mandatory minimum is two) so I don't think they're targeting the European market directly right now.
They support Skoda which is not availabe in the US. Otoh VAG brand so it shares the same platform as Volkswagen which is available there
Didn't George quit comma.ai?
Good, something that is needed for running LLMs and other non-LLM based deep learning work that doesn't suck or has poor drivers / firmware for.
I can rest assured that when I use this on any machine running Mac, Windows or Linux, I know it just works well with tinygrad.
Two things: 1. they have a cheap fuse (cents on the dollar) that’s not automotive-grade so your windshield mounted device fails in hot weather and doesn’t last past the hardware warranty. Known issue, doubt they ever fixed it.
2. 1B parameter model to stay between two lines. Why. Waste of time. Their product hasn’t actually changed in several years because they will never advance past lane keeping SAE Level 2.
I suspect for what they’re selling for $1,000+ these days, could you find a way to do for half? Less than that?
I mean after all, it still runs off a Snapdragon 845.
Nice tech, disappointing limitations and too expensive. The world moved on, Tesla is bad but a Waymo competitor would be more serious than this.
You're not paying $1,000 for a cut down Android when you buy a Comma Four.
What you're buying is an entry ticket to Comma-land — where dozens of car models are supported, pre-made harnesses are just a buy button away, and everything is open source.
If George had chosen to go the closed source route, you might be paying $200 for a locked-down device and $200 every month for a mandatory subscription.
Which one makes you feel better? Comma as a business needs to be able to pay their employees.
Comma-land?
Comma on, man.
> 2. 1B parameter model to stay between two lines. Why. Waste of time. Their product hasn’t actually changed in several years because they will never advance past lane keeping SAE Level 2.
Maybe... you're answering your own question there?
> I suspect for what they’re selling for $1,000+ these days, could you find a way to do for half? Less than that?
Genuine question: does anyone else anywhere sell something like this? An all-in-one retrofitable level 2 self-driving gadget?
There are clone devices but nothing else I’m aware of