Notes

This wee note is about physics results I noticed suggesting it may be possible to greatly reduce the power and water required by datacentres. This is in a field of physics I am not remotely able to verify but I’m keeping an eye on what seems to be happening. Large Language Models are subject to the laws of physics in a bad way, because they use so much electricity and make so much heat. Landauer’s principle ↗ identifies the thermodynamic cost of information erasure, and some later work builds on this to show that computation can avoid erasure through logical reversibility. ...

Random humans and computers Humans are terrible at randomness. If you ask people to write down a list of random numbers the result can usually be shown to not be random at all. Stage magicians and marketing experts exploit our inability to assess how random an event is. But computers, surely they should be random? It sure feels like it when your printer jams. But no, computers are often worse than humans at being random, and that’s a problem. Randomness is exceedingly important to making computers and networks work. ...