I want to believe that the current generation of applications powered by Large Language Model (LLM) don’t represent the height of the state of the art for prediction machines and that no single firm will reach 80% market share and go onto dominate the generative era. I want to believe that the future is quite open, and that these early returns we’ve made in applied machine learning can compound. It’s because I want to believe so much that it’s worth questioning the assumptions. What might cause the future to become closed? Does OpenAI scan its API logs for good ideas? In 2023, a surge of founders developed skins for OpenAI’s ChatGPT. Some based their startup on enabling a user to[…]

Geoffrey Hinton, the father of deep learning, said a few things at the ReWork Deep Learning Summit in Toronto last week. Hinton often looks to biology as a source for inspiration. I’ll share and expand in this post. Hinton started off with an analogy. A caterpillar is rally a leaf eating machine. It’s optimized to eat leaves. Then it turns itself into goo and becomes something else, a butterfly, to serve a different purpose. Similarly, the planet has minerals. Humans build an infrastructure to transform earth into paydirt. And then a different set of chemical reactions are applied to paydirt to yield gold, which has some purpose. This is much the same way that training data is converted into a set[…]

Who do you trust to manage your attention? Because now that the news cycle has surfaced Cambridge Analytica issue – that’s the real thesis question. Let me explain. How the Newsfeed manages your attention I really can’t understate just how powerful amplified engagement really is. When you overlay the like/share verbs on top of a network of individuals who all have something in common, or who procure people who have something in common, you get some pretty strong effects. Don’t believe me? Just check out the clothing in your drawers and the items in your fridge. You, my friend, are an outcome of considerable social contagion effects. Facebook’s newsfeed algorithm shelters you from a power law distribution of content that the[…]

Earlier in the month, I dined under the space shuttle Endeavour with some of the best minds in marketing science. One mind remarked: “That’s why I bring a glossary with me, oh, you want to do supervised learning? Oh you mean regression? Oh, okay, now we can talk… We’ve been talking to managers about these methods for decades, but it’s just suddenly sexy because it’s all machine learning and deep learning and reinforcement learning.” A lot of the math that underlies much of machine intelligence and artificial intelligence is indeed remarketed marketing science. And, hipsterism aside, the annoyance is understandable. Marketing science started out a bit of a revolt against the Mad Men. Some of the early stories feature post-war[…]

You’re going to hear a lot more about Artificial Intelligence (AI) more generally, and Machine Intelligence more specifically. Valuation is the core causal factor. Here’s why: We’ve gotten pretty good at training a machine on niche problems. They can be trained to a point to replace a median-skilled/low-motivated human in many industries. Sometimes they can make predictions that agree with a human’s judgement 85 to 90% of the time, and sometimes, it’s the human that’s causing the bulk of the error to disagree with the machine. We’re confident that we can train a machine to learn a very specific domain. And these days we’re in the midst of that great automation revolution. Most of the organization that build those machines can[…]