It was a pretty lively summer for me, as I was fortunate enough to be invited to a few festivals and talks, all focused on AI. I wanted to share some thoughts and photos from each event to document the fun I had and the wonderful people I met. HowTheLightGetsIn Hay Festival The Institute for … Continue reading A Summer of AI Debates and Talks
Tag: technology
Understanding Transformers via N-Gram Statistics
I released a preprint of my paper Understanding Transformers via N-Gram Statistics last Friday, which provides insights into the ways in which LLM behavior can be described in terms of simple statistical rules. I wrote a detailed X thread summarizing the paper, so I don't have anything else to add to that for now. I'm … Continue reading Understanding Transformers via N-Gram Statistics
Marcus Hutter | Universal Artificial Intelligence and Solomonoff Induction
Marcus Hutter is an artificial intelligence researcher who is both a Senior Researcher at Google DeepMind and an Honorary Professor in the Research School of Computer Science at Australian National University. He is responsible for the development of the theory of Universal Artificial Intelligence, for which he has written two books, one back in 2005 … Continue reading Marcus Hutter | Universal Artificial Intelligence and Solomonoff Induction
Timothy Nguyen 