Sitemap - 2023 - The Gradient

2023 in AI, with Nathan Benaich

Mini-Update #32: Child Sexual Abuse Material in LAION-5B and ControlRoom3D

Kathleen Fisher: DARPA and AI for National Security

Update #65: Foundation Models in Robotics and AI in the Media

Salmon in the Loop

Peter Tse: The Neuroscience of Consciousness and Free Will

Mini-Update #31: EU AI Act and Emu

Article Early Access | Salmon the Loop

Vera Liao: AI Explainability and Transparency

Update #64: Trouble at Sports Illustrated and Extractable Memorization in LLMs

Thomas Dietterich: From the Foundations

Mini-Update #30: OpenAI Updates and GAIA

Update #63: AI Brings Oxygen to Mars and Pretraining Data Mixtures

Martin Wattenberg: ML Visualization and Interpretability

Mini-Update #29: Grok and NOIR

Laurence Liew: AI Singapore

Update #62: The Generative AI Paradox and New AI Bills

Michael Levin & Adam Goldstein: Intelligence and its Many Scales

Jonathan Frankle: From Lottery Tickets to LLMs

Update #61: AI in Smartphone Cameras and MatFormer

Nao Tokui: "Surfing" Musical Creativity with AI

Mini-Update #28: Problems with AI Chatbots and Language Models as Analogical Reasoners

Neural Algorithmic Reasoning

Divyansh Kaushik: The Realities of AI Policy

Article Early Access | Neural Algorithmic Reasoning

Update #60: Wearable AI and Efficient Streaming Language Models

The Artificiality of Alignment

Tal Linzen: Psycholinguistics and Language Modeling

Mini-Update #27: Meta's ChatGPT Competitor and ViTs' Need for Registers

Article Early Access | The Artificiality of Alignment

An Introduction to the Problems of AI Consciousness

Kevin K. Yang: Engineering Proteins with ML

Article Early Access | An Introduction to the Problems of AI Consciousness

Update #59: Generative AI in the Classroom and Next-Token Predictors as Universal Learners

Arjun Ramani & Zhengdong Wang: Why Transformative AI is Really, Really Hard to Achieve

Mini-Update #26: Schumer's AI insight forum and PagedAttention

Miles Grimshaw: Benchmark, LangChain, and Investing in AI

Update #58: Hidden Meme Messages & LLMs as Optimizers

30K Subscriber Special: The Gradient Editors on Grad School

Text-to-CAD: Risks and Opportunities

Shreya Shankar: Machine Learning in the Real World

Article Early Access | Text-to-CAD: Risks and Opportunities

Mini-Update #25: ChatGPT Enterprise and StableVideo

Stevan Harnad: AI's Symbol Grounding Problem

Update #57: AI Powers Accessibility Tech and Faith & Fate: Limits of Transformers on Compositionality

Terry Winograd: AI, HCI, Language, and Cognition

Mini-Update #24: New York Times vs. AI Vendors and VisIT-Bench

Gil Strang: Linear Algebra and Deep Learning

Update #56: Artificial Intimacy and Faithfulness in Chain-of-Thought Reasoning

Anant Agarwal: AI for Education

Mini-Update #23: AudioCraft and DeepSpeed-Chat

Raphaël Millière: The Vector Grounding Problem and Self-Consciousness

Update #55: Hollywood on Strike and RetNet

Peli Grietzer: A Mathematized Philosophy of Literature

Mini-Update #22: Testing Google's Medical AI Chatbot and Llama 2

Ryan Drapeau: Battling Fraud with ML at Stripe

Update #54: Will Steam Publish Games Made with AI? and Long Transformers

Shiv Rao: Enabling Better Patient Care with AI

Interpretability Creationism

Mini-Update #21: NYC’s Anti-Bias Law and Transformers Meet Directed Graphs

Hugo Larochelle: Deep Learning as Science

Update #53: Autonomous Robotaxi Issues and Scaling MLPs

Jeremie Harris: Realistic Alignment and AI Policy

Mini-Update #20: Nvidia-Snowflake Partnership and Predicting Hit Songs

Why transformative artificial intelligence is really, really hard to achieve

Antoine Blondeau: Alpha Intelligence Capital and Investing in AI

Update #52: The Ironies in Pausing AI and Finetuning LLMs without Backpropagation

Joon Park: Generative Agents and Human-Computer Interaction

Mini-Update #19: AI Risk Letter and AlphaDev

Christoffer Holmgård: AI for Video Games

Update #51: ChatGPT-hallucinated Briefs in Court and Voyager

Riley Goodside: The Art and Craft of Prompt Engineering

Mini-Update #18: EU AI Act Targets Open-Source Software and Snowballing Language Model Hallucinations

Modern AI is Domestification

Talia Ringer: Formal Verification and Deep Learning

Update #50: China Semiconductor Sanctions and The State of Multimodal Models

Brigham Hyde: AI for Clinical Decision-Making

Mini-Update #17: Geoff Hinton Leaves Google and a Foundation Model for Single-Cell Multi-omics

Scott Aaronson: Against AI Doomerism

Update #49: Fundamental Limitations of Alignment in LLMs and EU/US Approaches to AI

Sigmoid Social is 6 Months Old!

Ted Underwood: Machine Learning and the Literary Imagination

Mini-Update #16: Stack Overflow Charges for Data and High-Resolution Video Synthesis

In-Context Learning, In Context + Author Q&As

Irene Solaiman: AI Policy and Social Impact

Update #48: Generative AI in Law & Art and Promptable Vision Models

Software²

Drago Anguelov: Waymo and Autonomous Vehicles

Mini-Update #15: Canada's OpenAI Probe and Consistency Models

Grounding Large Language Models in a Cognitive Foundation

Joanna Bryson: The Problems of Cognition

Update #47: AI Index Report Highlights and Text-to-3D

Daniel Situnayake: AI on the Edge

Mini-Update #14: Midjourney Abuse and BloombergGPT

Soumith Chintala: PyTorch

Update #46: GPT-4 and Modular Reasoning for Visual Question Answering

Sewon Min: The Science of Natural Language

Mini-Update #13: OpenChatKit and CNNs + Tuberculosis

Richard Socher: Re-Imagining Search

Update #45: Baidu's ChatGPT Rival and Machine Love

Joe Edelman: Meaning-Aligned AI

Mini-Update #12: Planning for AGI and Images as Sets of Points

Ed Grefenstette: Language, Semantics, Cohere

Update #44: Challenges for Personal Robotics and Cheaply Poisoning Web-Scale Datasets

Ken Liu: What Science Fiction Can Teach Us

Mini-Update #11: Bing off the Rails and Discovering Optimization Algorithms

A 20k Subscriber Thank You

Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs

Update #43: Propaganda Deepfakes and Transformers get Loopy

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science

Mini-Update #10: MusicLM and ChatGPT Detection

Steve Miller: Will AI Take Your Job? It's Not So Simple.

Update #42: AI + News Editors Make Mistakes and New Masked Image Self-Supervised Methods

Blair Attard-Frost: Canada’s AI strategy and the ethics of AI business practices

Mini Update #9: AI for Protein Creation and Electronic Health Records

Reasons to Punish Autonomous Robots

Do Large Language Models learn world models or just surface statistics?

Linus Lee: At the Boundary of Machine and Mind

Update #41: ChatGPT Bans and Robot Manipulation with Multimodal Prompts

Suresh Venkatasubramanian: An AI Bill of Rights

Mini-Update #8: Google in Code Red and VALL-E

Pete Florence: Dense Visual Representations, NeRFs, and LLMs for Robotics

Update #40: AI's Year in Review and In-Context Learning as Gradient Descent