Archive - The Update of The Gradient

Update #40: AI's Year in Review and In-Context Learning as Gradient Descent

Selected trends from a speedy year in AI, and the relationship between in-context learning and gradient descent

Jan 3, 2023 •

,

, and

Update #69: Gemini Overcompensates for Bias and Missing Details in Sora

Gemini sparks AI culture wars and OpenAI releases a state-of-the-art video generation model.

Feb 27, 2024 •

,

, and

Update #83: AI Music Fraud and PlanSearch

We look at the mechanics of AI-assisted music streaming fraud; researchers develop a new algorithm for LLM code generation that leverages inference time…

Sep 11, 2024 •

Update #75: A Bad Week for AI Worriers, and The Platonic Representation Hypothesis

Schumer Shafts the AI Bias Crowd While Altman Alienates AGI’ers; MIT researchers think model representations in models are converging (to what?).

May 21, 2024 •

and

Mini-Update #40: NIST Launches GenAI and Lifelike Facial Mimicking

The National Institute for Standards and Technology begins evaluations on generative AI and Microsoft launches VASA-1, which produces realistic talking…

May 1, 2024 •

and

Update #70: Apple Shutters Autonomous EV Project and Griffin + Hawk Compete with Transformers

Apple terminates Project Titan and redirects resources to generative AI, and researchers propose two RNN-based architectures in the SSM line of work…

Mar 12, 2024 •

and

Update #81: The EU AI Act's Enforcement and Self-Taught Evaluators

Welcome to the 81st update from the Gradient!

Aug 13, 2024 •

and

Update #74: Detecting Postpartum Depression and Kolmogorov-Arnold Networks

We look at Dionysus Digital Health's new ML system for detecting postpartum depression in expectant or new mothers; Kolmogorov-Arnold Networks are…

May 7, 2024 •

and

Update #66: SAG-AFTRA's Voice Cloning Deal and Sleeper Agents

Replica offers voice cloning with support from SAG-AFTRA, and Anthropic researchers train deceptive LLMs that persist through safety training.

Jan 16, 2024 •

,

, and

Update #82: AI Lawsuits and SOPHON

We look at the numerous ongoing lawsuits against AI giants; researchers develop a method to address the risk of pre-trained models being repurposed for…

Aug 27, 2024 •

,

, and

Update #72: NYC's Unfortunate Chatbot and Mixture-of-Depths

NYC's My City Chatbot makes concerning suggestions to users and DeepMind introduces a novel method for optimizing the resource allocation in transformer…

Apr 9, 2024 •

,

, and

Update #80: Kamala Harris's AI Policy and End-To-End Causal Effect Estimation from Unstructured Natural Language Data

We look at Harris's stances on AI regulation; researchers introduce the NATURAL framework for causal effect estimation.

Jul 30, 2024 •

,

, and

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts