The Carousel
The Carousel Podcast
76. Brian Chau
1
0:00
-1:31:04

76. Brian Chau

Not a Stochastic Parrot
1

It’s the AI Episode. DC AI policy guy Brian Chau convinces me, an AI skeptic, that machine learning actually is all it’s cracked up to be.

The key lay in Brian’s description of gradient descent, the so-called “workhorse behind machine learning.”

Basically, gradient descent is how you teach a computer through mathematics to climb or descend a linear hill. Sort of how you give the computer the ability to “see” in the right direction. The computer responds to right and wrong inputs by creating its own vast calculus that humans can’t reproduce—in that sense it really does form its own “impressions” and “ideas” about how to respond in certain scenarios. It is thus more than just “glorified autocorrect” or a “stochastic parrot”—just a probabilistic word/image calculator—which is what I had thought beforehand based on articles like ChatGPT is a Blurry JPEG of the Web.

Here are some of the other articles discussed:

A Visual Example of Interpretability: https://openai.com/research/microscope…

Brians’s article explaining transformers:

From the New World
Why it’s easy to Brainwash ChatGPT (AI series, Part 2)
OpenAI is a company which produces state of the art machine learning models used to answer language-based prompts (ChatGPT, GPT3), generate images (DALLE), and perform a variety of other tasks. These models have plenty of commercial applications and can be expected to automate parts of many industries. Its …
Read more

FTC statement: https://ftc.gov/news-events/news/press-releases/2023/11/ftc-authorizes-compulsory-process-ai-related-products-services…

Biden executive order: https://whitehouse.gov/briefing-room/statements-releases/2023/10/30/fact-sheet-president-biden-issues-executive-order-on-safe-secure-and-trustworthy-artificial-intelligence/

Brian’s AI policy think tank Alliance for the Future will launch next month.

The Carousel is a reader-supported publication.

Discussion about this podcast

The Carousel
The Carousel Podcast
Writer Isaac Simpson explores the world through modern propaganda.