Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
over a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
Marcus on AI
Generative AI’s Continuing Copyright Problems, an Essay in Memory of Suchir Balaji, 1998 - 2024
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate...
a week ago
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate named Suchir Balaji, who had just left OpenAI.
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit
August 18, 2023
a year ago
Society's Backend
AI Reading List 2: Mathematical Limitations of LLMs, A SQL Roadmap for Data Science, and...
Society's Backend Reading List 10-14-2024
2 months ago
Society's Backend Reading List 10-14-2024
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
One Useful Thing
Freeing the chatbot
Intelligence, of a sort, is going to be all around us
7 months ago
Intelligence, of a sort, is going to be all around us
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
Daniel Miessler
Why Apple Keeps Winning
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Daniel Miessler
Custom Models Are AI’s Killer App
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
Society's Backend
Artificial Intelligence: A New Paradigm Emerges
A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
A realistic perspective of the advantages and pitfalls of artificial intelligence
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Artificial Ignorance
AI Roundup 041: Lyria
November 17, 2023.
a year ago
Artificial Ignorance
Pitfalls of building with large language models
Dealing with more than just hallucinations.
a year ago
Dealing with more than just hallucinations.
Artificial Ignorance
AI Roundup 052: AI, EO, DPA
February 2, 2024.
10 months ago
Artificial Ignorance
AI Roundup 029: Hug all the faces
August 25, 2023
a year ago
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode
One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
IEEE Spectrum
Robot Photographer Takes the Perfect Picture
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
Strange Loop Canon
OpenAI's Strawberry models can reason like an expert
When models can think
3 months ago
Daniel Miessler
News & Analysis | NO. 350
over a year ago
Rozado’s Visual...
The Political Biases of Google Bard
It is probably only a matter of time until a nation state purposely builds a biased AI system...
a year ago
It is probably only a matter of time until a nation state purposely builds a biased AI system designed to advance government interests
AI Snake Oil
Scientists should use AI as a tool, not an oracle
How AI hype leads to flawed research that fuels more hype
6 months ago
How AI hype leads to flawed research that fuels more hype
One Useful Thing
AI in organizations: Some tactics
Meet the Lab and the Crowd
2 months ago
Meet the Lab and the Crowd
Artificial Ignorance
Groq, Gemini, and 10x improvements
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When...
10 months ago
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When you scale your inputs (users, page views, messages, etc) by 10x, something breaks. Usually, it's something pretty fundamental. And the end result is that you need to replace a...
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
Artificial Ignorance
AI Roundup 058: Devin and SIMA
March 15, 2023.
9 months ago
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
2 months ago
The one good reason to do a PhD and two others that fall flat
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
8 months ago
From megaFLOPS to mega flops.
AI Snake Oil
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
a year ago
How the veneer of AI is used to legitimize awful ideas
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on...
a year ago
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr:
The emerging LLM stack is composed of several elements centered...
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
fast.ai
Practical Deep Learning for Coders 2022
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION The US accused 13 Chinese nationals of committing espionage-related...
Made by Ollin
Priors for Autonomous Vehicle Development
over a year ago
Society's Backend
Coming soon!
Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
10 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Artificial Ignorance
Small newsletters, big ideas
A subscriber showcase full of hidden gems on Substack.
6 days ago
A subscriber showcase full of hidden gems on Substack.
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
a month ago
Why AI products really need some better UX.
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
One Useful Thing
The practical guide to using AI to do stuff
A resource for students in my classes (and other interested people).
a year ago
A resource for students in my classes (and other interested people).
One Useful Thing
Centaurs and Cyborgs on the Jagged Frontier
I think we have an answer on whether AIs will reshape work....
a year ago
I think we have an answer on whether AIs will reshape work....
Marcus on AI
o3, AGI, the art of the demo, and what you can expect in 2025
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived....
19 hours ago
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived. Here’s what you should pay attention to in the coming year.
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
One Useful Thing
On holding back the strange AI tide
There is no way to stop the disruption. We need to channel it instead
a year ago
There is no way to stop the disruption. We need to channel it instead
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
4 months ago
Weekly updates and resources 7/29/24
Artificial Ignorance
The hidden side of Apple Intelligence
More than just another keynote recap.
6 months ago
More than just another keynote recap.
Matt Mazur
Sharing small, incremental updates with users
I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Weighty Thoughts
China's AI Journey
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI...
Machine learning resources and updates 2024-09-09
3 months ago
Machine learning resources and updates 2024-09-09
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty.
“Life can only be understood backwards, but it must be lived forwards.”
9 months ago
“Life can only be understood backwards, but it must be lived forwards.”
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
Artificial Ignorance
AI Roundup 042: sama drama
November 24, 2023.
a year ago
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture
The actual takeaways from the iPhone 15 event
a year ago
The actual takeaways from the iPhone 15 event
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
4 months ago
What people (still) fundamentally misunderstand about AI search.
Artificial Ignorance
Workshop: Prompt Engineering for Claude
Watch now | If you’ve ever wanted to level up your AI prompting skills, this is the workshop for...
2 months ago
Watch now | If you’ve ever wanted to level up your AI prompting skills, this is the workshop for you.
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and...
Machine learning resources and updates 8/19/2024
4 months ago
Machine learning resources and updates 8/19/2024
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps
I keep getting fooled by AI, and it seems like others are, too.
a year ago
I keep getting fooled by AI, and it seems like others are, too.
Society's Backend
I Beat Newsletter Fatigue With AI
And why direct forms of communication will always be super valuable
10 months ago
And why direct forms of communication will always be super valuable
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
8 months ago
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
Marcus on AI
AI influencer hype gone wild
Reality is quite the opposite
a month ago
Reality is quite the opposite
Andrej Karpathy blog
A Survival Guide to a PhD
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
Artificial Ignorance
I gave ChatGPT access to my Gmail
I'm sure this will end well.
a year ago
I'm sure this will end well.
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
Artificial Ignorance
AI Roundup 096: Happy Shipmas
December 6, 2024.
2 weeks ago
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
The Gradient
A Brief Overview of Gender Bias in AI
A brief overview and discussion on gender bias in AI
8 months ago
A brief overview and discussion on gender bias in AI
Matt Mazur
“Monthly Billed Annually” is Cursed Copy
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS...
a year ago
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS for not refunding an accidental annual payment he made on their service. He intended to purchase the monthly plan, but due to an unclear UI and poor copy, he unintentionally...
AI Snake Oil
Generative AI companies must publish transparency reports
The debate about the harms of AI is happening in a data vacuum
a year ago
The debate about the harms of AI is happening in a data vacuum
The Berkeley...
Virtual Personas for Language Models via an Anthology of Backstories
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual...
a month ago
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual personas by generating and utilizing naturalistic backstories with rich details of individual values and experience.
-->
We introduce Anthology, a method for conditioning LLMs to...
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested.
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water resources, and more
One Useful Thing
Setting time on fire and the temptation of The Button
We used to consider writing an indication of time and effort spent on a task. That isn't true...
a year ago
We used to consider writing an indication of time and effort spent on a task. That isn't true anymore.
Artificial Ignorance
AI Roundup 097: Model Mayhem
December 13, 2024.
a week ago
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
6 days ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Society's Backend
What Makes Machine Learning so Hard for Software Engineers
How decades of learning a mindset makes adapting difficult
4 months ago
How decades of learning a mindset makes adapting difficult
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
9 months ago
Adding precision to the debate on openness in AI
Daniel Miessler
Twitter’s Blue Checkmark Strategy Reduces Trust in Pursuit of Revenue
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month,...
over a year ago
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month, I was happy. As a legacy holder of the checkmark there’s a slight band-aid-sting of the check indicating specialness—who doesn’t want to feel special?—but I’d much rather see a...
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Society's Backend
I Enjoy Technical Interviews and You Can Too
A simple change in mindset that completely changed the way I interview
a year ago
A simple change in mindset that completely changed the way I interview
Made by Ollin
Singing Style Transfer
Initial Experiments
over a year ago
One Useful Thing
Innovation through prompting
Democratizing educational technology... and more
8 months ago
Democratizing educational technology... and more
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
11 months ago
Taking AI timelines seriously
One Useful Thing
Assigning AI: Seven Ways of Using AI in Class
Also prompts! And things to watch out for!
a year ago
Also prompts! And things to watch out for!
AI Snake Oil
Is AI progress slowing down?
Making sense of recent technology trends and claims
4 days ago
Making sense of recent technology trends and claims
One Useful Thing
Which AI should I use? Superpowers and the State of Play
And then there were three...
9 months ago
And then there were three...
Sam Altman
A Clarification
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to...
over a year ago
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to clarify it.
I didn’t mean that we need to tolerate brilliant homophobic
jerks in the lab so that we can have scientific progress.
Although there are famous...
Daniel Miessler
My Mom Died on Saturday
My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
AI Snake Oil
Four more things we worked on in 2022
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
a year ago
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
Rozado’s Visual...
DepolarizingGPT
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
AI Snake Oil
Starting reading the AI Snake Oil book online today
The book will be published on September 24
3 months ago
The book will be published on September 24
Daniel Miessler
AI Art Will Push the Top 1% to Human Artists
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist...
over a year ago
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist on the opposite, i.e., manual, human art. The more manual the better. The more human the better. Ideally there’d only be one of whatever you have, and it’d only be yours. Why is...
AI Snake Oil
What is algorithmic amplification and why should we care?
A symposium and a primer on social media recommendation algorithms
a year ago
A symposium and a primer on social media recommendation algorithms
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
Weighty Thoughts
What I got Right or Wrong in 2020
Reflecting on the Past Year
over a year ago
Reflecting on the Past Year
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
Weighty Thoughts
When the AI Bubble Bursts
It’s when, not if, for these kinds of new technologies
5 months ago
It’s when, not if, for these kinds of new technologies
Andrej Karpathy blog
What a Deep Neural Network thinks about your #selfie
Convolutional Neural Networks are great: they recognize things, places and people in your personal...
over a year ago
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic in aerial imagery, various anomalies in medical images and all kinds of other useful things. But...
Sam Altman
Keep the Internet Open
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon.
The internet is a public good, and I believe access should be a basic right. We've seen such great innovation in software because the internet has...
Daniel Miessler
Humiliation is Deadly
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That...
over a year ago
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That is, people who not only feel like they have no respect and no options to gain any respect, but who also feel that: They deserve those things, and… That someone else is the cause of...
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
3 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
fast.ai
Qualitative humanities research is crucial to AI
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
Sam Altman
GPT-4o
There are two things from our announcement today I wanted to highlight.
First, a key part of our...
7 months ago
There are two things from our announcement today I wanted to highlight.
First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
Weighty Thoughts
The Real Risks of AI
Humans are really the ones to be scared of
7 months ago
Humans are really the ones to be scared of
Weighty Thoughts
The EU is making itself an economic backwater
Regulation is not a real export
5 months ago
Regulation is not a real export
Artificial Ignorance
Case Study: Scaling customer intelligence
Analyzing 10,000 sales calls with Claude
3 weeks ago
Analyzing 10,000 sales calls with Claude
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Artificial Ignorance
Distributing the future
A reminder that things take time.
6 months ago
A reminder that things take time.
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
4 months ago
A critical question for investors in AI
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Marcus on AI
Casey (Newton) Strikes Out
His continued skepticism of AI skepticism continues to miss the mark
a week ago
His continued skepticism of AI skepticism continues to miss the mark
Weighty Thoughts
I'm writing a book!
Why I've been gone over a month, and how you can help
3 weeks ago
Why I've been gone over a month, and how you can help
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches
If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
Artificial Ignorance
Lessons from 139 YC AI startups (S23)
The evolution of the AI landscape, and YC's Copilot era.
a year ago
The evolution of the AI landscape, and YC's Copilot era.
Daniel Miessler
Something is Up With Meritocracy
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Society's Backend
How to Know if Your Data is Being Used Maliciously
The information you should know about a company before gifting them your data
a year ago
The information you should know about a company before gifting them your data
One Useful Thing
Post-apocalyptic education
What comes after the Homework Apocalypse
3 months ago
What comes after the Homework Apocalypse
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
Society's Backend
Why Gemini's Struggles Aren't Straightforward
And an overview of LLM security issues
9 months ago
And an overview of LLM security issues
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon
How your greatest asset is silently stolen by technology every day
a year ago
How your greatest asset is silently stolen by technology every day
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Artificial Ignorance
The State of AI Engineering (2024)
Notes from the AI Engineer World's Fair.
5 months ago
Notes from the AI Engineer World's Fair.
Daniel Miessler
Unsupervised Learning NO. 365 | China’s Decline, MicrosoftAI, Creativity Ratio…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS NYC Surveillance Amnesty International has revealed new research showing that the NYPD has over 15,000 cameras that can do...
Matt Mazur
Going Full Time on My SaaS After 13 Years
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
5 months ago
Stories by Andrej...
Yes you should understand backprop
over a year ago
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Artificial Ignorance
AI Roundup 066: AlphaFold 3
May 10, 2024.
7 months ago
IEEE Spectrum
Video Friday: Mars Chopper
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news...
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Made by Ollin
NVIDIA Internship (2017)
Notes on my internship at NVIDIA Redmond.
over a year ago
Notes on my internship at NVIDIA Redmond.
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Daniel Miessler
Frontview Mirror: 2023 Edition
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
2 months ago
Artificial Ignorance
Why Claude 3 is a big upgrade
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks,...
9 months ago
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks, add multi-modal capabilities, and are a real competitor to GPT-4.
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave
November 8, 2024.
a month ago
One Useful Thing
I hope you weren't getting too comfortable.
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits...
a year ago
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits of AI were wrong.
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
One Useful Thing
One sentence.
Prompting for maximum impact (and why that is a bad idea)
a year ago
Prompting for maximum impact (and why that is a bad idea)
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Artificial Ignorance
AI Roundup 085: You win some, you Newsom
September 20, 2024.
3 months ago
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
Artificial Ignorance
YC is now 80% AI startups (S24)
Analyzing the latest companies out of "AI Combinator"
2 months ago
Analyzing the latest companies out of "AI Combinator"
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
4 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
9 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
AI Snake Oil
AI cannot predict the future. But companies keep trying (and failing).
A new paper on how AI companies make false promises and how we can challenge them
a year ago
A new paper on how AI companies make false promises and how we can challenge them
Daniel Miessler
What Made the 90’s So Awesome?
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
Sam Altman
Hard Startups
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
over a year ago
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one. A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
One Useful Thing
An AI Haunted World
Intelligence, everywhere.
a year ago
Intelligence, everywhere.
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
11 months ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
Made by Ollin
A Video History of Self-Driving Cars
over a year ago
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
Society's Backend
JAX is for More Than Just Machine Learning
What JAX is and its potential applications
6 months ago
What JAX is and its potential applications
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice...
Society's Backend Reading List 11-18-2024
a month ago
Society's Backend Reading List 11-18-2024
Artificial Ignorance
OpenAI's o1 is a misunderstood model
Are the latest "reasoning" breakthroughs all they're hyped up to be?
3 months ago
Are the latest "reasoning" breakthroughs all they're hyped up to be?
fast.ai
From Deep Learning Foundations to Stable Diffusion
Practical Deep Learning for Coders part 2, 2022
over a year ago
Practical Deep Learning for Coders part 2, 2022
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good.
Turning models into products runs into five challenges
4 months ago
Turning models into products runs into five challenges
One Useful Thing
Change blindness
21 months later
4 months ago
Sam Altman
How To Be Successful
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter.
Here are 13 thoughts about how to achieve such outlier...
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
Artificial Ignorance
AI Roundup 084: Strawberry / o1
September 13, 2024.
3 months ago
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
over a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
Increased efficiency can sometimes, counterintuitively, lead to worse outcomes.
This is true almost everywhere.
We will name...
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
IEEE Spectrum
Where’s My Robot?
See the interactive version of this story on our site →
a month ago
See the interactive version of this story on our site →
Artificial Ignorance
Tutorial: How to make and share custom GPTs
They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
They're not going to disrupt everything (yet), but they're a ton of fun.
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
2 months ago
“Connectionist” vs. Knowledge-Based AI
Strange Loop Canon
Google had a very bad week
Gemini's paradox
9 months ago
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
IEEE Spectrum
SwitchBot S10 Review: “This Is the Future of Home Robots”
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
2 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Made by Ollin
HintBot
Hinting icons automatically with a neural network
over a year ago
Hinting icons automatically with a neural network
Sam Altman
Please Fund More Science
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.
Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
Artificial Ignorance
AI's invisible instructions
What meme prompts can teach us about better interface design.
a month ago
What meme prompts can teach us about better interface design.
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
10 months ago
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and...
Society's Backend Reading List 11-04-2024
a month ago
Society's Backend Reading List 11-04-2024
Artificial Ignorance
AI Roundup 078: Voice mode
August 2, 2024.
4 months ago
Artificial Ignorance
AI Roundup 057: Claude 3
March 8, 2024.
9 months ago
Artificial Ignorance
AI Roundup 069: Project Greymatter
May 31, 2024.
6 months ago
Artificial Ignorance
YCombinator's AI boom is still going strong (W24)
Combing through all 158 YC AI startups (65% of the batch).
8 months ago
Combing through all 158 YC AI startups (65% of the batch).
Weighty Thoughts
Apple Wins
Apple Intelligence and aggregation puts Apple in a dominant AI position
6 months ago
Apple Intelligence and aggregation puts Apple in a dominant AI position
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
Artificial Ignorance
The AI email startup that's taking on Gmail
A conversation with Andrew Lee, CEO of Shortwave and cofounder of Firebase.
a year ago
A conversation with Andrew Lee, CEO of Shortwave and cofounder of Firebase.
Sam Altman
Funding for COVID-19 Projects
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help. I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on:
Producing a lot of ventilators or...
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Strange Loop Canon
Symposium: On Building God
a year ago
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation?
The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
The bottleneck isn't the cost of producing disinfo, which is already very low.
Strange Loop Canon
State of the Canon
Onwards
11 months ago
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat."
What we can learn from a completely AI written & illustrated lecture
a year ago
What we can learn from a completely AI written & illustrated lecture
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
4 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
Weighty Thoughts
Why we need AI as a society
We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
We’re aging too fast (AKA my entire AI/robotics investment thesis)
Society's Backend
AI Reading List 3: Meta's Self-Taught Evaluator, AI for Cancer Diagnosis, and a Technical...
Society's Backend Reading List 10-21-2024
2 months ago
Society's Backend Reading List 10-21-2024
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition
AI systems have gotten more capable and easier to use
6 months ago
AI systems have gotten more capable and easier to use
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
9 months ago
And effective ways to mitigate it
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
Matt Mazur
Emergent Mind in The Atlantic
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The...
a year ago
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The Atlantic who asked Caroline Mimbs Nyce, one of their reporters, to look into it. Caroline interviewed me for the article they just published which focused on the challenges Google is...
Made by Ollin
Emojin
An infinite kaomoji generator
over a year ago
An infinite kaomoji generator
Weighty Thoughts
Software Engineering is Doomed
Or is it?
5 months ago
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text.
Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Artificial Ignorance
AI Roundup 049: Down the Rabbit hole
January 12, 2023.
11 months ago
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck
You can’t just blindly extrapolate compute requirements
a year ago
You can’t just blindly extrapolate compute requirements
One Useful Thing
Magic for English Majors
Programming in prose in an AI-haunted world
a year ago
Programming in prose in an AI-haunted world
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes
Several states just banned deepfakes in political ads and porn.
9 months ago
Several states just banned deepfakes in political ads and porn.
Marcus on AI
Which CEO will be the last to see it?
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
2 weeks ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers
Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Content creation and networking lessons from a wildly successful freelance tech writer
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Artificial Ignorance
AI Roundup 093: Diminishing returns
November 15, 2024.
a month ago
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
12 months ago
Hey Siri, set a reminder for 365 days.
One Useful Thing
The Homework Apocalypse
Fall is going to be very different this year. Educators need to be ready.
a year ago
Fall is going to be very different this year. Educators need to be ready.
Society's Backend
Ask Stupid Questions
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
11 months ago
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
10 months ago
Four questions to ask your organization.
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Society's Backend
How to Use Benchmarks to Build Successful Machine Learning Systems
And what benchmarks mean for real-world applications
4 months ago
And what benchmarks mean for real-world applications
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
If You Understand Bananas, You Can Understand Machine Learning
A simplified high-level overview of primary machine learning algorithms for anyone to understand
11 months ago
A simplified high-level overview of primary machine learning algorithms for anyone to understand
One Useful Thing
Embracing weirdness: What it means to use AI as a (writing) tool
AI is strange. We need to learn to use it.
a year ago
AI is strange. We need to learn to use it.
Artificial Ignorance
AI Roundup 071: How do you like them AIs
June 14, 2024.
6 months ago
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Society's Backend
Why Software Engineers Need to Understand Machine Learning
And how ML helps software engineers in their daily work
6 months ago
And how ML helps software engineers in their daily work
Made by Ollin
Game Emulation via Neural Network
over a year ago
AI Snake Oil
Three Ideas for Regulating Generative AI
Policy input to the federal government from a Stanford-Princeton team
a year ago
Policy input to the federal government from a Stanford-Princeton team
Society's Backend
Weekly Backend #7: 39 Resources and Updates
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
7 months ago
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
Artificial Ignorance
AI Roundup 036: The money pit
October 13, 2023.
a year ago
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
10 months ago
Five analytical tasks in under a minute
Matt Mazur
Indie Hacking Week 1 Recap: Starting TimelineGPT, Ending LearnGPT
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good...
a year ago
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good groove as far as my daily routine, but I don’t think it’s quite sunk in yet how much flexibility I have in terms of my daily schedule. For example, I’m still waking up early to […]
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
Strange Loop Canon
I wrote a book!
AI enables us to, finally, get "soft" APIs
a year ago
AI enables us to, finally, get "soft" APIs
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
AI Snake Oil
Tech policy is only frustrating 90% of the time
That’s what makes it worthwhile
8 months ago
That’s what makes it worthwhile
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in...
a month ago
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
The Gradient
The Artificiality of Alignment
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk”...
a year ago
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
AI Snake Oil
Does the UK’s liver transplant matching algorithm systematically exclude younger patients?
Seemingly minor technical decisions can have life-or-death effects
a month ago
Seemingly minor technical decisions can have life-or-death effects
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
Artificial Ignorance
AI Roundup 080: Grok 2
August 16, 2024.
4 months ago
Rozado’s Visual...
Pessimism in News Media Headlines
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
Society's Backend
Would You Build the Manhattan Project in the UAE?
Thoughts on AI national security threats
6 months ago
Thoughts on AI national security threats
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
All of us, except the AI startups and VCs—unless a real war breaks out
Daniel Miessler
Using Custom Searches in Safari (in 2022)
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Sam Altman
Tech Workers' Values
For good and bad, technology has become a central force in all
our lives.
As members of the...
over a year ago
For good and bad, technology has become a central force in all
our lives.
As members of the community, we're interested in ways in which
tech companies can use their collective power to protect privacy, rule of law,
freedom of expression, and other fundamental American rights....
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
One Useful Thing
On-boarding your AI Intern
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots
large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
a month ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
AI Snake Oil
Will AI transform law?
The hype is not supported by current evidence
11 months ago
The hype is not supported by current evidence
Daniel Miessler
The UL Boost Protocol
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe...
over a year ago
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe Already a member? Login
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Sam Altman
Time to Take a Stand
It is time for tech companies to start speaking up about
some of the actions taken by President...
over a year ago
It is time for tech companies to start speaking up about
some of the actions taken by President Trump’s administration.
There are many actions from his first week that are
objectionable. In repeatedly
invoking unsubstantiated conspiracy theories (like the 3 million...
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there
Contra Hoel on AI and its supply paradox
a year ago
Contra Hoel on AI and its supply paradox
Daniel Miessler
Your Experience is Your Creativity
Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 