fast.ai
My family’s unlikely homeschooling journey
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
Marcus on AI
Two visions of AI’s future
It’s not looking good
4 weeks ago
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
5 months ago
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
over a year ago
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps
I keep getting fooled by AI, and it seems like others are, too.
a year ago
I keep getting fooled by AI, and it seems like others are, too.
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem
December 22, 2023.
a year ago
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
over a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Weighty Thoughts
Commentary on Technology, Startups, and Investing
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater...
over a year ago
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater and Google X. Co-Founder Lioness. Sign up now so you don’t miss the first issue. In the meantime, tell your friends!
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
10 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
Artificial Ignorance
The fable of Reflection 70B
From groundbreaking to grifting.
3 months ago
From groundbreaking to grifting.
The Gradient
Text-to-CAD: Risks and Opportunities
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
fast.ai
A new old kind of R&D lab
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on...
a year ago
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughs.
Artificial Ignorance
AI Roundup 026: AudioCraft
August 4, 2023
a year ago
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
AI Snake Oil
What the executive order means for openness in AI
Good news on paper, but the devil is in the details
a year ago
Good news on paper, but the devil is in the details
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
5 months ago
What people (still) fundamentally misunderstand about AI search.
Daniel Miessler
The 2 Current Major AI Bottlenecks
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
3 weeks ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
Marcus on AI
AI influencer hype gone wild
Reality is quite the opposite
2 months ago
Reality is quite the opposite
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
a month ago
Why AI products really need some better UX.
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture
The actual takeaways from the iPhone 15 event
a year ago
The actual takeaways from the iPhone 15 event
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
Society's Backend
The State of AI in China
Is China winning the race to AGI?
5 months ago
Is China winning the race to AGI?
Daniel Miessler
Summary: Andrej Kaparthy on Lex Fridman’s Podcast (Late 2022)
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My...
a year ago
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My One-Sentence Summary/Highlight The future of programming is not humans writing code, but neural nets creating weights. Capture Neural networks are mathematical expressions with many...
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1)
Part 1: What is an agent, and how do they work?
a year ago
Part 1: What is an agent, and how do they work?
Society's Backend
No One Should Be GPU Poor
For everyone to have access to AGI, everyone must also have access to the compute to use it
7 months ago
For everyone to have access to AGI, everyone must also have access to the compute to use it
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
9 months ago
And effective ways to mitigate it
Artificial Ignorance
What President Biden's AI executive order actually means
I read all 111 pages so you don't have to.
a year ago
I read all 111 pages so you don't have to.
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
10 months ago
Adding precision to the debate on openness in AI
One Useful Thing
Feats to astonish and amaze
A compendium of things I didn't think AI should be able to do
a year ago
A compendium of things I didn't think AI should be able to do
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Weighty Thoughts
Fear and Loathing in 7nm
How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
How much does Huawei and SMIC's new chip matter? And what should the US do?
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Strange Loop Canon
Evaluations are all we need
On analysing talent in LLMs
11 months ago
On analysing talent in LLMs
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Sam Altman
GPT-4o
There are two things from our announcement today I wanted to highlight.
First, a key part of our...
7 months ago
There are two things from our announcement today I wanted to highlight.
First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Society's Backend
Ask Stupid Questions
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
Artificial Ignorance
GPTs won't make you rich
But they'll make you more productive.
11 months ago
But they'll make you more productive.
One Useful Thing
Innovation through prompting
Democratizing educational technology... and more
8 months ago
Democratizing educational technology... and more
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on...
a year ago
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr:
The emerging LLM stack is composed of several elements centered...
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
3 months ago
Machine learning highlights and resources 9-23-24
Weighty Thoughts
Most AI startups are doomed
Just because it matters doesn’t mean it’s defensible or profitable
a year ago
Just because it matters doesn’t mean it’s defensible or profitable
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
8 months ago
From megaFLOPS to mega flops.
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
Society's Backend
An AI Revolution Isn't Coming - We're Already In It
A small showcase of companies using AI in ways that will change your life
a year ago
A small showcase of companies using AI in ways that will change your life
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice
Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
Artificial Ignorance
AI Roundup 071: How do you like them AIs
June 14, 2024.
6 months ago
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
Artificial Ignorance
AI Roundup 044: Google Gemini
December 8, 2023.
a year ago
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
Society's Backend
AI Reading List 3: Meta's Self-Taught Evaluator, AI for Cancer Diagnosis, and a Technical...
Society's Backend Reading List 10-21-2024
2 months ago
Society's Backend Reading List 10-21-2024
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
9 months ago
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
IEEE Spectrum
The Top 7 Robotics Stories of 2024
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said...
5 days ago
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said before. But that’s the great thing about robotics—it’s always new, and it’s always exciting. What may be different about this year is the real sense that not only is AI going to...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
Made by Ollin
Emojin
An infinite kaomoji generator
over a year ago
An infinite kaomoji generator
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
10 months ago
Artificial Ignorance
AI Roundup 027: Challenge accepted
August 11, 2023
a year ago
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
11 months ago
And other practical guides to understand machine learning
AI Snake Oil
Is AI progress slowing down?
Making sense of recent technology trends and claims
2 weeks ago
Making sense of recent technology trends and claims
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition
A simple answer, and then a less simple one.
a year ago
A simple answer, and then a less simple one.
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Sam Altman
Helion
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
over a year ago
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen.
David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Stories by Andrej...
A Peek at Trends in Machine Learning
over a year ago
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
Artificial Ignorance
Jevons Paradox and the future of programming
Supply and demand in the Age of AI.
9 months ago
Supply and demand in the Age of AI.
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
...
over a year ago
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
font-weight: 300;
overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */
}
.post pre,
.post code {
background-color: #fafafa;
font-size: 13px; /*...
AI Snake Oil
We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.
Technology Isn’t the Problem—or the Solution.
2 weeks ago
Technology Isn’t the Problem—or the Solution.
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
The Berkeley...
Modeling Extremely Large Images with $x$T
As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community
The timeline and why OpenAI’s actions are a big deal
7 months ago
The timeline and why OpenAI’s actions are a big deal
Artificial Ignorance
10 AI stories that shaped 2024
Agents, deepfakes, Strawberries, and more.
a week ago
Agents, deepfakes, Strawberries, and more.
Strange Loop Canon
I wrote a book!
AI enables us to, finally, get "soft" APIs
a year ago
AI enables us to, finally, get "soft" APIs
Strange Loop Canon
The agent principal problem
"Show me the incentive and I will show you the outcome."
a year ago
"Show me the incentive and I will show you the outcome."
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
Rozado’s Visual...
The Political Biases of Google Bard
It is probably only a matter of time until a nation state purposely builds a biased AI system...
a year ago
It is probably only a matter of time until a nation state purposely builds a biased AI system designed to advance government interests
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
Daniel Miessler
News & Analysis | NO. 350
over a year ago
IEEE Spectrum
Video Friday: ICRA Turns 40
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
Artificial Ignorance
AI Roundup 064: Big Tech's small models
April 26, 2024.
8 months ago
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
AI Snake Oil
One year update: book submitted; TIME 100; Sep 21 online workshop
It's been an eventful year
a year ago
It's been an eventful year
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
Made by Ollin
Singing Style Transfer
Initial Experiments
over a year ago
Strange Loop Canon
Progress
when benefits are worth tallying the human cost of technological leaps
a year ago
when benefits are worth tallying the human cost of technological leaps
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too)
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
Society's Backend
OpenAI's Strawberry May Enhance AI Reasoning, Optimization of Vision Language Models, Info on...
Weekly updates and resources 7/15/24
5 months ago
Weekly updates and resources 7/15/24
Matt Mazur
Full Time Indie Hacking: Month 5 Update
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
One Useful Thing
Everyone is above average
Is AI a Leveler, King Maker, or Escalator?
a year ago
Is AI a Leveler, King Maker, or Escalator?
One Useful Thing
The Best Available Human Standard
What are the imperatives of the upside?
a year ago
What are the imperatives of the upside?
Artificial Ignorance
LLMs are getting dumber and we have no idea why
Five theories that could explain how chatbots are getting worse.
3 months ago
Five theories that could explain how chatbots are getting worse.
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
One Useful Thing
On-boarding your AI Intern
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
Artificial Ignorance
AI's invisible instructions
What meme prompts can teach us about better interface design.
2 months ago
What meme prompts can teach us about better interface design.
fast.ai
nbdev+Quarto: A new secret weapon for productivity
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
over a year ago
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
IEEE Spectrum
Video Friday: Trick or Treat, Atlas
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
5 months ago
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes
Several states just banned deepfakes in political ads and porn.
9 months ago
Several states just banned deepfakes in political ads and porn.
Strange Loop Canon
Mind the Gap
from empire to umpire
a year ago
Artificial Ignorance
AI Roundup 085: You win some, you Newsom
September 20, 2024.
3 months ago
The Gradient
An Introduction to the Problems of AI Consciousness
Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in...
a month ago
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Artificial Ignorance
AI Roundup 075: Levels of AGI
July 12, 2024.
5 months ago
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
Artificial Ignorance
AI Roundup 040: GPTs
November 10, 2023.
a year ago
Rozado’s Visual...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system
Should AI systems treat different demographic groups unequally?
a year ago
Should AI systems treat different demographic groups unequally?
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
3 months ago
The one good reason to do a PhD and two others that fall flat
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
a year ago
And why it might revolutionize the search industry.
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
Strange Loop Canon
State of the Canon
Onwards
a year ago
Sam Altman
Helion Needs You
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
over a year ago
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator.
The goals of the company are quite ambitious—clean, continuous energy for 1...
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing
January 26, 2024.
11 months ago
One Useful Thing
Gradually, then Suddenly: Upon the Threshold
Small improvements can lead to big changes
6 months ago
Small improvements can lead to big changes
Society's Backend
Why Gemini's Struggles Aren't Straightforward
And an overview of LLM security issues
9 months ago
And an overview of LLM security issues
Weighty Thoughts
Software Engineering is Doomed
Or is it?
6 months ago
Society's Backend
Would You Build the Manhattan Project in the UAE?
Thoughts on AI national security threats
6 months ago
Thoughts on AI national security threats
One Useful Thing
A prosthesis for imagination: Using AI to boost your creativity
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
a year ago
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
a month ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task.
This video is notable because it’s the first real look we’ve had at the new Atlas doing...
IEEE Spectrum
Where’s My Robot?
See the interactive version of this story on our site →
a month ago
See the interactive version of this story on our site →
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
a month ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
10 months ago
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth so much
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
7 months ago
How employees and CEOs alike can plan for the future.
Weighty Thoughts
From 6 Weeks to 600 Seconds (or Less)
The revolutionary potential of utilizing AI for electronic hardware design
4 days ago
The revolutionary potential of utilizing AI for electronic hardware design
fast.ai
Masks for COVID: Updating the evidence
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
11 months ago
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
Rozado’s Visual...
Pessimism in News Media Headlines
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
4 weeks ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
Society's Backend
What Apple Intelligence Means for You
"We think you're gonna LOVE it"
6 months ago
"We think you're gonna LOVE it"
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
2 months ago
Matt Mazur
LearnGPT is now EmergentMind
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
Artificial Ignorance
Blade Runner 2024
Reddit's AI Hunters and the quest for authentic digital experiences.
4 months ago
Reddit's AI Hunters and the quest for authentic digital experiences.
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
3 weeks ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Matt Mazur
Introducing Preceden’s new AI-Powered Timeline Generator
For the past few months I’ve been heads down building an AI-powered timeline generator tool for...
a year ago
For the past few months I’ve been heads down building an AI-powered timeline generator tool for Preceden, my SaaS timeline maker software: The tool – which is free to use and available on Preceden’s homepage – lets you type in a topic or detailed description of a timeline and it...
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
6 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Artificial Ignorance
Why Claude 3 is a big upgrade
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks,...
10 months ago
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks, add multi-modal capabilities, and are a real competitor to GPT-4.
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
Strange Loop Canon
We all live on a knife's edge, and it's fine
Or: How we weaponised serendipity
9 months ago
Or: How we weaponised serendipity
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Weighty Thoughts
I'm writing a book!
Why I've been gone over a month, and how you can help
a month ago
Why I've been gone over a month, and how you can help
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Society's Backend
Mastering the Art of Documentation
Documentation is really just glorified dog sitting
a year ago
Documentation is really just glorified dog sitting
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
8 months ago
One Useful Thing
On the necessity of a sin
Why treating AI like a person is the future
9 months ago
Why treating AI like a person is the future
The Gradient
Interpretability Creationism
On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation?
The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
The bottleneck isn't the cost of producing disinfo, which is already very low.
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
5 months ago
Weekly updates and resources 7/29/24
Society's Backend
Why MLX is Important for the ML Community
And a step-by-step guide to train a machine learning model on your Mac
8 months ago
And a step-by-step guide to train a machine learning model on your Mac
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
11 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
One Useful Thing
On giving AI eyes and ears
AI can listen and see, with bigger implications than we might realize.
a year ago
AI can listen and see, with bigger implications than we might realize.
Artificial Ignorance
Funding a new generation of AI companies
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
11 months ago
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
Artificial Ignorance
AI Roundup 056: Data deals
March 1, 2024.
10 months ago
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Strange Loop Canon
Power, money and human nature
Thoughts on OpenAI, a tragedy
a year ago
Thoughts on OpenAI, a tragedy
Artificial Ignorance
The ideologies fighting for the soul (and future) of AI
EAs, e/accs, decels, and doomers.
a year ago
EAs, e/accs, decels, and doomers.
Society's Backend
Welcome to 2024: The Year Where AI is No Longer an Option
Why everyone should learn about machine learning
a year ago
Why everyone should learn about machine learning
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
One Useful Thing
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
a year ago
It took me a few minutes to create a fake me giving a fake lecture.
Society's Backend
5 Highlights From Society's Backend in 2024
The top 5 articles and resources
2 days ago
The top 5 articles and resources
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
Strange Loop Canon
Google had a very bad week
Gemini's paradox
10 months ago
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
a month ago
The bullshit just keeps on coming.
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
2 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
Artificial Ignorance
The AI email startup that's taking on Gmail
A conversation with Andrew Lee, CEO of Shortwave and cofounder of Firebase.
a year ago
A conversation with Andrew Lee, CEO of Shortwave and cofounder of Firebase.
Matt Mazur
Emergent Mind finally went viral
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
All of us, except the AI startups and VCs—unless a real war breaks out
One Useful Thing
Catastrophe / Eucatastrophe
We have more agency over the future of AI than we think.
a year ago
We have more agency over the future of AI than we think.
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
IEEE Spectrum
Video Friday: Unitree Talent Awakening
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Society's Backend
OpenAI's o1, Model Merging, California Approves AI Regulation, and More
Machine learning resources and updates 2024-09-17
3 months ago
Machine learning resources and updates 2024-09-17
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Weighty Thoughts
Today’s AI critics don’t understand the history of technology
But is AI different than other technologies?
10 months ago
But is AI different than other technologies?
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
One Useful Thing
AI in organizations: Some tactics
Meet the Lab and the Crowd
3 months ago
Meet the Lab and the Crowd
AI Snake Oil
Will AI transform law?
The hype is not supported by current evidence
11 months ago
The hype is not supported by current evidence
AI Snake Oil
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
a year ago
How the veneer of AI is used to legitimize awful ideas
Daniel Miessler
Custom Models Are AI’s Killer App
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
Artificial Ignorance
AI Roundup 048: The Robot Constitution
January 5, 2024.
12 months ago
AI Snake Oil
How Transparent Are Foundation Model Developers?
Introducing the Foundation Model Transparency Index
a year ago
Introducing the Foundation Model Transparency Index
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
over a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
IEEE Spectrum
In 2025, People Will Try Living in This Underwater Habitat
The future of human habitation in the sea is taking shape in an abandoned quarry on the border of...
3 days ago
The future of human habitation in the sea is taking shape in an abandoned quarry on the border of Wales and England. There, the ocean-exploration organization Deep has embarked on a multiyear quest to enable scientists to live on the seafloor at depths up to 200 meters for weeks,...
Artificial Ignorance
AI Roundup 030: OpenAI's $1B revenue
September 1, 2023
a year ago
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Daniel Miessler
AI Art Will Push the Top 1% to Human Artists
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist...
over a year ago
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist on the opposite, i.e., manual, human art. The more manual the better. The more human the better. Ideally there’d only be one of whatever you have, and it’d only be yours. Why is...
Artificial Ignorance
YC is now 80% AI startups (S24)
Analyzing the latest companies out of "AI Combinator"
3 months ago
Analyzing the latest companies out of "AI Combinator"
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns
Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
Science, sociology, and the likely financial collapse of the Generative AI bubble
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
10 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Strange Loop Canon
Seeing Like A Network
Dark Forests, Dense Networks
6 months ago
Dark Forests, Dense Networks
Andrej Karpathy blog
What a Deep Neural Network thinks about your #selfie
Convolutional Neural Networks are great: they recognize things, places and people in your personal...
over a year ago
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic in aerial imagery, various anomalies in medical images and all kinds of other useful things. But...
Sam Altman
What I Wish Someone Had Told Me
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started.
Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection
Authors: PromptArmor
4 months ago
Artificial Ignorance
Small newsletters, big ideas
A subscriber showcase full of hidden gems on Substack.
2 weeks ago
A subscriber showcase full of hidden gems on Substack.
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
10 months ago
Four questions to ask your organization.
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter
Democratizing data analysis with AI
a year ago
Democratizing data analysis with AI
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good.
Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Teachers adapted to the calculator. They can certainly adapt to language models.
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and...
Society's Backend Reading List 11-04-2024
a month ago
Society's Backend Reading List 11-04-2024
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Weighty Thoughts
Why we need AI as a society
We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
We’re aging too fast (AKA my entire AI/robotics investment thesis)
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
2 months ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.”
Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
The Gradient
The Artificiality of Alignment
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk”...
a year ago
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
Artificial Ignorance
AI Roundup 069: Project Greymatter
May 31, 2024.
7 months ago
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Matt Mazur
Is the ChatGPT API Refusing to Summarize Academic Papers? Not so fast.
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API...
a year ago
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API indicating that it was refusing to summarize arXiv papers: There has been a lot of discussion recently about the perceived decrease in the quality of ChatGPT’s responses and seeing...
Artificial Ignorance
AI Roundup 055: Race conditions
February 23, 2023.
10 months ago
Marcus on AI
PSA: Microsoft may be training on your private data without your knowledge
The Great Data Heist continues.
a month ago
The Great Data Heist continues.
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
One Useful Thing
Post-apocalyptic education
What comes after the Homework Apocalypse
4 months ago
What comes after the Homework Apocalypse
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
5 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
3 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
Daniel Miessler
Unsupervised Learning NO. 365 | China’s Decline, MicrosoftAI, Creativity Ratio…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS NYC Surveillance Amnesty International has revealed new research showing that the NYPD has over 15,000 cameras that can do...
Artificial Ignorance
AI Roundup 039: The governance issue
November 3, 2023.
a year ago
Society's Backend
A Fundamental Overview of Machine Learning Experimentation [Part 1]
And how it differs from the software development you're familiar with
4 weeks ago
And how it differs from the software development you're familiar with
Marcus on AI
𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁...
Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course...
a week ago
Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course they have to announce AGI the day my vacation starts”.
Andrej Karpathy blog
Self-driving as a case study for AGI
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
11 months ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
One Useful Thing
In Praise of Boring AI
Automation has always been about killing tedious work. AI can do the same.
a year ago
Automation has always been about killing tedious work. AI can do the same.
Society's Backend
Taking the AI to Consumers
The Google Pixel 8 Pro is a much bigger deal than you think
a year ago
The Google Pixel 8 Pro is a much bigger deal than you think
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
3 months ago
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications
And then there were two.
10 months ago
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse?
Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Providing a technical perspective for a more educated assessment of a complaint I hear quite frequently
One Useful Thing
15 Times to use AI, and 5 Not to
Notes on the Practical Wisdom of AI Use
3 weeks ago
Notes on the Practical Wisdom of AI Use
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
a month ago
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for their job
Daniel Miessler
My Mom Died on Saturday
My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Rozado’s Visual...
Define Wokeness! Or how you shall know a word by the company it keeps
Visualizing what words often appear in the vicinity of woke/wokeness in news media content...
a year ago
Visualizing what words often appear in the vicinity of woke/wokeness in news media content illustrates why communication is almost impossible between red and blue America
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
Matt Mazur
Sharing small, incremental updates with users
I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
a month ago
Sam Altman
Idea Generation
The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup.
But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
Marcus on AI
An epidemic of weirdly precise AI butt facts
The parade of made-up numbers never stops
2 months ago
The parade of made-up numbers never stops
Artificial Ignorance
o3 is important, but not because of benchmarks
OpenAI's new model offers a peek at the future of AI investment.
a week ago
OpenAI's new model offers a peek at the future of AI investment.
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit
August 18, 2023
a year ago
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
8 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
The Gradient
A Brief Overview of Gender Bias in AI
A brief overview and discussion on gender bias in AI
8 months ago
A brief overview and discussion on gender bias in AI
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
7 months ago
The mystery of why we don't dream of building perfect societies anymore
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
6 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
a year ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
One Useful Thing
Getting started with AI: Good enough prompting
Don't make this hard
a month ago
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth?
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
3 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
One Useful Thing
Something New: On OpenAI's "Strawberry" and Reasoning
Solving hard problems in new ways
3 months ago
Solving hard problems in new ways
One Useful Thing
Setting time on fire and the temptation of The Button
We used to consider writing an indication of time and effort spent on a task. That isn't true...
a year ago
We used to consider writing an indication of time and effort spent on a task. That isn't true anymore.
Rozado’s Visual...
Which is the Wokest AI?
A Wokeness Ranking of LLMs
10 months ago
A Wokeness Ranking of LLMs
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
3 weeks ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
One Useful Thing
Change blindness
21 months later
4 months ago
One Useful Thing
Embracing weirdness: What it means to use AI as a (writing) tool
AI is strange. We need to learn to use it.
a year ago
AI is strange. We need to learn to use it.
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Society's Backend
What you need to understand about LLM creativity
An simple overview of temperature and its effect on LLM output
8 months ago
An simple overview of temperature and its effect on LLM output
The Berkeley...
The Berkeley Crossword Solver
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving...
over a year ago
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving American-style crossword puzzles. The BCS combines neural question answering and probabilistic inference to achieve near-perfect performance on most American-style crossword...
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Made by Ollin
A Video History of Self-Driving Cars
over a year ago
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 