Marcus on AI
The impeccable logic of Sam Altman
From a Bloomberg interview, spotted and summarized by Harlan Stewart, presented without further...
a week ago
From a Bloomberg interview, spotted and summarized by Harlan Stewart, presented without further comment:
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text.
Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Strange Loop Canon
Evaluations are all we need
On analysing talent in LLMs
a year ago
On analysing talent in LLMs
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
9 months ago
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now
.post-header h1 {
font-size: 35px;
}
.post pre,
.post code {
background-color: #fcfcfc;
...
over a year ago
.post-header h1 {
font-size: 35px;
}
.post pre,
.post code {
background-color: #fcfcfc;
font-size: 13px; /* make code smaller for this post... */
}
The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
Artificial Ignorance
AI Roundup 064: Big Tech's small models
April 26, 2024.
9 months ago
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
3 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Marcus on AI
Where will AI be at the end of 2027? A bet
We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI...
3 weeks ago
We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI policy researcher who recently left OpenAI and is bullish on AI progress, have agreed to the following bet, at 10:1 odds, with criteria drawn from two earlier Substack essays by Gary...
Society's Backend
How to Know if Your Data is Being Used Maliciously
The information you should know about a company before gifting them your data
a year ago
The information you should know about a company before gifting them your data
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
11 months ago
Artificial Ignorance
o3 is important, but not because of benchmarks
OpenAI's new model offers a peek at the future of AI investment.
4 weeks ago
OpenAI's new model offers a peek at the future of AI investment.
Marcus on AI
Sam Altman thinks that AGI is basically a solved problem. I don’t. Here’s why.
Yesterday Sam Altman claimed in a new blog post that “We are now confident we how to build AGI as we...
2 weeks ago
Yesterday Sam Altman claimed in a new blog post that “We are now confident we how to build AGI as we have traditionally understood it”, alleging that OpenAI (which has not demonstrated AGI) was now on to new and better things.
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
3 months ago
VC funding, here we come.
Society's Backend
Updates to Society's Backend
New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and...
10 months ago
New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and more
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
over a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
Artificial Ignorance
Saving the world with AI and government grants
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
6 months ago
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
IEEE Spectrum
The Top 7 Robotics Stories of 2024
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said...
3 weeks ago
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said before. But that’s the great thing about robotics—it’s always new, and it’s always exciting. What may be different about this year is the real sense that not only is AI going to...
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
a month ago
Fantastic writeup of my views today at The Wall Street Journal:
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
over a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Marcus on AI
Could 2025 see the largest cyberattack in history?
In a just-published series of very brief essays called “The Incredible, World-Altering ‘Black Swan’...
2 weeks ago
In a just-published series of very brief essays called “The Incredible, World-Altering ‘Black Swan’ Events That Could Upend Life in 2025”, Politico asked “15 futurists, foreign policy analysts and other prognosticators”, including me, “to provide some explosive potential...
Marcus on AI
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a month ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
One Useful Thing
Magic for English Majors
Programming in prose in an AI-haunted world
a year ago
Programming in prose in an AI-haunted world
Marcus on AI
Which CEO will be the last to see it?
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
a month ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI...
Machine learning resources and updates 2024-09-09
4 months ago
Machine learning resources and updates 2024-09-09
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Marcus on AI
PSA: Microsoft may be training on your private data without your knowledge
The Great Data Heist continues.
a month ago
The Great Data Heist continues.
Artificial Ignorance
AI Roundup 074: Amazon's Adept acquisition
July 5, 2024.
6 months ago
Artificial Ignorance
AI Roundup 050: Synthetic Geometry
January 19, 2024.
a year ago
Weighty Thoughts
Commentary on Technology, Startups, and Investing
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater...
over a year ago
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater and Google X. Co-Founder Lioness. Sign up now so you don’t miss the first issue. In the meantime, tell your friends!
Society's Backend
Multimodal Biometric Authentication, Noteworthy AI Research Papers of 2024, 5 Common Mistakes to...
Society's Backend Reading List 01-17-2025
5 days ago
Society's Backend Reading List 01-17-2025
Strange Loop Canon
Power, money and human nature
Thoughts on OpenAI, a tragedy
a year ago
Thoughts on OpenAI, a tragedy
Marcus on AI
25 AI Predictions for 2025, from Marcus on AI
With a review of last year’s predictions
2 weeks ago
With a review of last year’s predictions
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
over a year ago
A checklist for avoiding hype
Sam Altman
The Strength of Being Misunderstood
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
over a year ago
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question.
Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Artificial Ignorance
AI Roundup 083: Bioacoustics
September 6, 2024.
4 months ago
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research?
Mentions of climate change in news media vastly outnumber other existential threats
a year ago
Mentions of climate change in news media vastly outnumber other existential threats
Artificial Ignorance
YCombinator's AI boom is still going strong (W24)
Combing through all 158 YC AI startups (65% of the batch).
9 months ago
Combing through all 158 YC AI startups (65% of the batch).
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck
You can’t just blindly extrapolate compute requirements
a year ago
You can’t just blindly extrapolate compute requirements
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
IEEE Spectrum
In 2025, People Will Try Living in This Underwater Habitat
The future of human habitation in the sea is taking shape in an abandoned quarry on the border of...
3 weeks ago
The future of human habitation in the sea is taking shape in an abandoned quarry on the border of Wales and England. There, the ocean-exploration organization Deep has embarked on a multiyear quest to enable scientists to live on the seafloor at depths up to 200 meters for weeks,...
Artificial Ignorance
The State of AI Engineering
Notes from the first AI Engineer Summit.
a year ago
Notes from the first AI Engineer Summit.
Weighty Thoughts
AI Reasoning—What is It?
The Significant Implications of Test-Time Compute
5 days ago
The Significant Implications of Test-Time Compute
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Matt Mazur
When LTD Purchasers Meet an Inactive User Policy
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo...
a year ago
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo community. Maybe I’ll dive into my experience there in another post, but I wanted to share an interesting thing that’s happening now, a year after the deal ended. AppSumo has a policy...
Weighty Thoughts
China's AI Journey
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
7 months ago
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
Artificial Ignorance
AI Roundup 072: The new new Claude
June 21, 2024.
7 months ago
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Society's Backend
Scaling Laws for LLMs, the Actual Cost of Frontier Models, 3 Key Principles for AI at Scale, and...
Society's Backend Reading List 01-10-2025
a week ago
Society's Backend Reading List 01-10-2025
Weighty Thoughts
The Fall of Data Moats
AI actually makes most data moats weaker
a year ago
AI actually makes most data moats weaker
IEEE Spectrum
Robot Photographer Takes the Perfect Picture
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
2 months ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
Artificial Ignorance
Tutorial: How to streamline your writing process with Whisper and GPT-4
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
8 months ago
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave
November 8, 2024.
2 months ago
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Marcus on AI
AI still lacks “common” sense, 70 years later
What’s obvious to people still isn’t always obvious to machines
2 weeks ago
What’s obvious to people still isn’t always obvious to machines
Strange Loop Canon
State of the Canon
Onwards
a year ago
Andrej Karpathy blog
A Recipe for Training Neural Networks
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
over a year ago
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
Society's Backend
Google Leads New AI Releases, OpenAI Gives First Glimpse of AGI with o3, AI Policy Will Be...
Society's Backend Reading List 12-23-2024
4 weeks ago
Society's Backend Reading List 12-23-2024
One Useful Thing
Change blindness
21 months later
5 months ago
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
11 months ago
Five analytical tasks in under a minute
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
One Useful Thing
In Praise of Boring AI
Automation has always been about killing tedious work. AI can do the same.
a year ago
Automation has always been about killing tedious work. AI can do the same.
Artificial Ignorance
AI Roundup 069: Project Greymatter
May 31, 2024.
7 months ago
One Useful Thing
Centaurs and Cyborgs on the Jagged Frontier
I think we have an answer on whether AIs will reshape work....
a year ago
I think we have an answer on whether AIs will reshape work....
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
2 months ago
Why AI products really need some better UX.
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a month ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
a year ago
Taking AI timelines seriously
Matt Mazur
LearnGPT is now EmergentMind
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
AI Snake Oil
Tech policy is only frustrating 90% of the time
That’s what makes it worthwhile
9 months ago
That’s what makes it worthwhile
Artificial Ignorance
AI Roundup 067: GPT-4o and Google I/O
May 17, 2024.
8 months ago
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news...
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
One Useful Thing
Acceleration.
7 days of new AI technologies shows us that everything is happening very fast.
a year ago
7 days of new AI technologies shows us that everything is happening very fast.
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Daniel Miessler
NO. 369 | Reddit Hack, Deepfake Scams, Embracing Change…
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank...
a year ago
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank you! SECURITY Reddit has confirmed it was hacked, and it’s recommending users add 2FA. The attack started by phishing Reddit employees and stealing credentials and 2FA codes. After...
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
5 months ago
A critical question for investors in AI
Daniel Miessler
Companies as Alaskan Fishing Boats
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest...
over a year ago
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest Catch. So you have this tiny crew of total badasses. Everyone is a superhero at their particular role because the crew needs to stay extremely small to protect profits. The...
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Daniel Miessler
Your Experience is Your Creativity
Creativity is usually described as an external force that graces you with inspiration. Something...
over a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
IEEE Spectrum
Video Friday: Happy Holidays!
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Artificial Ignorance
AI Roundup 085: You win some, you Newsom
September 20, 2024.
4 months ago
Matt Mazur
Emergent Mind in The Atlantic
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The...
a year ago
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The Atlantic who asked Caroline Mimbs Nyce, one of their reporters, to look into it. Caroline interviewed me for the article they just published which focused on the challenges Google is...
Marcus on AI
“LLMs amplify existing security risks and introduce new ones”
also: “the work of securing AI systems will never be complete”
6 days ago
also: “the work of securing AI systems will never be complete”
One Useful Thing
On speaking to AI
Voice changes a lot of things
5 months ago
Voice changes a lot of things
IEEE Spectrum
Video Friday: Reachy 2
IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few...
3 months ago
IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU DHABI, UAE
ICSR 2024: 23–26 October 2024, ODENSE, DENMARK
Cybathlon 2024: 25–27 October 2024,...
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
Marcus on AI
Breaking news: AGI is not imminent!
Influencers have gone wild lately claiming that AGI is imminent.
2 days ago
Influencers have gone wild lately claiming that AGI is imminent.
IEEE Spectrum
Robot Gets Up Close to the Seabed Without Disturbing It
Seabed observation plays a major role in safeguarding marine systems by keeping tabs on the species...
yesterday
Seabed observation plays a major role in safeguarding marine systems by keeping tabs on the species and habitats on the ocean floor at different depths. This is primarily done by underwater robots that use optical imaging to collect high quality data that can be fed into...
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
11 months ago
Artificial Ignorance
AI Roundup 042: sama drama
November 24, 2023.
a year ago
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More
Discussions from the past week: 09/16/2024
4 months ago
Discussions from the past week: 09/16/2024
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
2 months ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Rozado’s Visual...
An Analysis of AI Political Preferences from a European Perspective
Introduction
2 months ago
Weighty Thoughts
My Book's Pre-Sale is Live!
Reserve an early copy and get other goodies
3 days ago
Reserve an early copy and get other goodies
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
Weighty Thoughts
What is Defensibility?
Back to basics for AI startups and others
9 months ago
Back to basics for AI startups and others
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
8 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community
The timeline and why OpenAI’s actions are a big deal
8 months ago
The timeline and why OpenAI’s actions are a big deal
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
11 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
Society's Backend
3 Key Principles for AI at Scale [Part 2]
The key to how large AI companies outcompete
2 weeks ago
The key to how large AI companies outcompete
Weighty Thoughts
Deep Tech Startups Are Not Software Startups
Or why AI and “Software/SaaS” are apples and oranges
11 months ago
Or why AI and “Software/SaaS” are apples and oranges
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on...
a year ago
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr:
The emerging LLM stack is composed of several elements centered...
Weighty Thoughts
News Roundup: May 27, 2014 🧴
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
7 months ago
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
One Useful Thing
On-boarding your AI Intern
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
Sam Altman
Funding for COVID-19 Projects
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help. I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on:
Producing a lot of ventilators or...
Artificial Ignorance
AI Roundup 100: CES
January 10, 2025.
a week ago
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
over a year ago
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another.
Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...
Rozado’s Visual...
The Political Preferences of LLMs
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
11 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and...
Machine learning resources and updates 8/19/2024
5 months ago
Machine learning resources and updates 8/19/2024
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
3 months ago
Society's Backend
One Year of Society's Backend
The lessons I've learned along the way
5 months ago
The lessons I've learned along the way
Strange Loop Canon
Progress
when benefits are worth tallying the human cost of technological leaps
a year ago
when benefits are worth tallying the human cost of technological leaps
Artificial Ignorance
The greatest movies never made
A look into the world of AI-generated movie trailer slop.
a week ago
A look into the world of AI-generated movie trailer slop.
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Marcus on AI
Update re: Microsoft and training data
Relevant to the post I sent earlier today,...
a month ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
Artificial Ignorance
The subscriptionization of AI
Navigating the paid AI landscape.
10 months ago
Navigating the paid AI landscape.
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
7 months ago
The mystery of why we don't dream of building perfect societies anymore
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
over a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
IEEE Spectrum
Video Friday: ICRA Turns 40
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
9 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Artificial Ignorance
AI Roundup 044: Google Gemini
December 8, 2023.
a year ago
IEEE Spectrum
Video Friday: Multiple MagicBots
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Artificial Ignorance
AI Roundup 070: AI whistleblowers
June 7, 2024.
7 months ago
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
Jascha’s blog
Neural network training makes beautiful fractals
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
11 months ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
.vimeo-player {
position: relative;
width: 444px;
height: 444px;
...
Matt Mazur
Introducing Preceden’s new AI-Powered Timeline Generator
For the past few months I’ve been heads down building an AI-powered timeline generator tool for...
a year ago
For the past few months I’ve been heads down building an AI-powered timeline generator tool for Preceden, my SaaS timeline maker software: The tool – which is free to use and available on Preceden’s homepage – lets you type in a topic or detailed description of a timeline and it...
The Gradient
Salmon in the Loop
On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
Sam Altman
Hard Startups
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
over a year ago
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one. A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
fast.ai
Mojo may be the biggest programming language advance in decades
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment...
a year ago
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment problems.
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a month ago
Exactly as I warned in February
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
Artificial Ignorance
AI Roundup 058: Devin and SIMA
March 15, 2023.
10 months ago
Sam Altman
Time to Take a Stand
It is time for tech companies to start speaking up about
some of the actions taken by President...
over a year ago
It is time for tech companies to start speaking up about
some of the actions taken by President Trump’s administration.
There are many actions from his first week that are
objectionable. In repeatedly
invoking unsubstantiated conspiracy theories (like the 3 million...
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
a month ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Strange Loop Canon
OpenAI's Strawberry models can reason like an expert
When models can think
4 months ago
Society's Backend
An AI Revolution Isn't Coming - We're Already In It
A small showcase of companies using AI in ways that will change your life
a year ago
A small showcase of companies using AI in ways that will change your life
One Useful Thing
The Best Available Human Standard
What are the imperatives of the upside?
a year ago
What are the imperatives of the upside?
Stories by Andrej...
Yes you should understand backprop
over a year ago
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Artificial Ignorance
AI Roundup 081: Creative differences
August 23, 2024.
5 months ago
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition
August 9, 2024.
5 months ago
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
AI Reading List 3: Meta's Self-Taught Evaluator, AI for Cancer Diagnosis, and a Technical...
Society's Backend Reading List 10-21-2024
3 months ago
Society's Backend Reading List 10-21-2024
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
11 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric...
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
Society's Backend
Always Be Networking
The things you should know about effective networking
a year ago
The things you should know about effective networking
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
6 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
2 months ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
a year ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
IEEE Spectrum
Video Friday: Agile Upgrade
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
5 days ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
RoboCup German Open: 12–16 March...
Artificial Ignorance
GPT-4o and the illusion of AGI
Why speed and multimodality is becoming the name of the game.
8 months ago
Why speed and multimodality is becoming the name of the game.
One Useful Thing
On the necessity of a sin
Why treating AI like a person is the future
9 months ago
Why treating AI like a person is the future
IEEE Spectrum
Ensuring the Security and Resilience of Autonomous Fleets with Advanced Testing Frameworks
Autonomous systems, particularly fleets of drones and other unmanned vehicles, face increasing risks...
2 weeks ago
Autonomous systems, particularly fleets of drones and other unmanned vehicles, face increasing risks as their complexity grows. Despite advancements, existing testing frameworks fall short in addressing end-to-end security, resilience, and safety in zero-trust environments. The...
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning
function reveal() {
const replay = document.querySelector('.ddpo-replay');
...
a year ago
function reveal() {
const replay = document.querySelector('.ddpo-replay');
replay.style.display = 'flex';
}
window.onload = () => {
const replay = document.querySelector('.ddpo-replay');
replay.addEventListener('click', () => {
...
Artificial Ignorance
Bridging AI and human creativity
A conversation with Harrison Telyan, co-founder of NUMI.
11 months ago
A conversation with Harrison Telyan, co-founder of NUMI.
Society's Backend
Would You Build the Manhattan Project in the UAE?
Thoughts on AI national security threats
7 months ago
Thoughts on AI national security threats
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
2 months ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
IEEE Spectrum
Video Friday: Unitree Talent Awakening
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
a month ago
Society's Backend Reading List 12-2-2024
Marcus on AI
Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
a month ago
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good.
Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Teachers adapted to the calculator. They can certainly adapt to language models.
Matt Mazur
Running Mistral 7B Instruct on a Macbook
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to...
a year ago
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct...
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
3 months ago
“Connectionist” vs. Knowledge-Based AI
Made by Ollin
Game Emulation via Neural Network
over a year ago
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
3 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem
December 22, 2023.
a year ago
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
over a year ago
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a month ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
4 months ago
Machine learning highlights and resources 9-23-24
Strange Loop Canon
Slouching Towards Utopia
by Brad DeLong
a year ago
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
10 months ago
The future of entertainment is going to be a wild ride.
One Useful Thing
Latent Expertise: Everyone is in R&D
Ideas come from the edges, not the center
7 months ago
Ideas come from the edges, not the center
Weighty Thoughts
What’s coming next for AI in 2024
A long overdue VC apocalypse and the birth of the first real AI companies
a year ago
A long overdue VC apocalypse and the birth of the first real AI companies
Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
2 months ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task.
This video is notable because it’s the first real look we’ve had at the new Atlas doing...
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
over a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Artificial Ignorance
AI Roundup 055: Race conditions
February 23, 2023.
11 months ago
Society's Backend
A Privacy Review: TikTok
You should stick to Instagram Reels and YouTube Shorts
a year ago
You should stick to Instagram Reels and YouTube Shorts
Artificial Ignorance
10 AI stories that shaped 2024
Agents, deepfakes, Strawberries, and more.
3 weeks ago
Agents, deepfakes, Strawberries, and more.
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
5 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
Artificial Ignorance
AI Roundup 052: AI, EO, DPA
February 2, 2024.
11 months ago
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
3 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
The Berkeley...
Rethinking the Role of PPO in RLHF
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Rozado’s Visual...
The political preferences of Grok
Elon Musk's response to ChatGPT
a year ago
Elon Musk's response to ChatGPT
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Artificial Ignorance
AI Roundup 057: Claude 3
March 8, 2024.
10 months ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing
January 26, 2024.
12 months ago
Artificial Ignorance
AI Roundup 026: AudioCraft
August 4, 2023
a year ago
Society's Backend
All Machine Learning Resources and Updates 06/21/2024
Below are the machine learning resources and updates from the past few days you don't want to miss....
7 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Artificial Ignorance
Jevons Paradox and the future of programming
Supply and demand in the Age of AI.
10 months ago
Supply and demand in the Age of AI.
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received
And how it changed my personal life too
a year ago
And how it changed my personal life too
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
Marcus on AI
Casey (Newton) Strikes Out
His continued skepticism of AI skepticism continues to miss the mark
a month ago
His continued skepticism of AI skepticism continues to miss the mark
IEEE Spectrum
Video Friday: Sleepy Robot Baby
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
RoboCup German Open: 12–16 March...
Marcus on AI
The 2023 White House Executive Order on AI has Been Rescinded
See here.
yesterday
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
10 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
AI Snake Oil
Scientists should use AI as a tool, not an oracle
How AI hype leads to flawed research that fuels more hype
7 months ago
How AI hype leads to flawed research that fuels more hype
Strange Loop Canon
The age of access
the great polarisation theory, and the death of professions
a year ago
the great polarisation theory, and the death of professions
One Useful Thing
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
a year ago
It took me a few minutes to create a fake me giving a fake lecture.
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth?
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
4 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Made by Ollin
HintBot
Hinting icons automatically with a neural network
over a year ago
Hinting icons automatically with a neural network
Matt Mazur
Screw it, I’m Keeping Emergent Mind
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
a month ago
Scaling laws were supposed to be, well, laws.
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns
Science, sociology, and the likely financial collapse of the Generative AI bubble
2 months ago
Science, sociology, and the likely financial collapse of the Generative AI bubble
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Daniel Miessler
The 2 Current Major AI Bottlenecks
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Weighty Thoughts
What I got Right or Wrong in 2020
Reflecting on the Past Year
over a year ago
Reflecting on the Past Year
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
4 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
Rozado’s Visual...
The Great Awokening as a Global Phenomenon
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
Matt Mazur
Full Time Indie Hacking: Month 5 Update
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
5 months ago
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
9 months ago
And a consideration for choosing a language
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
5 months ago
What people (still) fundamentally misunderstand about AI search.
Matt Mazur
Sharing small, incremental updates with users
I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
5 months ago
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
8 months ago
Inside Stability AI's roster of AI models.
One Useful Thing
Setting time on fire and the temptation of The Button
We used to consider writing an indication of time and effort spent on a task. That isn't true...
a year ago
We used to consider writing an indication of time and effort spent on a task. That isn't true anymore.
Daniel Miessler
Unsupervised Learning NO. 365 | China’s Decline, MicrosoftAI, Creativity Ratio…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
over a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS NYC Surveillance Amnesty International has revealed new research showing that the NYPD has over 15,000 cameras that can do...
The Berkeley...
The Berkeley Crossword Solver
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving...
over a year ago
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving American-style crossword puzzles. The BCS combines neural question answering and probabilistic inference to achieve near-perfect performance on most American-style crossword...
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
2 months ago
One Useful Thing
It is starting to get strange.
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
a year ago
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
Society's Backend
Resources to Get a Job in ML, Post-Transformer Architectures, What's in Store for 2025, and More
Society's Backend Reading List 12-30-2024
3 weeks ago
Society's Backend Reading List 12-30-2024
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
over a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Society's Backend
Why Software Engineers Need to Understand Machine Learning
And how ML helps software engineers in their daily work
7 months ago
And how ML helps software engineers in their daily work
Artificial Ignorance
AI Roundup 040: GPTs
November 10, 2023.
a year ago
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴
Siri versus the machine god?
7 months ago
Siri versus the machine god?
Frank’s Ramblings
Vision Transformers are Overrated
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
a year ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers
Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Content creation and networking lessons from a wildly successful freelance tech writer
Artificial Ignorance
AI Roundup 056: Data deals
March 1, 2024.
10 months ago
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
2 months ago
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for their job
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
3 months ago
finding the new equilibrium for the next superpower
One Useful Thing
Scaling: The State of Play in AI
A brief intergenerational pause...
4 months ago
A brief intergenerational pause...
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
10 months ago
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
2 months ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.”
Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Strange Loop Canon
No, LLMs are not "scheming"
a month ago
Daniel Miessler
What Made the 90’s So Awesome?
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a month ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
Artificial Ignorance
AI Roundup 101: Strange bedfellows
January 17, 2025.
5 days ago
Society's Backend
Why Machine Learning Terminology is So Confusing
And definitions for the most important terms you should know
11 months ago
And definitions for the most important terms you should know
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
a month ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
a year ago
And why it might revolutionize the search industry.
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty.
“Life can only be understood backwards, but it must be lived forwards.”
10 months ago
“Life can only be understood backwards, but it must be lived forwards.”
Stories by Andrej...
Virtual Reality: still not quite there, again.
over a year ago
One Useful Thing
On giving AI eyes and ears
AI can listen and see, with bigger implications than we might realize.
a year ago
AI can listen and see, with bigger implications than we might realize.
One Useful Thing
I hope you weren't getting too comfortable.
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits...
a year ago
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits of AI were wrong.
Society's Backend
Why Machine Learning Systems Misbehave
And what makes them so difficult to work with
6 months ago
And what makes them so difficult to work with
The Berkeley...
TinyAgent: Function Calling at the Edge
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
7 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
Artificial Ignorance
AI Roundup 075: Levels of AGI
July 12, 2024.
6 months ago
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection
Authors: PromptArmor
5 months ago
Weighty Thoughts
The EU is making itself an economic backwater
Regulation is not a real export
6 months ago
Regulation is not a real export
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
...
over a year ago
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
font-weight: 300;
overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */
}
.post pre,
.post code {
background-color: #fafafa;
font-size: 13px; /*...
Strange Loop Canon
What can LLMs never do?
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
9 months ago
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI
March 22, 2023.
10 months ago
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
a year ago
Output similarity is a distraction
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 