Society's Backend
If You Understand Bananas, You Can Understand Machine Learning
A simplified high-level overview of primary machine learning algorithms for anyone to understand
11 months ago
A simplified high-level overview of primary machine learning algorithms for anyone to understand
Weighty Thoughts
Let's talk about AI power costs
It's important, but a lot of recent attention has been concern-trolling
4 months ago
It's important, but a lot of recent attention has been concern-trolling
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
a month ago
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for their job
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
Rozado’s Visual...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system
Should AI systems treat different demographic groups unequally?
a year ago
Should AI systems treat different demographic groups unequally?
Society's Backend
Artificial Intelligence: A New Paradigm Emerges
A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
A realistic perspective of the advantages and pitfalls of artificial intelligence
Society's Backend
What Makes Machine Learning so Hard for Software Engineers
How decades of learning a mindset makes adapting difficult
4 months ago
How decades of learning a mindset makes adapting difficult
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
Stories by Andrej...
A Peek at Trends in Machine Learning
over a year ago
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers
Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Content creation and networking lessons from a wildly successful freelance tech writer
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴
Siri versus the machine god?
6 months ago
Siri versus the machine god?
One Useful Thing
An AI Haunted World
Intelligence, everywhere.
a year ago
Intelligence, everywhere.
Frank’s Ramblings
A Gentle Introduction to Vector Databases
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium,...
over a year ago
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium, and DZone.
If you have any feedback, feel free to connect with me on Twitter or Linkedin. If you enjoyed this post and want to learn a bit more about vector databases and embeddings...
The Gradient
Why transformative artificial intelligence is really, really hard to achieve
A collection of the best technical, social, and economic arguments
Humans have a good track record...
a year ago
A collection of the best technical, social, and economic arguments
Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Andrej Karpathy blog
Self-driving as a case study for AGI
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
11 months ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Made by Ollin
Acapella Extraction with ConvNets
A working prototype
over a year ago
Artificial Ignorance
Stop begging for JSON
How OpenAI's Structured Outputs makes building with AI much more reliable.
a week ago
How OpenAI's Structured Outputs makes building with AI much more reliable.
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Strange Loop Canon
Mind the Gap
from empire to umpire
a year ago
Strange Loop Canon
Seeing Like A Network
Dark Forests, Dense Networks
6 months ago
Dark Forests, Dense Networks
Society's Backend
All Machine Learning Resources and Updates 7/8/24
Everything I've been reading
5 months ago
Everything I've been reading
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
4 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon
How your greatest asset is silently stolen by technology every day
a year ago
How your greatest asset is silently stolen by technology every day
Artificial Ignorance
AI Roundup 088: Movie magic
October 11, 2024.
2 months ago
Society's Backend
MatMul-free Machine Learning Can Improve Efficiency, Excellent Foundational Learning Resources, SSMs...
The top 10 most important updates of last week: 7/8/24
5 months ago
The top 10 most important updates of last week: 7/8/24
Strange Loop Canon
Slouching Towards Utopia
by Brad DeLong
a year ago
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth?
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
3 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
Marcus on AI
Satya Nadella and the three stages of scientific truth
A textbook case in how good ideas are often initially throttled
4 weeks ago
A textbook case in how good ideas are often initially throttled
AI Snake Oil
OpenAI’s policies hinder reproducible research on language models
LLMs have become privately-controlled research infrastructure
a year ago
LLMs have become privately-controlled research infrastructure
AI Snake Oil
What the executive order means for openness in AI
Good news on paper, but the devil is in the details
a year ago
Good news on paper, but the devil is in the details
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Artificial Ignorance
AI Roundup 042: sama drama
November 24, 2023.
a year ago
Society's Backend
One Year of Society's Backend
The lessons I've learned along the way
4 months ago
The lessons I've learned along the way
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a week ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Andrej Karpathy blog
Short Story on AI: A Cognitive Discontinuity.
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind...
over a year ago
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at a story, and what better way to kick things off than with a story on AI and what that might look like if you...
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
a month ago
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave
November 8, 2024.
a month ago
Marcus on AI
An AI rumor you won’t want to miss
Converging evidence that the core hypothesis driving generative AI may be wrong
a month ago
Converging evidence that the core hypothesis driving generative AI may be wrong
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
4 months ago
Sam Altman
Join the YC Software Team
If you want to get funded by YC as a founder in the future, but you don't have a startup that's...
over a year ago
If you want to get funded by YC as a founder in the future, but you don't have a startup that's ready for that yet, joining the YC software team is a great hack to get there.
The YC software team is a small group of hackers in SF that write the software that makes all the parts...
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards
Counterintuitively, start from how much money you need
over a year ago
Counterintuitively, start from how much money you need
Artificial Ignorance
AI Roundup 069: Project Greymatter
May 31, 2024.
6 months ago
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
Rozado’s Visual...
DepolarizingGPT
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Artificial Ignorance
The ideologies fighting for the soul (and future) of AI
EAs, e/accs, decels, and doomers.
a year ago
EAs, e/accs, decels, and doomers.
Artificial Ignorance
AI Roundup 097: Model Mayhem
December 13, 2024.
a week ago
Artificial Ignorance
Workshop: Midjourney Masterclass with Daniel Nest
“This is one of the only webinars where I've actually been glued to my screen for the entire time,...
3 months ago
“This is one of the only webinars where I've actually been glued to my screen for the entire time, not distracted by passing whimsies...
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI...
Machine learning resources and updates 2024-09-09
3 months ago
Machine learning resources and updates 2024-09-09
IEEE Spectrum
How Amazon Is Changing the Future of Robotics and Logistics
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you...
6 days ago
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you have a good idea,” said Valerie Samzun, a leader in Amazon’s Fulfillment Technologies and Robotics (FTR) division. “It happens because you have the right team, the right...
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
Artificial Ignorance
AI's invisible instructions
What meme prompts can teach us about better interface design.
2 months ago
What meme prompts can teach us about better interface design.
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse?
Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Providing a technical perspective for a more educated assessment of a complaint I hear quite frequently
Artificial Ignorance
The intern and the coach
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Sam Altman
Helion
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
over a year ago
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen.
David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty.
“Life can only be understood backwards, but it must be lived forwards.”
9 months ago
“Life can only be understood backwards, but it must be lived forwards.”
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
Artificial Ignorance
AI Roundup 045: Google's just getting started
December 15, 2023.
a year ago
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
5 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches
If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
2 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Matt Mazur
When you ship a major bug before signing off for the day
For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning
You probably know more about machine learning math than you think
10 months ago
You probably know more about machine learning math than you think
Weighty Thoughts
Let’s Talk About AI Compute
What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
What really matters and why AI computing is exactly the same as all other large-scale computing
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on...
a year ago
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr:
The emerging LLM stack is composed of several elements centered...
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
3 weeks ago
Scaling laws were supposed to be, well, laws.
Artificial Ignorance
Saving the world with AI and government grants
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
5 months ago
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
IEEE Spectrum
Robot Photographer Takes the Perfect Picture
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
Rozado’s Visual...
Pessimism in News Media Headlines
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Artificial Ignorance
AI Roundup 044: Google Gemini
December 8, 2023.
a year ago
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
12 months ago
Hey Siri, set a reminder for 365 days.
Society's Backend
The Unfortunate Truth Regarding AI Regulation
And the impact it'll have for decades to come
6 months ago
And the impact it'll have for decades to come
Made by Ollin
Emojin
An infinite kaomoji generator
over a year ago
An infinite kaomoji generator
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
7 months ago
Inside Stability AI's roster of AI models.
Weighty Thoughts
VC Office Hours
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
10 months ago
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
Weighty Thoughts
Today’s AI critics don’t understand the history of technology
But is AI different than other technologies?
9 months ago
But is AI different than other technologies?
Society's Backend
No One Should Be GPU Poor
For everyone to have access to AGI, everyone must also have access to the compute to use it
7 months ago
For everyone to have access to AGI, everyone must also have access to the compute to use it
Weighty Thoughts
Apple Wins
Apple Intelligence and aggregation puts Apple in a dominant AI position
6 months ago
Apple Intelligence and aggregation puts Apple in a dominant AI position
Artificial Ignorance
The State of AI Engineering (2024)
Notes from the AI Engineer World's Fair.
5 months ago
Notes from the AI Engineer World's Fair.
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
a month ago
Why AI products really need some better UX.
Society's Backend
A Privacy Review: Google
I read Google's privacy policy for you
a year ago
I read Google's privacy policy for you
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
AI Snake Oil
AI safety is not a model property
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
9 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
Society's Backend
Weekly Backend #7: 39 Resources and Updates
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
7 months ago
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture
The actual takeaways from the iPhone 15 event
a year ago
The actual takeaways from the iPhone 15 event
Daniel Miessler
News & Analysis | NO. 353
over a year ago
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
10 months ago
Daniel Miessler
Why Apple Keeps Winning
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
The Gradient
Interpretability Creationism
On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
Jascha’s blog
Neural network training makes beautiful fractals
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
10 months ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
.vimeo-player {
position: relative;
width: 444px;
height: 444px;
...
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
Society's Backend
Welcome to 2024: The Year Where AI is No Longer an Option
Why everyone should learn about machine learning
11 months ago
Why everyone should learn about machine learning
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
11 months ago
And other practical guides to understand machine learning
Society's Backend
Why Machine Learning Terminology is So Confusing
And definitions for the most important terms you should know
10 months ago
And definitions for the most important terms you should know
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
Artificial Ignorance
The hidden side of Apple Intelligence
More than just another keynote recap.
6 months ago
More than just another keynote recap.
Rozado’s Visual...
The Political Preferences of LLMs
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
10 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Strange Loop Canon
Symposium: On Building God
a year ago
The Gradient
Text-to-CAD: Risks and Opportunities
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Society's Backend
The Slow, Painful Death of the Free Content Creator
It's happening as you read this
a year ago
It's happening as you read this
Weighty Thoughts
When the AI Bubble Bursts
It’s when, not if, for these kinds of new technologies
6 months ago
It’s when, not if, for these kinds of new technologies
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
11 months ago
And why it might revolutionize the search industry.
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit
August 18, 2023
a year ago
Artificial Ignorance
Distributing the future
A reminder that things take time.
6 months ago
A reminder that things take time.
AI Snake Oil
Tech policy is only frustrating 90% of the time
That’s what makes it worthwhile
8 months ago
That’s what makes it worthwhile
One Useful Thing
Blinded by Analogies
What is this AI thing? The wrong model can lead us astray
a year ago
What is this AI thing? The wrong model can lead us astray
Andrej Karpathy blog
(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
over a year ago
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but
whenever I do get a chance to post something I have recently been defaulting
to doing it on Medium because...
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More
Discussions from the past week: 09/16/2024
3 months ago
Discussions from the past week: 09/16/2024
Daniel Miessler
UL NO. 354 | THE NEWS & ANALYSIS SERIES
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from...
over a year ago
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from attaining advanced semiconductors. And now it looks like the bans will be expanded to quantum computing and AI as well. NYTIMES | MY ANALYSIS BELOW It appears Bytedance had a plan to...
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Society's Backend
All Machine Learning Resources and Updates 06/14/2024
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve...
6 months ago
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve decided to try out separating paid/free updates. I’m constantly trying new ways to make information consumption easier for you while working within the confines of the platforms...
Sam Altman
PG and Jessica
A lot of people want to replicate YC in some other industry or some other place or with some other...
over a year ago
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
11 months ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
Matt Mazur
LearnGPT is now EmergentMind
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
The Gradient
A Brief Overview of Gender Bias in AI
A brief overview and discussion on gender bias in AI
8 months ago
A brief overview and discussion on gender bias in AI
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
3 weeks ago
Weighty Thoughts
The AI Executive Order
AKA: “We’ll do something about it later”
a year ago
AKA: “We’ll do something about it later”
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck
You can’t just blindly extrapolate compute requirements
a year ago
You can’t just blindly extrapolate compute requirements
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
Daniel Miessler
Using Custom Searches in Safari (in 2022)
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
10 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Marcus on AI
PSA: Microsoft may be training on your private data without your knowledge
The Great Data Heist continues.
3 weeks ago
The Great Data Heist continues.
Strange Loop Canon
What can LLMs never do?
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
8 months ago
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
One Useful Thing
Using AI to make teaching easier & more impactful
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
Society's Backend
Meta's New Segmentation Model, A New Open-Source Image Generation Model, Apple Intelligence Model...
Machine learning resources and updates 8/5/2024
4 months ago
Machine learning resources and updates 8/5/2024
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice...
Society's Backend Reading List 11-18-2024
a month ago
Society's Backend Reading List 11-18-2024
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
8 months ago
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
Artificial Ignorance
AI Roundup 096: Happy Shipmas
December 6, 2024.
2 weeks ago
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
6 months ago
The mystery of why we don't dream of building perfect societies anymore
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
Weighty Thoughts
Software Engineering is Doomed
Or is it?
5 months ago
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
Artificial Ignorance
AI Roundup 056: Data deals
March 1, 2024.
9 months ago
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
Daniel Miessler
My Mom Died on Saturday
My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
Matt Mazur
Is the ChatGPT API Refusing to Summarize Academic Papers? Not so fast.
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API...
11 months ago
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API indicating that it was refusing to summarize arXiv papers: There has been a lot of discussion recently about the perceived decrease in the quality of ChatGPT’s responses and seeing...
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
Made by Ollin
NVIDIA Internship (2017)
Notes on my internship at NVIDIA Redmond.
over a year ago
Notes on my internship at NVIDIA Redmond.
Society's Backend
Run Your Own Race
What Bluey can teach us about machine learning
8 months ago
What Bluey can teach us about machine learning
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
2 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
4 months ago
A critical question for investors in AI
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering
And isn't that we're all going to lose our jobs
9 months ago
And isn't that we're all going to lose our jobs
One Useful Thing
Confronting Impossible Futures
We shouldn't be certain about what is next, but we should plan for it
5 months ago
We shouldn't be certain about what is next, but we should plan for it
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
9 months ago
The future of entertainment is going to be a wild ride.
One Useful Thing
The practical guide to using AI to do stuff
A resource for students in my classes (and other interested people).
a year ago
A resource for students in my classes (and other interested people).
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
11 months ago
Taking AI timelines seriously
Artificial Ignorance
AI Roundup 036: The money pit
October 13, 2023.
a year ago
Weighty Thoughts
Open AI's Valuation and a Favor to Ask
A guest post and an in-person panel
4 months ago
A guest post and an in-person panel
Artificial Ignorance
AI Roundup 037: The AI IPCC
October 20, 2023.
a year ago
One Useful Thing
15 Times to use AI, and 5 Not to
Notes on the Practical Wisdom of AI Use
a week ago
Notes on the Practical Wisdom of AI Use
Weighty Thoughts
China's AI Journey
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
Sam Altman
Time to Take a Stand
It is time for tech companies to start speaking up about
some of the actions taken by President...
over a year ago
It is time for tech companies to start speaking up about
some of the actions taken by President Trump’s administration.
There are many actions from his first week that are
objectionable. In repeatedly
invoking unsubstantiated conspiracy theories (like the 3 million...
fast.ai
Practical Deep Learning for Coders 2022
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
2 months ago
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
3 weeks ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
Artificial Ignorance
AI Roundup 035: Me or your lying eyes
October 6, 2023.
a year ago
AI Snake Oil
Generative AI companies must publish transparency reports
The debate about the harms of AI is happening in a data vacuum
a year ago
The debate about the harms of AI is happening in a data vacuum
One Useful Thing
The Homework Apocalypse
Fall is going to be very different this year. Educators need to be ready.
a year ago
Fall is going to be very different this year. Educators need to be ready.
Society's Backend
The Problem with American Emergency Alerts
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia
And how our media is failing, wildly, in one of the most important stories in US history
a month ago
And how our media is failing, wildly, in one of the most important stories in US history
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Artificial Ignorance
YC is now 80% AI startups (S24)
Analyzing the latest companies out of "AI Combinator"
2 months ago
Analyzing the latest companies out of "AI Combinator"
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report
And my notes on why they’re important
8 months ago
And my notes on why they’re important
Artificial Ignorance
AI Roundup 048: The Robot Constitution
January 5, 2024.
11 months ago
Daniel Miessler
News & Analysis | NO. 350
over a year ago
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
All of us, except the AI startups and VCs—unless a real war breaks out
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
IEEE Spectrum
Video Friday: Trick or Treat, Atlas
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Artificial Ignorance
Small newsletters, big ideas
A subscriber showcase full of hidden gems on Substack.
6 days ago
A subscriber showcase full of hidden gems on Substack.
Matt Mazur
It’s Time to Build
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
10 months ago
Five analytical tasks in under a minute
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
a month ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.”
Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
One Useful Thing
Gradually, then Suddenly: Upon the Threshold
Small improvements can lead to big changes
5 months ago
Small improvements can lead to big changes
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and...
Society's Backend Reading List 11-04-2024
a month ago
Society's Backend Reading List 11-04-2024
Matt Mazur
Don’t Self Host Unlicensed Proxima Nova Fonts
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time...
a year ago
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time I was loading Proxima Nova on Preceden via Typekit (a hosted web font service) for $49.99/year, but at some point I decided to self-host it to avoid the third party request which...
Sam Altman
A Clarification
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to...
over a year ago
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to clarify it.
I didn’t mean that we need to tolerate brilliant homophobic
jerks in the lab so that we can have scientific progress.
Although there are famous...
Marcus on AI
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a week ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
IEEE Spectrum
Video Friday: Mars Chopper
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
Strange Loop Canon
Predicting AI
I revisit past predictions
3 months ago
I revisit past predictions
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a week ago
Exactly as I warned in February
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
fast.ai
Qualitative humanities research is crucial to AI
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
One Useful Thing
A prosthesis for imagination: Using AI to boost your creativity
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
a year ago
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
Frank’s Ramblings
My Experience Living and Working in China, Part I
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
Society's Backend
LLM Research Recap of 2024, Fine-tuning LLM Judges, Amazon's Nova Models, Google's Genie 2, and More
Society's Backend Reading List 12-10-2024
a week ago
Society's Backend Reading List 12-10-2024
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there
Contra Hoel on AI and its supply paradox
a year ago
Contra Hoel on AI and its supply paradox
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs
Also, we have a prompt library!
9 months ago
Also, we have a prompt library!
Artificial Ignorance
AI Roundup 029: Hug all the faces
August 25, 2023
a year ago
Sam Altman
How To Invest In Startups
There is a lot of advice about how to be a good startup founder. But there isn’t very much about...
over a year ago
There is a lot of advice about how to be a good startup founder. But there isn’t very much about how to be a good startup investor.
Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
Society's Backend
Always Be Networking
The things you should know about effective networking
a year ago
The things you should know about effective networking
One Useful Thing
Thinking companion, companion for thinking
Some simple ways to use AI to break you out of biases
a year ago
Some simple ways to use AI to break you out of biases
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns
Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
Science, sociology, and the likely financial collapse of the Generative AI bubble
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
Artificial Ignorance
How to leverage long form content with AI
Specific tools and tactics for authors, podcasters, and videographers.
6 months ago
Specific tools and tactics for authors, podcasters, and videographers.
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
One Useful Thing
Democratizing the future of education
We are all EdTech designers, now
a year ago
We are all EdTech designers, now
Matt Mazur
Indie Hacking Week 1 Recap: Starting TimelineGPT, Ending LearnGPT
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good...
a year ago
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good groove as far as my daily routine, but I don’t think it’s quite sunk in yet how much flexibility I have in terms of my daily schedule. For example, I’m still waking up early to […]
One Useful Thing
Feats to astonish and amaze
A compendium of things I didn't think AI should be able to do
a year ago
A compendium of things I didn't think AI should be able to do
Artificial Ignorance
Milestones, motivations, and miscellany
Some thoughts on the future of this newsletter.
5 months ago
Some thoughts on the future of this newsletter.
Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
AI Snake Oil
I set up a ChatGPT voice interface for my 3-year old. Here’s how it went.
Chatbots are likely to revive familiar debates about kids and apps
a year ago
Chatbots are likely to revive familiar debates about kids and apps
Society's Backend
Coming soon!
Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
fast.ai
Masks for COVID: Updating the evidence
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested.
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Weighty Thoughts
News Roundup: May 27, 2014 🧴
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
6 months ago
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
Artificial Ignorance
The State of AI Engineering
Notes from the first AI Engineer Summit.
a year ago
Notes from the first AI Engineer Summit.
Matt Mazur
Emergent Mind in The Atlantic
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The...
a year ago
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The Atlantic who asked Caroline Mimbs Nyce, one of their reporters, to look into it. Caroline interviewed me for the article they just published which focused on the challenges Google is...
Strange Loop Canon
The agent principal problem
"Show me the incentive and I will show you the outcome."
a year ago
"Show me the incentive and I will show you the outcome."
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
3 months ago
Machine learning highlights and resources 9-23-24
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
Strange Loop Canon
AI embraces its product arc
fuzzy processors are entering mass production
7 months ago
fuzzy processors are entering mass production
One Useful Thing
On-boarding your AI Intern
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
Artificial Ignorance
AI Roundup 082: System prompts
August 30, 2024.
3 months ago
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
Sam Altman
The Virus
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19.
I hope that society views this as a warning for the future. Covid-19 is bad, but only a warm-up. I think it’s...
Strange Loop Canon
No, LLMs are not "scheming"
3 days ago
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Artificial Ignorance
AI Roundup 047: NYT v. OpenAI
Friday, December 29.
11 months ago
Strange Loop Canon
We all live on a knife's edge, and it's fine
Or: How we weaponised serendipity
8 months ago
Or: How we weaponised serendipity
The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Sam Altman
E Pur Si Muove
Earlier
this year, I noticed something in China that really surprised me. I
realized I felt more...
over a year ago
Earlier
this year, I noticed something in China that really surprised me. I
realized I felt more comfortable discussing controversial ideas in Beijing than
in San Francisco. I didn’t feel completely comfortable—this was China,
after all—just more comfortable than at home.
That...
Artificial Ignorance
Bridging AI and human creativity
A conversation with Harrison Telyan, co-founder of NUMI.
10 months ago
A conversation with Harrison Telyan, co-founder of NUMI.
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good.
Turning models into products runs into five challenges
4 months ago
Turning models into products runs into five challenges
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Strange Loop Canon
Google had a very bad week
Gemini's paradox
9 months ago
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
a week ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
AI Snake Oil
Is GPT-4 getting worse over time?
A new paper going viral has been widely misinterpreted
a year ago
A new paper going viral has been widely misinterpreted
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design
Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled.
The development of tools and methods to guide this process is one of the...
Matt Mazur
The Kenya Quick Answer Goes Viral, Again
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
Artificial Ignorance
AI Roundup 084: Strawberry / o1
September 13, 2024.
3 months ago
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric...
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
over a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION The US accused 13 Chinese nationals of committing espionage-related...
One Useful Thing
Signs and Portents
Some hints about what the next year of AI looks like
11 months ago
Some hints about what the next year of AI looks like
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0…
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications
And then there were two.
10 months ago
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
Daniel Miessler
Generate AI Art Using Your Own Writing
One of the most challenging parts of finishing a post is coming up with a good image. The AI art...
over a year ago
One of the most challenging parts of finishing a post is coming up with a good image. The AI art tools like DALL-E, Midjourney, and Stable Diffusion are cool, but a lot of the magic comes down to prompt engineering, which is non-trivial. Prompt Engineering is almost equal parts...
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
The Gradient
An Introduction to the Problems of AI Consciousness
Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
AI Snake Oil
FAQ about the book and our writing process
What's in the book and how we wrote it
2 months ago
What's in the book and how we wrote it
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
11 months ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
One Useful Thing
Reshaping the tree: rebuilding organizations for AI
Technological change brings organizational change.
a year ago
Technological change brings organizational change.
Artificial Ignorance
AI Roundup 089: Adobe MAX
October 18, 2024.
2 months ago
Matt Mazur
When LTD Purchasers Meet an Inactive User Policy
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo...
a year ago
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo community. Maybe I’ll dive into my experience there in another post, but I wanted to share an interesting thing that’s happening now, a year after the deal ended. AppSumo has a policy...
IEEE Spectrum
Video Friday: Happy Holidays!
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 days ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Society's Backend
A Fundamental Overview of Machine Learning Experimentation [Part 1]
And how it differs from the software development you're familiar with
2 weeks ago
And how it differs from the software development you're familiar with
Daniel Miessler
NO. 363 | FrontView Mirror: 2023 Edition
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS...
a year ago
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS BREACHES SECURITY NEWS In a bit of Deja Vu from LastPass, Okta has now revealed that attackers have stolen source code from its GitHub repositories. This comes after it was hit by...
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps
I keep getting fooled by AI, and it seems like others are, too.
a year ago
I keep getting fooled by AI, and it seems like others are, too.
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
9 months ago
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and...
Machine learning resources and updates 8/19/2024
4 months ago
Machine learning resources and updates 8/19/2024
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
9 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
Sam Altman
Project Covalence
Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
over a year ago
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.
Science remains the...
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 