Society's Backend
AI Reading List 2: Mathematical Limitations of LLMs, A SQL Roadmap for Data Science, and...
Society's Backend Reading List 10-14-2024
2 months ago
Society's Backend Reading List 10-14-2024
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for...
Society's Backend Reading List 10-28-2024
2 months ago
Society's Backend Reading List 10-28-2024
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
Weighty Thoughts
From 6 Weeks to 600 Seconds (or Less)
The revolutionary potential of utilizing AI for electronic hardware design
4 days ago
The revolutionary potential of utilizing AI for electronic hardware design
Artificial Ignorance
OpenAI's o1 is a misunderstood model
Are the latest "reasoning" breakthroughs all they're hyped up to be?
3 months ago
Are the latest "reasoning" breakthroughs all they're hyped up to be?
Artificial Ignorance
AI Roundup 090: Computer Use
October 25, 2024.
2 months ago
IEEE Spectrum
The Top 7 Robotics Stories of 2024
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said...
5 days ago
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said before. But that’s the great thing about robotics—it’s always new, and it’s always exciting. What may be different about this year is the real sense that not only is AI going to...
Strange Loop Canon
Progress
when benefits are worth tallying the human cost of technological leaps
a year ago
when benefits are worth tallying the human cost of technological leaps
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
All of us, except the AI startups and VCs—unless a real war breaks out
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
a month ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
a month ago
Fantastic writeup of my views today at The Wall Street Journal:
Stories by Andrej...
ICLR 2017 vs arxiv-sanity
over a year ago
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
One Useful Thing
It is starting to get strange.
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
a year ago
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
One Useful Thing
On speaking to AI
Voice changes a lot of things
5 months ago
Voice changes a lot of things
Artificial Ignorance
AI's invisible instructions
What meme prompts can teach us about better interface design.
2 months ago
What meme prompts can teach us about better interface design.
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Society's Backend
Why MLX is Important for the ML Community
And a step-by-step guide to train a machine learning model on your Mac
8 months ago
And a step-by-step guide to train a machine learning model on your Mac
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Weighty Thoughts
The Real Risks of AI
Humans are really the ones to be scared of
7 months ago
Humans are really the ones to be scared of
Weighty Thoughts
Deep Tech Startups Are Not Software Startups
Or why AI and “Software/SaaS” are apples and oranges
10 months ago
Or why AI and “Software/SaaS” are apples and oranges
The Berkeley...
The Berkeley Crossword Solver
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving...
over a year ago
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving American-style crossword puzzles. The BCS combines neural question answering and probabilistic inference to achieve near-perfect performance on most American-style crossword...
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
Weighty Thoughts
Consider the Llama
Are closed source AI models doomed?
5 months ago
Are closed source AI models doomed?
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too)
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
Artificial Ignorance
AI Roundup 088: Movie magic
October 11, 2024.
2 months ago
Strange Loop Canon
AI embraces its product arc
fuzzy processors are entering mass production
7 months ago
fuzzy processors are entering mass production
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice
Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat."
What we can learn from a completely AI written & illustrated lecture
a year ago
What we can learn from a completely AI written & illustrated lecture
Strange Loop Canon
Google had a very bad week
Gemini's paradox
10 months ago
One Useful Thing
Signs and Portents
Some hints about what the next year of AI looks like
12 months ago
Some hints about what the next year of AI looks like
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
a month ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task.
This video is notable because it’s the first real look we’ve had at the new Atlas doing...
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications
And then there were two.
10 months ago
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
a month ago
Scaling laws were supposed to be, well, laws.
Artificial Ignorance
AI Roundup 073: Music make you lose control
June 28, 2024.
6 months ago
Society's Backend
OpenAI's o1, Model Merging, California Approves AI Regulation, and More
Machine learning resources and updates 2024-09-17
3 months ago
Machine learning resources and updates 2024-09-17
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition
A simple answer, and then a less simple one.
a year ago
A simple answer, and then a less simple one.
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
over a year ago
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
Society's Backend
The Problem with American Emergency Alerts
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
Society's Backend
The Metrics Machine Learning Engineers Care About That Modelers Don't
And a brief overview of TPUs in Google data centers
10 months ago
And a brief overview of TPUs in Google data centers
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
Artificial Ignorance
AI Roundup 049: Down the Rabbit hole
January 12, 2023.
11 months ago
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news...
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Strange Loop Canon
Symposium: On Building God
a year ago
One Useful Thing
Using AI to make teaching easier & more impactful
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Society's Backend
Artificial Intelligence: A New Paradigm Emerges
A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
A realistic perspective of the advantages and pitfalls of artificial intelligence
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
over a year ago
A checklist for avoiding hype
Marcus on AI
AI influencer hype gone wild
Reality is quite the opposite
2 months ago
Reality is quite the opposite
Society's Backend
Clarifying DEI
What makes DEI important and where it fails
11 months ago
What makes DEI important and where it fails
Artificial Ignorance
AI Roundup 057: Claude 3
March 8, 2024.
10 months ago
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat
November 22, 2024.
a month ago
Andrej Karpathy blog
What a Deep Neural Network thinks about your #selfie
Convolutional Neural Networks are great: they recognize things, places and people in your personal...
over a year ago
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic in aerial imagery, various anomalies in medical images and all kinds of other useful things. But...
One Useful Thing
Feats to astonish and amaze
A compendium of things I didn't think AI should be able to do
a year ago
A compendium of things I didn't think AI should be able to do
AI Snake Oil
AI safety is not a model property
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
9 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
Artificial Ignorance
AI Roundup 066: AlphaFold 3
May 10, 2024.
7 months ago
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia
And how our media is failing, wildly, in one of the most important stories in US history
2 months ago
And how our media is failing, wildly, in one of the most important stories in US history
Artificial Ignorance
AI Roundup 086: Llama 3.2
September 27, 2024.
3 months ago
Society's Backend
You Are What You Eat: Digital Edition
Why who you follow is more important than who follows you
a year ago
Why who you follow is more important than who follows you
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
10 months ago
Adding precision to the debate on openness in AI
Society's Backend
AI Reading List 1: Understand Transformers, Reflection-70B Update, and LLMs Still Cannot Reason
Society's Backend Reading List 10-07-2024
2 months ago
Society's Backend Reading List 10-07-2024
The Berkeley...
How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could...
4 months ago
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak frontier LLMs simply by translating forbidden prompts into obscure languages. Excited by this result, we attempted to reproduce it and found something unexpected.
The...
Rozado’s Visual...
The Political Biases of GPT-4
Things are not always what they seem
a year ago
Things are not always what they seem
The Berkeley...
Interactive Fleet Learning
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time.
In the last few years we have seen an exciting development in robotics and artificial...
Marcus on AI
Which CEO will be the last to see it?
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
4 weeks ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
One Useful Thing
The Homework Apocalypse
Fall is going to be very different this year. Educators need to be ready.
a year ago
Fall is going to be very different this year. Educators need to be ready.
Marcus on AI
Update re: Microsoft and training data
Relevant to the post I sent earlier today,...
a month ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
Artificial Ignorance
AI Roundup 034: Meta Connect
September 29, 2023
a year ago
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Weighty Thoughts
The AI Executive Order
AKA: “We’ll do something about it later”
a year ago
AKA: “We’ll do something about it later”
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Matt Mazur
Don’t Self Host Unlicensed Proxima Nova Fonts
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time...
a year ago
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time I was loading Proxima Nova on Preceden via Typekit (a hosted web font service) for $49.99/year, but at some point I decided to self-host it to avoid the third party request which...
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
2 weeks ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested.
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
10 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
Strange Loop Canon
The mystery of the garage
10 months ago
The Gradient
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
9 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
11 months ago
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
One Useful Thing
Thinking Like an AI
A little intuition can help
2 months ago
A little intuition can help
Artificial Ignorance
Tutorial: How to chat with your documents
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
Artificial Ignorance
AI Roundup 044: Google Gemini
December 8, 2023.
a year ago
Daniel Miessler
NO. 358 | NEWS, ANALYSIS & DISCOVERY
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But...
over a year ago
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But that's a Friday, so I'm going to enable the discount link earlier. How early, and how much of a discount? You'll have to find out. If the link works before the date, then it's...
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves.
What spending $2,000 can tell us about evaluating AI agents
8 months ago
What spending $2,000 can tell us about evaluating AI agents
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Matt Mazur
Full Time Indie Hacking: Month 5 Update
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter
Democratizing data analysis with AI
a year ago
Democratizing data analysis with AI
Rozado’s Visual...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system
Should AI systems treat different demographic groups unequally?
a year ago
Should AI systems treat different demographic groups unequally?
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design
Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled.
The development of tools and methods to guide this process is one of the...
Society's Backend
Weekly Backend #5: 55 Resources
The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful...
8 months ago
The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful viruses, and more
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
One Useful Thing
Democratizing the future of education
We are all EdTech designers, now
a year ago
We are all EdTech designers, now
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
Sam Altman
Please Fund More Science
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.
Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
Artificial Ignorance
Blade Runner 2024
Reddit's AI Hunters and the quest for authentic digital experiences.
4 months ago
Reddit's AI Hunters and the quest for authentic digital experiences.
Sam Altman
How To Be Successful
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter.
Here are 13 thoughts about how to achieve such outlier...
Strange Loop Canon
Evaluations are all we need
On analysing talent in LLMs
11 months ago
On analysing talent in LLMs
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers
Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Content creation and networking lessons from a wildly successful freelance tech writer
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
One Useful Thing
Confronting Impossible Futures
We shouldn't be certain about what is next, but we should plan for it
5 months ago
We shouldn't be certain about what is next, but we should plan for it
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1)
Part 1: What is an agent, and how do they work?
a year ago
Part 1: What is an agent, and how do they work?
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received
And how it changed my personal life too
a year ago
And how it changed my personal life too
AI Snake Oil
Generative AI companies must publish transparency reports
The debate about the harms of AI is happening in a data vacuum
a year ago
The debate about the harms of AI is happening in a data vacuum
Weighty Thoughts
Fear and Loathing in 7nm
How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
How much does Huawei and SMIC's new chip matter? And what should the US do?
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
10 months ago
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water resources, and more
Artificial Ignorance
AI Roundup 039: The governance issue
November 3, 2023.
a year ago
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Marcus on AI
Casey (Newton) Strikes Out
His continued skepticism of AI skepticism continues to miss the mark
3 weeks ago
His continued skepticism of AI skepticism continues to miss the mark
The Berkeley...
TinyAgent: Function Calling at the Edge
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
7 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Strange Loop Canon
We all live on a knife's edge, and it's fine
Or: How we weaponised serendipity
9 months ago
Or: How we weaponised serendipity
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
2 weeks ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Society's Backend
Why Machine Learning Systems Misbehave
And what makes them so difficult to work with
5 months ago
And what makes them so difficult to work with
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
Society's Backend
LLM-as-a-Judge, Instruction Pretraining, Solving Benchmarks Instead of Real-World ML Problems, and...
Weekly updates and resources 7/22/24
5 months ago
Weekly updates and resources 7/22/24
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
Sam Altman
PG and Jessica
A lot of people want to replicate YC in some other industry or some other place or with some other...
over a year ago
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION The US accused 13 Chinese nationals of committing espionage-related...
Artificial Ignorance
The hidden side of Apple Intelligence
More than just another keynote recap.
6 months ago
More than just another keynote recap.
One Useful Thing
An AI Haunted World
Intelligence, everywhere.
a year ago
Intelligence, everywhere.
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
IEEE Spectrum
Zen and the Art of Aibo Engineering
Sony’s team made that happen. And since Aibo’s debut, the company has sold
more than 170,000 of...
3 weeks ago
Sony’s team made that happen. And since Aibo’s debut, the company has sold
more than 170,000 of the cute little quadrupeds—a huge number considering their price of several thousand dollars each. From the start, Aibo could express a range of simulated emotions and learn through...
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
3 weeks ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition
AI systems have gotten more capable and easier to use
7 months ago
AI systems have gotten more capable and easier to use
One Useful Thing
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
a year ago
It took me a few minutes to create a fake me giving a fake lecture.
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
11 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
10 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
fast.ai
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
a year ago
Hey Siri, set a reminder for 365 days.
Society's Backend
How to Know if Your Data is Being Used Maliciously
The information you should know about a company before gifting them your data
a year ago
The information you should know about a company before gifting them your data
Rozado’s Visual...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of...
Please be mindful of potential confounds: population density, population behavior, virus virulence...
over a year ago
Please be mindful of potential confounds: population density, population behavior, virus virulence drift, herd immunity, etc.
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck
You can’t just blindly extrapolate compute requirements
a year ago
You can’t just blindly extrapolate compute requirements
One Useful Thing
When you give a Claude a mouse
Some quick impressions of an actual agent
2 months ago
Some quick impressions of an actual agent
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
5 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
5 months ago
Weekly updates and resources 7/29/24
Made by Ollin
Mac Replacement Icons
A standardized, simplified, and beautiful icon set
over a year ago
A standardized, simplified, and beautiful icon set
The Berkeley...
The Shift from Models to Compound AI Systems
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
10 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
Matt Mazur
Is the ChatGPT API Refusing to Summarize Academic Papers? Not so fast.
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API...
a year ago
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API indicating that it was refusing to summarize arXiv papers: There has been a lot of discussion recently about the perceived decrease in the quality of ChatGPT’s responses and seeing...
IEEE Spectrum
SwitchBot S10 Review: “This Is the Future of Home Robots”
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
2 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Artificial Ignorance
GPTs won't make you rich
But they'll make you more productive.
11 months ago
But they'll make you more productive.
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
11 months ago
Taking AI timelines seriously
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
11 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Society's Backend
Backend Biweekly #3: 97 Updates and Resources
Huge Nvidia Updates, Gemini Hackathon for Money, and more
9 months ago
Huge Nvidia Updates, Gemini Hackathon for Money, and more
Artificial Ignorance
The intern and the coach
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
Daniel Miessler
NO. 368 | ChinaBalloons, CustomGPT, 90s++…
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll...
a year ago
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll prevent the email from occasionally descending into the void. SECURITY The US shot down a Chinese spy balloon. They gathered the debris from the water it fell into, and it's currently...
Daniel Miessler
News & Analysis | NO. 353
over a year ago
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
Artificial Ignorance
YC is now 80% AI startups (S24)
Analyzing the latest companies out of "AI Combinator"
3 months ago
Analyzing the latest companies out of "AI Combinator"
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale
Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Moving AI ethics beyond explainability and fairness to empowerment and justice
Daniel Miessler
Summary: Andrej Kaparthy on Lex Fridman’s Podcast (Late 2022)
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My...
a year ago
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My One-Sentence Summary/Highlight The future of programming is not humans writing code, but neural nets creating weights. Capture Neural networks are mathematical expressions with many...
Daniel Miessler
Podcast Audio Quality: AI-based Post-processing vs. Hardware
I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much....
over a year ago
I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much. Anyway. I’ve been obsessed with podcast audio quality for years, and have been through so…many…iterations of my setup. I started with a Yeti (still a great mic). Did the...
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
4 months ago
A critical question for investors in AI
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
PromptArmor Blog
Slack AI data exfiltration from private channels via indirect prompt injection
Authors: PromptArmor
4 months ago
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community
The timeline and why OpenAI’s actions are a big deal
7 months ago
The timeline and why OpenAI’s actions are a big deal
Sam Altman
What I Wish Someone Had Told Me
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started.
Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
One Useful Thing
In Praise of Boring AI
Automation has always been about killing tedious work. AI can do the same.
a year ago
Automation has always been about killing tedious work. AI can do the same.
Weighty Thoughts
Today’s AI critics don’t understand the history of technology
But is AI different than other technologies?
10 months ago
But is AI different than other technologies?
AI Snake Oil
We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.
Technology Isn’t the Problem—or the Solution.
2 weeks ago
Technology Isn’t the Problem—or the Solution.
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
Strange Loop Canon
Why AI hasn’t shown up in the GDP statistics yet
AI is meant to bring us closer to utopia, according to its builders.
4 months ago
AI is meant to bring us closer to utopia, according to its builders.
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
6 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Weighty Thoughts
News Roundup: May 15, 2024
Open AI announcements, DeepSeek-v2, and TSMC Arizona
7 months ago
Open AI announcements, DeepSeek-v2, and TSMC Arizona
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode
One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
One Useful Thing
The future of education in a world of AI
A positive vision for the transformation to come
a year ago
A positive vision for the transformation to come
The Gradient
An Introduction to the Problems of AI Consciousness
Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
fast.ai
In defense of screen time
Pundits say my husband and I are parenting wrong.
2 months ago
Pundits say my husband and I are parenting wrong.
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
One Useful Thing
Post-apocalyptic education
What comes after the Homework Apocalypse
4 months ago
What comes after the Homework Apocalypse
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Sam Altman
Helion
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
over a year ago
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen.
David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
IEEE Spectrum
Video Friday: Mars Chopper
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes
Several states just banned deepfakes in political ads and porn.
9 months ago
Several states just banned deepfakes in political ads and porn.
AI Snake Oil
Introducing the REFORMS checklist for ML-based science
ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
ML-based science is in trouble. Clear reporting standards for researchers could help.
One Useful Thing
What just happened
A transformative month rewrites the capabilities of AI
2 weeks ago
A transformative month rewrites the capabilities of AI
AI Snake Oil
Four more things we worked on in 2022
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
over a year ago
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
Matt Mazur
Running Mistral 7B Instruct on a Macbook
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to...
a year ago
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct...
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
7 months ago
How employees and CEOs alike can plan for the future.
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
over a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
3 months ago
“Connectionist” vs. Knowledge-Based AI
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
One Useful Thing
Magic for English Majors
Programming in prose in an AI-haunted world
a year ago
Programming in prose in an AI-haunted world
One Useful Thing
What just happened, what is happening next
The tasks AI can do well are expanding rapidly
8 months ago
The tasks AI can do well are expanding rapidly
Artificial Ignorance
AI Roundup 061: The AI innovator's dilemma
April 5, 2024.
9 months ago
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Strange Loop Canon
Predicting AI
I revisit past predictions
4 months ago
I revisit past predictions
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
a month ago
The bullshit just keeps on coming.
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
9 months ago
And effective ways to mitigate it
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
11 months ago
And other practical guides to understand machine learning
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
10 months ago
Artificial Ignorance
10 of the most impactful AI stories of 2023
A quick look back on a very busy year in AI.
a year ago
A quick look back on a very busy year in AI.
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI
March 22, 2023.
9 months ago
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
3 weeks ago
Exactly as I warned in February
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
Artificial Ignorance
o3 is important, but not because of benchmarks
OpenAI's new model offers a peek at the future of AI investment.
a week ago
OpenAI's new model offers a peek at the future of AI investment.
Weighty Thoughts
Apple Wins
Apple Intelligence and aggregation puts Apple in a dominant AI position
6 months ago
Apple Intelligence and aggregation puts Apple in a dominant AI position
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
8 months ago
From megaFLOPS to mega flops.
Artificial Ignorance
The subscriptionization of AI
Navigating the paid AI landscape.
9 months ago
Navigating the paid AI landscape.
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
7 months ago
Inside Stability AI's roster of AI models.
Andrej Karpathy blog
(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
over a year ago
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but
whenever I do get a chance to post something I have recently been defaulting
to doing it on Medium because...
Artificial Ignorance
AI Roundup 045: Google's just getting started
December 15, 2023.
a year ago
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
6 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
One Useful Thing
Now is the time for grimoires
It isn't data that will unlock AI, it is human expertise
a year ago
It isn't data that will unlock AI, it is human expertise
Strange Loop Canon
I wrote a book!
AI enables us to, finally, get "soft" APIs
a year ago
AI enables us to, finally, get "soft" APIs
Society's Backend
Ask Stupid Questions
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
11 months ago
Output similarity is a distraction
Society's Backend
All Machine Learning Resources and Updates 7/8/24
Everything I've been reading
5 months ago
Everything I've been reading
One Useful Thing
The Present Future: AI's Impact Long Before Superintelligence
You can start to see the outlines of an AI future, for better and worse
a month ago
You can start to see the outlines of an AI future, for better and worse
Artificial Ignorance
Bridging AI and human creativity
A conversation with Harrison Telyan, co-founder of NUMI.
10 months ago
A conversation with Harrison Telyan, co-founder of NUMI.
Society's Backend
No One Should Be GPU Poor
For everyone to have access to AGI, everyone must also have access to the compute to use it
7 months ago
For everyone to have access to AGI, everyone must also have access to the compute to use it
Artificial Ignorance
AI Roundup 083: Bioacoustics
September 6, 2024.
3 months ago
Artificial Ignorance
AI Roundup 050: Synthetic Geometry
January 19, 2024.
11 months ago
Made by Ollin
Priors for Autonomous Vehicle Development
over a year ago
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
Society's Backend
I Enjoy Technical Interviews and You Can Too
A simple change in mindset that completely changed the way I interview
a year ago
A simple change in mindset that completely changed the way I interview
Society's Backend
Weekly Backend #7: 39 Resources and Updates
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
7 months ago
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
10 months ago
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth so much
Matt Mazur
Screw it, I’m Keeping Emergent Mind
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
Society's Backend
What Apple Intelligence Means for You
"We think you're gonna LOVE it"
6 months ago
"We think you're gonna LOVE it"
Sam Altman
The Strength of Being Misunderstood
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
over a year ago
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question.
Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
a month ago
Why AI products really need some better UX.
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Artificial Ignorance
AI Roundup 047: NYT v. OpenAI
Friday, December 29.
a year ago
Stories by Andrej...
Yes you should understand backprop
over a year ago
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
Matt Mazur
It’s Time to Build
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
Daniel Miessler
My Mom Died on Saturday
My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
Rozado’s Visual...
The Political Preferences of LLMs
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
11 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free
Announcing the ML Road Map-Turbo
6 months ago
Announcing the ML Road Map-Turbo
Society's Backend
Mastering the Art of Documentation
Documentation is really just glorified dog sitting
a year ago
Documentation is really just glorified dog sitting
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
3 months ago
Machine learning highlights and resources 9-23-24
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Artificial Ignorance
AI Roundup 081: Creative differences
August 23, 2024.
4 months ago
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Artificial Ignorance
GPT-4o and the illusion of AGI
Why speed and multimodality is becoming the name of the game.
7 months ago
Why speed and multimodality is becoming the name of the game.
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns
Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
Science, sociology, and the likely financial collapse of the Generative AI bubble
Society's Backend
Run Your Own Race
What Bluey can teach us about machine learning
9 months ago
What Bluey can teach us about machine learning
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
The Gradient
Why transformative artificial intelligence is really, really hard to achieve
A collection of the best technical, social, and economic arguments
Humans have a good track record...
a year ago
A collection of the best technical, social, and economic arguments
Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research?
Mentions of climate change in news media vastly outnumber other existential threats
a year ago
Mentions of climate change in news media vastly outnumber other existential threats
fast.ai
nbdev+Quarto: A new secret weapon for productivity
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
over a year ago
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
IEEE Spectrum
Video Friday: Happy Holidays!
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Society's Backend
What you need to understand about LLM creativity
An simple overview of temperature and its effect on LLM output
8 months ago
An simple overview of temperature and its effect on LLM output
Weighty Thoughts
VC Office Hours
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
11 months ago
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
The Gradient
Interpretability Creationism
On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
Society's Backend
JAX is for More Than Just Machine Learning
What JAX is and its potential applications
7 months ago
What JAX is and its potential applications
IEEE Spectrum
Video Friday: Multiple MagicBots
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Society's Backend
All Machine Learning Resources and Updates 06/14/2024
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve...
6 months ago
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve decided to try out separating paid/free updates. I’m constantly trying new ways to make information consumption easier for you while working within the confines of the platforms...
Sam Altman
Time to Take a Stand
It is time for tech companies to start speaking up about
some of the actions taken by President...
over a year ago
It is time for tech companies to start speaking up about
some of the actions taken by President Trump’s administration.
There are many actions from his first week that are
objectionable. In repeatedly
invoking unsubstantiated conspiracy theories (like the 3 million...
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
AI Snake Oil
Is AI progress slowing down?
Making sense of recent technology trends and claims
2 weeks ago
Making sense of recent technology trends and claims
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
The Gradient
A Brief Overview of Gender Bias in AI
A brief overview and discussion on gender bias in AI
8 months ago
A brief overview and discussion on gender bias in AI
Artificial Ignorance
Pitfalls of building with large language models
Dealing with more than just hallucinations.
a year ago
Dealing with more than just hallucinations.
Artificial Ignorance
LLMs are getting dumber and we have no idea why
Five theories that could explain how chatbots are getting worse.
3 months ago
Five theories that could explain how chatbots are getting worse.
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 