AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
9 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
Strange Loop Canon
People want competence, seemingly over everything else
All elections are about state capacity
a month ago
All elections are about state capacity
Daniel Miessler
The 2 Current Major AI Bottlenecks
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
One Useful Thing
Superhuman?
What does it mean for AI to be better than a human? And how can we tell?
7 months ago
What does it mean for AI to be better than a human? And how can we tell?
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
3 months ago
Machine learning highlights and resources 9-23-24
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
Rozado’s Visual...
Pessimism in News Media Headlines
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
4 months ago
A critical question for investors in AI
Artificial Ignorance
Tutorial: How to make and share custom GPTs
They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
They're not going to disrupt everything (yet), but they're a ton of fun.
Society's Backend
Coming soon!
Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
One Useful Thing
How to... use AI to unstick yourself
We often lose momentum because of something small. AI can help.
a year ago
We often lose momentum because of something small. AI can help.
Marcus on AI
𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁...
Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course...
5 hours ago
Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course they have to announce AGI the day my vacation starts”.
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia
And how our media is failing, wildly, in one of the most important stories in US history
a month ago
And how our media is failing, wildly, in one of the most important stories in US history
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Matt Mazur
Screw it, I’m Keeping Emergent Mind
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
a month ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
Stories by Andrej...
Virtual Reality: still not quite there, again.
over a year ago
Daniel Miessler
News & Analysis | NO. 353
over a year ago
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Society's Backend
If You Understand Bananas, You Can Understand Machine Learning
A simplified high-level overview of primary machine learning algorithms for anyone to understand
11 months ago
A simplified high-level overview of primary machine learning algorithms for anyone to understand
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing
Introduction
Imagine yourself a decade ago, jumping directly into the present shock of conversing...
4 months ago
Introduction
Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
Artificial Ignorance
Tutorial: How to chat with your documents
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
Artificial Ignorance
AI Roundup 041: Lyria
November 17, 2023.
a year ago
Artificial Ignorance
AI Roundup 056: Data deals
March 1, 2024.
9 months ago
Rozado’s Visual...
Out-of-office Donald Trump still more prominent in news media content than the current U.S....
In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump...
a year ago
In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump in news media content (see here). I have recently updated that previous analysis. Briefly stated, no U.S. president in recent history has received a similar amount of media...
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
7 months ago
Inside Stability AI's roster of AI models.
Society's Backend
Clarifying DEI
What makes DEI important and where it fails
11 months ago
What makes DEI important and where it fails
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Stories by Andrej...
ICLR 2017 vs arxiv-sanity
over a year ago
Society's Backend
OpenAI's o1, Model Merging, California Approves AI Regulation, and More
Machine learning resources and updates 2024-09-17
3 months ago
Machine learning resources and updates 2024-09-17
IEEE Spectrum
Forums, Competitions, Challenges: Inspiring Creativity in Robotics
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total...
2 months ago
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the...
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Marcus on AI
Update re: Microsoft and training data
Relevant to the post I sent earlier today,...
3 weeks ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
AI Snake Oil
Evaluating LLMs is a minefield
Annotated slides from a recent talk
a year ago
Annotated slides from a recent talk
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too)
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
One Useful Thing
Blinded by Analogies
What is this AI thing? The wrong model can lead us astray
a year ago
What is this AI thing? The wrong model can lead us astray
Strange Loop Canon
Slouching Towards Utopia
by Brad DeLong
a year ago
One Useful Thing
The Best Available Human Standard
What are the imperatives of the upside?
a year ago
What are the imperatives of the upside?
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
fast.ai
Mojo may be the biggest programming language advance in decades
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment...
a year ago
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment problems.
Weighty Thoughts
Fear and Loathing in 7nm
How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
How much does Huawei and SMIC's new chip matter? And what should the US do?
Matt Mazur
LearnGPT is now EmergentMind
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
AI Snake Oil
People keep anthropomorphizing AI. Here’s why
Companies and journalists both contribute to the confusion
a year ago
Companies and journalists both contribute to the confusion
Society's Backend
I Enjoy Technical Interviews and You Can Too
A simple change in mindset that completely changed the way I interview
a year ago
A simple change in mindset that completely changed the way I interview
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
Society's Backend
Backend Biweekly #3: 97 Updates and Resources
Huge Nvidia Updates, Gemini Hackathon for Money, and more
8 months ago
Huge Nvidia Updates, Gemini Hackathon for Money, and more
The Berkeley...
The Shift from Models to Compound AI Systems
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
10 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
The Gradient
Salmon in the Loop
On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
Weighty Thoughts
One Definite Sign of a Bad Startup Idea
If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
If you can’t tell anyone about your startup idea, it's not a good idea
The Gradient
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
8 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Artificial Ignorance
Has YC hit peak AI? (F24)
The latest batch is up to 86% AI startups.
2 weeks ago
The latest batch is up to 86% AI startups.
IEEE Spectrum
Video Friday: Trick or Treat, Atlas
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
a month ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.”
Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
The Berkeley...
On the Stepwise Nature of <br> Self-Supervised Learning
Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we...
a year ago
Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we find that the loss descends in a stepwise fashion (top left) and the learned embeddings iteratively increase in dimensionality (bottom left). Direct visualization of embeddings...
fast.ai
Qualitative humanities research is crucial to AI
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
AI Snake Oil
Is GPT-4 getting worse over time?
A new paper going viral has been widely misinterpreted
a year ago
A new paper going viral has been widely misinterpreted
Strange Loop Canon
Evaluations are all we need
On analysing talent in LLMs
11 months ago
On analysing talent in LLMs
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
over a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
Artificial Ignorance
AI Roundup 090: Computer Use
October 25, 2024.
a month ago
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications
And then there were two.
10 months ago
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
11 months ago
And other practical guides to understand machine learning
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
2 weeks ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
Matt Mazur
The Kenya Quick Answer Goes Viral, Again
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
IEEE Spectrum
Where’s My Robot?
See the interactive version of this story on our site →
a month ago
See the interactive version of this story on our site →
Artificial Ignorance
AI Roundup 082: System prompts
August 30, 2024.
3 months ago
Weighty Thoughts
Software Engineering is Doomed
Or is it?
5 months ago
AI Snake Oil
We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.
Technology Isn’t the Problem—or the Solution.
a week ago
Technology Isn’t the Problem—or the Solution.
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Artificial Ignorance
AI Roundup 057: Claude 3
March 8, 2024.
9 months ago
Weighty Thoughts
What is Defensibility?
Back to basics for AI startups and others
8 months ago
Back to basics for AI startups and others
One Useful Thing
Automating creativity
There is now strong evidence that AI can help make us more innovative.
a year ago
There is now strong evidence that AI can help make us more innovative.
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Rozado’s Visual...
DepolarizingGPT
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition
August 9, 2024.
4 months ago
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
4 months ago
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Sam Altman
Time to Take a Stand
It is time for tech companies to start speaking up about
some of the actions taken by President...
over a year ago
It is time for tech companies to start speaking up about
some of the actions taken by President Trump’s administration.
There are many actions from his first week that are
objectionable. In repeatedly
invoking unsubstantiated conspiracy theories (like the 3 million...
AI Snake Oil
Scientists should use AI as a tool, not an oracle
How AI hype leads to flawed research that fuels more hype
6 months ago
How AI hype leads to flawed research that fuels more hype
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
Daniel Miessler
Frontview Mirror: 2023 Edition
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Weighty Thoughts
The Real Risks of AI
Humans are really the ones to be scared of
7 months ago
Humans are really the ones to be scared of
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
AI Snake Oil
I set up a ChatGPT voice interface for my 3-year old. Here’s how it went.
Chatbots are likely to revive familiar debates about kids and apps
a year ago
Chatbots are likely to revive familiar debates about kids and apps
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning
You probably know more about machine learning math than you think
10 months ago
You probably know more about machine learning math than you think
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
One Useful Thing
Freeing the chatbot
Intelligence, of a sort, is going to be all around us
7 months ago
Intelligence, of a sort, is going to be all around us
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community
The timeline and why OpenAI’s actions are a big deal
7 months ago
The timeline and why OpenAI’s actions are a big deal
Marcus on AI
Two visions of AI’s future
It’s not looking good
2 weeks ago
Society's Backend
Why MLX is Important for the ML Community
And a step-by-step guide to train a machine learning model on your Mac
7 months ago
And a step-by-step guide to train a machine learning model on your Mac
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
11 months ago
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
9 months ago
The future of entertainment is going to be a wild ride.
Matt Mazur
“Monthly Billed Annually” is Cursed Copy
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS...
a year ago
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS for not refunding an accidental annual payment he made on their service. He intended to purchase the monthly plan, but due to an unclear UI and poor copy, he unintentionally...
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Rozado’s Visual...
The Great Awokening as a Global Phenomenon
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
One Useful Thing
Latent Expertise: Everyone is in R&D
Ideas come from the edges, not the center
6 months ago
Ideas come from the edges, not the center
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs
Also, we have a prompt library!
9 months ago
Also, we have a prompt library!
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
Weighty Thoughts
The EU is making itself an economic backwater
Regulation is not a real export
5 months ago
Regulation is not a real export
Strange Loop Canon
State of the Canon
Onwards
11 months ago
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
Weighty Thoughts
Commentary on Technology, Startups, and Investing
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater...
over a year ago
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater and Google X. Co-Founder Lioness. Sign up now so you don’t miss the first issue. In the meantime, tell your friends!
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
3 weeks ago
Fantastic writeup of my views today at The Wall Street Journal:
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
2 weeks ago
Society's Backend Reading List 12-2-2024
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
3 weeks ago
The bullshit just keeps on coming.
Artificial Ignorance
How Shopify is making AI Magic
A case study on turning competitive advantages into useful AI.
a year ago
A case study on turning competitive advantages into useful AI.
Sam Altman
Please Fund More Science
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.
Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
One Useful Thing
Thinking Like an AI
A little intuition can help
2 months ago
A little intuition can help
Weighty Thoughts
The Fall of Data Moats
AI actually makes most data moats weaker
a year ago
AI actually makes most data moats weaker
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
One Useful Thing
Getting started with AI: Good enough prompting
Don't make this hard
4 weeks ago
Strange Loop Canon
Symposium: On Building God
a year ago
Sam Altman
PG and Jessica
A lot of people want to replicate YC in some other industry or some other place or with some other...
over a year ago
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
Artificial Ignorance
How to build an AI search engine (Part 1)
Working with Claude, Brave, and streaming responses.
2 months ago
Working with Claude, Brave, and streaming responses.
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in...
a month ago
What is the Role of Mathematics in Modern Machine Learning?
The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
7 months ago
How employees and CEOs alike can plan for the future.
Artificial Ignorance
AI Roundup 044: Google Gemini
December 8, 2023.
a year ago
Artificial Ignorance
AI Roundup 067: GPT-4o and Google I/O
May 17, 2024.
7 months ago
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
4 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
Society's Backend
What you need to understand about LLM creativity
An simple overview of temperature and its effect on LLM output
7 months ago
An simple overview of temperature and its effect on LLM output
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
over a year ago
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and...
Machine learning resources and updates 8/19/2024
4 months ago
Machine learning resources and updates 8/19/2024
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale
Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Moving AI ethics beyond explainability and fairness to empowerment and justice
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm...
Machine learning resources and updates 8/26/2024
3 months ago
Machine learning resources and updates 8/26/2024
Artificial Ignorance
Why now?
What's behind our current AI boom?
a year ago
What's behind our current AI boom?
Marcus on AI
o3, AGI, the art of the demo, and what you can expect in 2025
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived....
yesterday
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived. Here’s what you should pay attention to in the coming year.
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good.
Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Teachers adapted to the calculator. They can certainly adapt to language models.
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
5 months ago
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
One Useful Thing
Confronting Impossible Futures
We shouldn't be certain about what is next, but we should plan for it
5 months ago
We shouldn't be certain about what is next, but we should plan for it
Society's Backend
Why Gemini's Struggles Aren't Straightforward
And an overview of LLM security issues
9 months ago
And an overview of LLM security issues
The Berkeley...
How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could...
3 months ago
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak frontier LLMs simply by translating forbidden prompts into obscure languages. Excited by this result, we attempted to reproduce it and found something unexpected.
The...
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴
Siri versus the machine god?
6 months ago
Siri versus the machine god?
The Berkeley...
2024 BAIR Graduate Directory
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most...
9 months ago
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most talented and innovative minds in artificial intelligence and machine learning. Our Ph.D. graduates have each expanded the frontiers of AI research and are now ready to embark on new...
Artificial Ignorance
Groq, Gemini, and 10x improvements
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When...
10 months ago
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When you scale your inputs (users, page views, messages, etc) by 10x, something breaks. Usually, it's something pretty fundamental. And the end result is that you need to replace a...
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
Artificial Ignorance
Blade Runner 2024
Reddit's AI Hunters and the quest for authentic digital experiences.
3 months ago
Reddit's AI Hunters and the quest for authentic digital experiences.
Strange Loop Canon
The agent principal problem
"Show me the incentive and I will show you the outcome."
a year ago
"Show me the incentive and I will show you the outcome."
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
Society's Backend
I Beat Newsletter Fatigue With AI
And why direct forms of communication will always be super valuable
10 months ago
And why direct forms of communication will always be super valuable
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a week ago
Exactly as I warned in February
Daniel Miessler
NO. 368 | ChinaBalloons, CustomGPT, 90s++…
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll...
a year ago
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll prevent the email from occasionally descending into the void. SECURITY The US shot down a Chinese spy balloon. They gathered the debris from the water it fell into, and it's currently...
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
One Useful Thing
What just happened
A transformative month rewrites the capabilities of AI
3 days ago
A transformative month rewrites the capabilities of AI
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Made by Ollin
Priors for Autonomous Vehicle Development
over a year ago
Weighty Thoughts
Consider the Llama
Are closed source AI models doomed?
5 months ago
Are closed source AI models doomed?
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Artificial Ignorance
AI Roundup 027: Challenge accepted
August 11, 2023
a year ago
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation?
The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
The bottleneck isn't the cost of producing disinfo, which is already very low.
Society's Backend
Weekly Backend #7: 39 Resources and Updates
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
7 months ago
GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy
How speculation gets laundered through pseudo-quantification
4 months ago
How speculation gets laundered through pseudo-quantification
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
Society's Backend
Why Machine Learning Terminology is So Confusing
And definitions for the most important terms you should know
10 months ago
And definitions for the most important terms you should know
Matt Mazur
It’s Time to Build
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
2 months ago
The Berkeley...
Virtual Personas for Language Models via an Anthology of Backstories
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual...
a month ago
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual personas by generating and utilizing naturalistic backstories with rich details of individual values and experience.
-->
We introduce Anthology, a method for conditioning LLMs to...
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0…
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
AI Snake Oil
Three Ideas for Regulating Generative AI
Policy input to the federal government from a Stanford-Princeton team
a year ago
Policy input to the federal government from a Stanford-Princeton team
The Gradient
Do text embeddings perfectly encode text?
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
9 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Daniel Miessler
NO. 358 | NEWS, ANALYSIS & DISCOVERY
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But...
over a year ago
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But that's a Friday, so I'm going to enable the discount link earlier. How early, and how much of a discount? You'll have to find out. If the link works before the date, then it's...
Marcus on AI
An epidemic of weirdly precise AI butt facts
The parade of made-up numbers never stops
a month ago
The parade of made-up numbers never stops
Artificial Ignorance
AI Roundup 086: Llama 3.2
September 27, 2024.
2 months ago
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
5 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse?
Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Providing a technical perspective for a more educated assessment of a complaint I hear quite frequently
One Useful Thing
On the necessity of a sin
Why treating AI like a person is the future
8 months ago
Why treating AI like a person is the future
Andrej Karpathy blog
What a Deep Neural Network thinks about your #selfie
Convolutional Neural Networks are great: they recognize things, places and people in your personal...
over a year ago
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic in aerial imagery, various anomalies in medical images and all kinds of other useful things. But...
Society's Backend
How to Know if Your Data is Being Used Maliciously
The information you should know about a company before gifting them your data
a year ago
The information you should know about a company before gifting them your data
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
Matt Mazur
Sharing small, incremental updates with users
I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
AI Snake Oil
Can AI automate computational reproducibility?
A new benchmark to measure the impact of AI on improving science
3 months ago
A new benchmark to measure the impact of AI on improving science
Society's Backend
AI Reading List 2: Mathematical Limitations of LLMs, A SQL Roadmap for Data Science, and...
Society's Backend Reading List 10-14-2024
2 months ago
Society's Backend Reading List 10-14-2024
Weighty Thoughts
Why we need AI as a society
We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
We’re aging too fast (AKA my entire AI/robotics investment thesis)
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
Made by Ollin
Mac Replacement Icons
A standardized, simplified, and beautiful icon set
over a year ago
A standardized, simplified, and beautiful icon set
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
Artificial Ignorance
LLMs are getting dumber and we have no idea why
Five theories that could explain how chatbots are getting worse.
3 months ago
Five theories that could explain how chatbots are getting worse.
AI Snake Oil
AI safety is not a model property
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
9 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
Strange Loop Canon
Discovery is the original sin of the modern age
technology, living post scarcity, and how to find what you want
a year ago
technology, living post scarcity, and how to find what you want
Society's Backend
The Unfortunate Truth Regarding AI Regulation
And the impact it'll have for decades to come
6 months ago
And the impact it'll have for decades to come
Weighty Thoughts
I'm writing a book!
Why I've been gone over a month, and how you can help
3 weeks ago
Why I've been gone over a month, and how you can help
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI...
Machine learning resources and updates 2024-09-09
3 months ago
Machine learning resources and updates 2024-09-09
Frank’s Ramblings
Vision Transformers are Overrated
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
11 months ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Daniel Miessler
Custom Models Are AI’s Killer App
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
Weighty Thoughts
Deep Tech Startups Are Not Software Startups
Or why AI and “Software/SaaS” are apples and oranges
10 months ago
Or why AI and “Software/SaaS” are apples and oranges
One Useful Thing
Post-apocalyptic education
What comes after the Homework Apocalypse
3 months ago
What comes after the Homework Apocalypse
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
10 months ago
Four questions to ask your organization.
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report
And my notes on why they’re important
8 months ago
And my notes on why they’re important
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
The Gradient
Why transformative artificial intelligence is really, really hard to achieve
A collection of the best technical, social, and economic arguments
Humans have a good track record...
a year ago
A collection of the best technical, social, and economic arguments
Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
Marcus on AI
Generative AI’s Continuing Copyright Problems, an Essay in Memory of Suchir Balaji, 1998 - 2024
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate...
a week ago
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate named Suchir Balaji, who had just left OpenAI.
The Berkeley...
TinyAgent: Function Calling at the Edge
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
6 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
Artificial Ignorance
Small newsletters, big ideas
A subscriber showcase full of hidden gems on Substack.
6 days ago
A subscriber showcase full of hidden gems on Substack.
Artificial Ignorance
The subscriptionization of AI
Navigating the paid AI landscape.
9 months ago
Navigating the paid AI landscape.
Strange Loop Canon
The mystery of the garage
10 months ago
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
One Useful Thing
Signs and Portents
Some hints about what the next year of AI looks like
11 months ago
Some hints about what the next year of AI looks like
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
One Useful Thing
Feats to astonish and amaze
A compendium of things I didn't think AI should be able to do
a year ago
A compendium of things I didn't think AI should be able to do
Artificial Ignorance
AI Roundup 030: OpenAI's $1B revenue
September 1, 2023
a year ago
Rozado’s Visual...
An Analysis of AI Political Preferences from a European Perspective
Introduction
a month ago
The Gradient
The Artificiality of Alignment
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk”...
a year ago
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
Society's Backend
Mastering the Art of Documentation
Documentation is really just glorified dog sitting
a year ago
Documentation is really just glorified dog sitting
Daniel Miessler
NO. 363 | FrontView Mirror: 2023 Edition
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS...
a year ago
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS BREACHES SECURITY NEWS In a bit of Deja Vu from LastPass, Okta has now revealed that attackers have stolen source code from its GitHub repositories. This comes after it was hit by...
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
One Useful Thing
One sentence.
Prompting for maximum impact (and why that is a bad idea)
a year ago
Prompting for maximum impact (and why that is a bad idea)
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
One Useful Thing
A prosthesis for imagination: Using AI to boost your creativity
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
a year ago
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
Rozado’s Visual...
What is the IQ of ChatGPT?
Making an AI model take an IQ test
over a year ago
Making an AI model take an IQ test
Daniel Miessler
Your Experience is Your Creativity
Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
One Useful Thing
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
a year ago
It took me a few minutes to create a fake me giving a fake lecture.
Strange Loop Canon
Mind the Gap
from empire to umpire
a year ago
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a week ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
4 months ago
Weekly updates and resources 7/29/24
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Sam Altman
What I Wish Someone Had Told Me
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started.
Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
11 months ago
Taking AI timelines seriously
Artificial Ignorance
Funding a new generation of AI companies
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
11 months ago
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
One Useful Thing
Acceleration.
7 days of new AI technologies shows us that everything is happening very fast.
a year ago
7 days of new AI technologies shows us that everything is happening very fast.
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Daniel Miessler
Humiliation is Deadly
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That...
over a year ago
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That is, people who not only feel like they have no respect and no options to gain any respect, but who also feel that: They deserve those things, and… That someone else is the cause of...
Matt Mazur
Redesigning Preceden’s Pricing Page
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
8 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches
If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
Society's Backend
The Problem with American Emergency Alerts
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
Artificial Ignorance
Looking a gift llama in the mouth
How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical...
5 months ago
How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical about it)
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave
November 8, 2024.
a month ago
One Useful Thing
On-boarding your AI Intern
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
Matt Mazur
Emergent Mind in The Atlantic
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The...
a year ago
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The Atlantic who asked Caroline Mimbs Nyce, one of their reporters, to look into it. Caroline interviewed me for the article they just published which focused on the challenges Google is...
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Artificial Ignorance
The intern and the coach
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
One Useful Thing
Now is the time for grimoires
It isn't data that will unlock AI, it is human expertise
a year ago
It isn't data that will unlock AI, it is human expertise
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Strange Loop Canon
Progress
when benefits are worth tallying the human cost of technological leaps
a year ago
when benefits are worth tallying the human cost of technological leaps
Weighty Thoughts
Let’s Talk About AI Compute
What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
What really matters and why AI computing is exactly the same as all other large-scale computing
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a week ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
Artificial Ignorance
What AI models really think about politics
Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
a month ago
Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
The Gradient
Neural algorithmic reasoning
In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Matt Mazur
Emergent Mind finally went viral
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
Society's Backend
The Method Google Used to Reduce LLM Size by 66%
A brief overview of knowledge distillation and its capabilities
5 months ago
A brief overview of knowledge distillation and its capabilities
fast.ai
Practical Deep Learning for Coders 2022
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
12 months ago
Hey Siri, set a reminder for 365 days.
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
8 months ago
One Useful Thing
Something New: On OpenAI's "Strawberry" and Reasoning
Solving hard problems in new ways
3 months ago
Solving hard problems in new ways
IEEE Spectrum
Robot Photographer Takes the Perfect Picture
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
Artificial Ignorance
Case Study: Scaling customer intelligence
Analyzing 10,000 sales calls with Claude
3 weeks ago
Analyzing 10,000 sales calls with Claude
The Berkeley...
Rethinking the Role of PPO in RLHF
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Society's Backend
Run Your Own Race
What Bluey can teach us about machine learning
8 months ago
What Bluey can teach us about machine learning
Artificial Ignorance
AI Roundup 055: Race conditions
February 23, 2023.
10 months ago
Weighty Thoughts
Open AI's Valuation and a Favor to Ask
A guest post and an in-person panel
4 months ago
A guest post and an in-person panel
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
over a year ago
I ported Stable Diffusion to my phone
AI Snake Oil
Does the UK’s liver transplant matching algorithm systematically exclude younger patients?
Seemingly minor technical decisions can have life-or-death effects
a month ago
Seemingly minor technical decisions can have life-or-death effects
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 