Society's Backend
No One Should Be GPU Poor
For everyone to have access to AGI, everyone must also have access to the compute to use it
7 months ago
For everyone to have access to AGI, everyone must also have access to the compute to use it
The Gradient
Neural algorithmic reasoning
In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
Artificial Ignorance
Tutorial: How to build an AI agent (Part 2)
Part 2: Giving our agent internet access.
a year ago
Part 2: Giving our agent internet access.
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Artificial Ignorance
Pitfalls of building with large language models
Dealing with more than just hallucinations.
a year ago
Dealing with more than just hallucinations.
AI Snake Oil
One year update: book submitted; TIME 100; Sep 21 online workshop
It's been an eventful year
a year ago
It's been an eventful year
Jascha’s blog
Neural network training makes beautiful fractals
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
10 months ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
.vimeo-player {
position: relative;
width: 444px;
height: 444px;
...
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
9 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
Sam Altman
Helion Needs You
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
over a year ago
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator.
The goals of the company are quite ambitious—clean, continuous energy for 1...
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
One Useful Thing
Detecting the Secret Cyborgs
The AI Trap for Organizations
a year ago
The AI Trap for Organizations
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1)
Part 1: What is an agent, and how do they work?
a year ago
Part 1: What is an agent, and how do they work?
One Useful Thing
Latent Expertise: Everyone is in R&D
Ideas come from the edges, not the center
6 months ago
Ideas come from the edges, not the center
Matt Mazur
Running Mistral 7B Instruct on a Macbook
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to...
a year ago
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct...
Artificial Ignorance
AI Roundup 064: Big Tech's small models
April 26, 2024.
7 months ago
Artificial Ignorance
AI Roundup 073: Music make you lose control
June 28, 2024.
5 months ago
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice...
Society's Backend Reading List 11-18-2024
a month ago
Society's Backend Reading List 11-18-2024
Sam Altman
Please Fund More Science
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.
Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
AI Snake Oil
Introducing the REFORMS checklist for ML-based science
ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
ML-based science is in trouble. Clear reporting standards for researchers could help.
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
One Useful Thing
AI in organizations: Some tactics
Meet the Lab and the Crowd
2 months ago
Meet the Lab and the Crowd
Artificial Ignorance
AI Roundup 034: Meta Connect
September 29, 2023
a year ago
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Matt Mazur
Emergent Mind in The Atlantic
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The...
a year ago
One of the many people who saw the incorrect Google Quick Answer about Kenya was an editor at The Atlantic who asked Caroline Mimbs Nyce, one of their reporters, to look into it. Caroline interviewed me for the article they just published which focused on the challenges Google is...
IEEE Spectrum
How Amazon Is Changing the Future of Robotics and Logistics
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you...
6 days ago
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you have a good idea,” said Valerie Samzun, a leader in Amazon’s Fulfillment Technologies and Robotics (FTR) division. “It happens because you have the right team, the right...
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
Society's Backend
JAX is for More Than Just Machine Learning
What JAX is and its potential applications
6 months ago
What JAX is and its potential applications
Artificial Ignorance
Milestones, motivations, and miscellany
Some thoughts on the future of this newsletter.
5 months ago
Some thoughts on the future of this newsletter.
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
Artificial Ignorance
AI Roundup 075: Levels of AGI
July 12, 2024.
5 months ago
fast.ai
nbdev+Quarto: A new secret weapon for productivity
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
over a year ago
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
11 months ago
And why it might revolutionize the search industry.
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
Artificial Ignorance
AI Roundup 049: Down the Rabbit hole
January 12, 2023.
11 months ago
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
over a year ago
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
fast.ai
AI Harms are Societal, Not Just Individual
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat."
What we can learn from a completely AI written & illustrated lecture
a year ago
What we can learn from a completely AI written & illustrated lecture
Society's Backend
OpenAI's Strawberry May Enhance AI Reasoning, Optimization of Vision Language Models, Info on...
Weekly updates and resources 7/15/24
5 months ago
Weekly updates and resources 7/15/24
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good.
Turning models into products runs into five challenges
4 months ago
Turning models into products runs into five challenges
Sam Altman
Keep the Internet Open
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon.
The internet is a public good, and I believe access should be a basic right. We've seen such great innovation in software because the internet has...
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
over a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
fast.ai
GPT 4 and the Uncharted Territories of Language
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Weighty Thoughts
What’s coming next for AI in 2024
A long overdue VC apocalypse and the birth of the first real AI companies
11 months ago
A long overdue VC apocalypse and the birth of the first real AI companies
The Berkeley...
Are We Ready for Multi-Image Reasoning? Launching VHs: The Visual Haystacks Benchmark!
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving...
5 months ago
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving artificial general intelligence (AGI). Over the decades, AI researchers have developed Visual Question Answering (VQA) systems to interpret scenes within single images and answer...
AI Snake Oil
AI scaling myths
Scaling will run out. The question is when.
5 months ago
Scaling will run out. The question is when.
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water resources, and more
Strange Loop Canon
Progress
when benefits are worth tallying the human cost of technological leaps
a year ago
when benefits are worth tallying the human cost of technological leaps
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
11 months ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
2 months ago
Made by Ollin
Game Emulation via Neural Network
over a year ago
Rozado’s Visual...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system
Should AI systems treat different demographic groups unequally?
a year ago
Should AI systems treat different demographic groups unequally?
One Useful Thing
It is starting to get strange.
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
a year ago
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a week ago
Exactly as I warned in February
AI Snake Oil
Tech policy is only frustrating 90% of the time
That’s what makes it worthwhile
8 months ago
That’s what makes it worthwhile
Society's Backend
Meta's New Segmentation Model, A New Open-Source Image Generation Model, Apple Intelligence Model...
Machine learning resources and updates 8/5/2024
4 months ago
Machine learning resources and updates 8/5/2024
Society's Backend
Welcome to 2024: The Year Where AI is No Longer an Option
Why everyone should learn about machine learning
11 months ago
Why everyone should learn about machine learning
Matt Mazur
Redesigning Preceden’s Pricing Page
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
Society's Backend
Weekly Backend #5: 55 Resources
The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful...
7 months ago
The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful viruses, and more
Society's Backend
Top 10 Machine Learning Resources and Updates 06/14/2024
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
6 months ago
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good.
Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Teachers adapted to the calculator. They can certainly adapt to language models.
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Society's Backend
Backend Biweekly #3: 97 Updates and Resources
Huge Nvidia Updates, Gemini Hackathon for Money, and more
8 months ago
Huge Nvidia Updates, Gemini Hackathon for Money, and more
One Useful Thing
Blinded by Analogies
What is this AI thing? The wrong model can lead us astray
a year ago
What is this AI thing? The wrong model can lead us astray
One Useful Thing
Everyone is above average
Is AI a Leveler, King Maker, or Escalator?
a year ago
Is AI a Leveler, King Maker, or Escalator?
One Useful Thing
The Present Future: AI's Impact Long Before Superintelligence
You can start to see the outlines of an AI future, for better and worse
a month ago
You can start to see the outlines of an AI future, for better and worse
One Useful Thing
Catastrophe / Eucatastrophe
We have more agency over the future of AI than we think.
a year ago
We have more agency over the future of AI than we think.
Society's Backend
A Privacy Review: Google
I read Google's privacy policy for you
a year ago
I read Google's privacy policy for you
One Useful Thing
Scaling: The State of Play in AI
A brief intergenerational pause...
3 months ago
A brief intergenerational pause...
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
over a year ago
I ported Stable Diffusion to my phone
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community
The timeline and why OpenAI’s actions are a big deal
7 months ago
The timeline and why OpenAI’s actions are a big deal
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Rozado’s Visual...
The Increasing Prominence of Prejudice and Social Justice Rhetoric in UK News Media
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice...
over a year ago
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice and social justice rhetoric in UK news media. Recent years have seen considerable debate about the rise of political polarization in British society. Specifically, over the last...
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
3 weeks ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
Strange Loop Canon
Evaluations are all we need
On analysing talent in LLMs
11 months ago
On analysing talent in LLMs
Artificial Ignorance
AI Roundup 030: OpenAI's $1B revenue
September 1, 2023
a year ago
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
One Useful Thing
When you give a Claude a mouse
Some quick impressions of an actual agent
2 months ago
Some quick impressions of an actual agent
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia
And how our media is failing, wildly, in one of the most important stories in US history
a month ago
And how our media is failing, wildly, in one of the most important stories in US history
Artificial Ignorance
AI Roundup 067: GPT-4o and Google I/O
May 17, 2024.
7 months ago
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Weighty Thoughts
Why we need AI as a society
We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
We’re aging too fast (AKA my entire AI/robotics investment thesis)
Artificial Ignorance
AI Roundup 096: Happy Shipmas
December 6, 2024.
2 weeks ago
Artificial Ignorance
How Intercom is transforming customer support with AI
A conversation with Fergal Reid, VP of AI at Intercom.
8 months ago
A conversation with Fergal Reid, VP of AI at Intercom.
Society's Backend
The Slow, Painful Death of the Free Content Creator
It's happening as you read this
a year ago
It's happening as you read this
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
Weighty Thoughts
When the AI Bubble Bursts
It’s when, not if, for these kinds of new technologies
5 months ago
It’s when, not if, for these kinds of new technologies
One Useful Thing
Confronting Impossible Futures
We shouldn't be certain about what is next, but we should plan for it
5 months ago
We shouldn't be certain about what is next, but we should plan for it
One Useful Thing
Centaurs and Cyborgs on the Jagged Frontier
I think we have an answer on whether AIs will reshape work....
a year ago
I think we have an answer on whether AIs will reshape work....
Artificial Ignorance
AI Roundup 083: Bioacoustics
September 6, 2024.
3 months ago
Artificial Ignorance
The State of AI Engineering (2024)
Notes from the AI Engineer World's Fair.
5 months ago
Notes from the AI Engineer World's Fair.
Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Strange Loop Canon
The age of access
the great polarisation theory, and the death of professions
a year ago
the great polarisation theory, and the death of professions
One Useful Thing
The future of education in a world of AI
A positive vision for the transformation to come
a year ago
A positive vision for the transformation to come
Society's Backend
A Fundamental Overview of Machine Learning Experimentation [Part 1]
And how it differs from the software development you're familiar with
2 weeks ago
And how it differs from the software development you're familiar with
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
5 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Marcus on AI
Two visions of AI’s future
It’s not looking good
2 weeks ago
AI Snake Oil
I set up a ChatGPT voice interface for my 3-year old. Here’s how it went.
Chatbots are likely to revive familiar debates about kids and apps
a year ago
Chatbots are likely to revive familiar debates about kids and apps
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty.
“Life can only be understood backwards, but it must be lived forwards.”
9 months ago
“Life can only be understood backwards, but it must be lived forwards.”
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
2 months ago
“Connectionist” vs. Knowledge-Based AI
AI Snake Oil
People keep anthropomorphizing AI. Here’s why
Companies and journalists both contribute to the confusion
a year ago
Companies and journalists both contribute to the confusion
Made by Ollin
Singing Style Transfer
Initial Experiments
over a year ago
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
10 months ago
Four questions to ask your organization.
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Strange Loop Canon
Slouching Towards Utopia
by Brad DeLong
a year ago
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
Society's Backend
AI Reading List 1: Understand Transformers, Reflection-70B Update, and LLMs Still Cannot Reason
Society's Backend Reading List 10-07-2024
2 months ago
Society's Backend Reading List 10-07-2024
Daniel Miessler
Unsupervised Learning NO. 365 | China’s Decline, MicrosoftAI, Creativity Ratio…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS NYC Surveillance Amnesty International has revealed new research showing that the NYPD has over 15,000 cameras that can do...
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches
If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
Rozado’s Visual...
The political preferences of Grok
Elon Musk's response to ChatGPT
a year ago
Elon Musk's response to ChatGPT
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
11 months ago
And other practical guides to understand machine learning
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
Daniel Miessler
Custom Models Are AI’s Killer App
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Matt Mazur
It’s Time to Build
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
3 weeks ago
The bullshit just keeps on coming.
Matt Mazur
Full Time Indie Hacking: Month 5 Update
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
IEEE Spectrum
SwitchBot S10 Review: “This Is the Future of Home Robots”
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
2 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Sam Altman
Tech Workers' Values
For good and bad, technology has become a central force in all
our lives.
As members of the...
over a year ago
For good and bad, technology has become a central force in all
our lives.
As members of the community, we're interested in ways in which
tech companies can use their collective power to protect privacy, rule of law,
freedom of expression, and other fundamental American rights....
Strange Loop Canon
AI bill vetoed; what's next?
Make AI regulations evidence based
2 months ago
Make AI regulations evidence based
Daniel Miessler
Something is Up With Meritocracy
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
AI Snake Oil
We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.
Technology Isn’t the Problem—or the Solution.
a week ago
Technology Isn’t the Problem—or the Solution.
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
10 months ago
AI Snake Oil
What the executive order means for openness in AI
Good news on paper, but the devil is in the details
a year ago
Good news on paper, but the devil is in the details
Society's Backend
How to Use Benchmarks to Build Successful Machine Learning Systems
And what benchmarks mean for real-world applications
4 months ago
And what benchmarks mean for real-world applications
One Useful Thing
Signs and Portents
Some hints about what the next year of AI looks like
11 months ago
Some hints about what the next year of AI looks like
Strange Loop Canon
People want competence, seemingly over everything else
All elections are about state capacity
a month ago
All elections are about state capacity
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Matt Mazur
The Kenya Quick Answer Goes Viral, Again
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
2 months ago
The one good reason to do a PhD and two others that fall flat
One Useful Thing
Using AI to make teaching easier & more impactful
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Artificial Ignorance
AI Roundup 048: The Robot Constitution
January 5, 2024.
11 months ago
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More
Discussions from the past week: 09/16/2024
3 months ago
Discussions from the past week: 09/16/2024
AI Snake Oil
Four more things we worked on in 2022
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
a year ago
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
Rozado’s Visual...
Define Wokeness! Or how you shall know a word by the company it keeps
Visualizing what words often appear in the vicinity of woke/wokeness in news media content...
a year ago
Visualizing what words often appear in the vicinity of woke/wokeness in news media content illustrates why communication is almost impossible between red and blue America
Marcus on AI
o3, AGI, the art of the demo, and what you can expect in 2025
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived....
20 hours ago
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived. Here’s what you should pay attention to in the coming year.
Andrej Karpathy blog
A Survival Guide to a PhD
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
One Useful Thing
One sentence.
Prompting for maximum impact (and why that is a bad idea)
a year ago
Prompting for maximum impact (and why that is a bad idea)
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
Artificial Ignorance
AI Roundup 050: Synthetic Geometry
January 19, 2024.
11 months ago
Weighty Thoughts
What is Defensibility?
Back to basics for AI startups and others
8 months ago
Back to basics for AI startups and others
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm...
Machine learning resources and updates 8/26/2024
3 months ago
Machine learning resources and updates 8/26/2024
Artificial Ignorance
Workshop: Midjourney Masterclass with Daniel Nest
“This is one of the only webinars where I've actually been glued to my screen for the entire time,...
3 months ago
“This is one of the only webinars where I've actually been glued to my screen for the entire time, not distracted by passing whimsies...
Society's Backend
Artificial Intelligence: A New Paradigm Emerges
A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
A realistic perspective of the advantages and pitfalls of artificial intelligence
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale
Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Moving AI ethics beyond explainability and fairness to empowerment and justice
Artificial Ignorance
How to build an AI search engine (Part 1)
Working with Claude, Brave, and streaming responses.
2 months ago
Working with Claude, Brave, and streaming responses.
Society's Backend
Mastering the Art of Documentation
Documentation is really just glorified dog sitting
a year ago
Documentation is really just glorified dog sitting
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots
large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
a month ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
One Useful Thing
Four Singularities for Research
The rise of AI is creating both crisis and opportunity
7 months ago
The rise of AI is creating both crisis and opportunity
Marcus on AI
Which CEO will be the last to see it?
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
2 weeks ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
Daniel Miessler
News & Analysis | NO. 349
over a year ago
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition
A simple answer, and then a less simple one.
a year ago
A simple answer, and then a less simple one.
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
7 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
Andrej Karpathy blog
Self-driving as a case study for AGI
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
11 months ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Artificial Ignorance
Tutorial: How to chat with your documents
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
Artificial Ignorance
The fable of Reflection 70B
From groundbreaking to grifting.
3 months ago
From groundbreaking to grifting.
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
2 weeks ago
Society's Backend Reading List 12-2-2024
Daniel Miessler
Why Apple Keeps Winning
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Marcus on AI
Update re: Microsoft and training data
Relevant to the post I sent earlier today,...
3 weeks ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Marcus on AI
Satya Nadella and the three stages of scientific truth
A textbook case in how good ideas are often initially throttled
4 weeks ago
A textbook case in how good ideas are often initially throttled
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
Marcus on AI
Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
2 weeks ago
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
3 weeks ago
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse?
Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Providing a technical perspective for a more educated assessment of a complaint I hear quite frequently
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Matt Mazur
Going Full Time on My SaaS After 13 Years
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
The Berkeley...
Modeling Extremely Large Images with $x$T
As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Daniel Miessler
Using Custom Searches in Safari (in 2022)
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
Daniel Miessler
UL NO. 354 | THE NEWS & ANALYSIS SERIES
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from...
over a year ago
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from attaining advanced semiconductors. And now it looks like the bans will be expanded to quantum computing and AI as well. NYTIMES | MY ANALYSIS BELOW It appears Bytedance had a plan to...
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Artificial Ignorance
Honey, I joined a cabal
Or: Mainstream media still isn't great at covering tech and AI ideologies
6 months ago
Or: Mainstream media still isn't great at covering tech and AI ideologies
AI Snake Oil
Three Ideas for Regulating Generative AI
Policy input to the federal government from a Stanford-Princeton team
a year ago
Policy input to the federal government from a Stanford-Princeton team
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
2 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
Sam Altman
How To Be Successful
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter.
Here are 13 thoughts about how to achieve such outlier...
Sam Altman
Hard Startups
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
over a year ago
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one. A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
Marcus on AI
Casey (Newton) Strikes Out
His continued skepticism of AI skepticism continues to miss the mark
a week ago
His continued skepticism of AI skepticism continues to miss the mark
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
Artificial Ignorance
Jevons Paradox and the future of programming
Supply and demand in the Age of AI.
8 months ago
Supply and demand in the Age of AI.
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Strange Loop Canon
Seeing Like A Network
Dark Forests, Dense Networks
6 months ago
Dark Forests, Dense Networks
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0…
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
11 months ago
Output similarity is a distraction
Artificial Ignorance
AI Roundup 039: The governance issue
November 3, 2023.
a year ago
IEEE Spectrum
Video Friday: ICRA Turns 40
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
IEEE Spectrum
Video Friday: Trick or Treat, Atlas
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
10 months ago
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode
One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
One Useful Thing
A prosthesis for imagination: Using AI to boost your creativity
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
a year ago
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering
And isn't that we're all going to lose our jobs
9 months ago
And isn't that we're all going to lose our jobs
One Useful Thing
What just happened, what is happening next
The tasks AI can do well are expanding rapidly
8 months ago
The tasks AI can do well are expanding rapidly
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
Artificial Ignorance
AI Roundup 029: Hug all the faces
August 25, 2023
a year ago
Weighty Thoughts
VC Office Hours
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
10 months ago
Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
One Useful Thing
On the necessity of a sin
Why treating AI like a person is the future
8 months ago
Why treating AI like a person is the future
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and...
Society's Backend Reading List 11-11-2024
a month ago
Society's Backend Reading List 11-11-2024
Society's Backend
What Makes Machine Learning so Hard for Software Engineers
How decades of learning a mindset makes adapting difficult
4 months ago
How decades of learning a mindset makes adapting difficult
Stories by Andrej...
Virtual Reality: still not quite there, again.
over a year ago
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Artificial Ignorance
AI Roundup 093: Diminishing returns
November 15, 2024.
a month ago
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
Society's Backend
Clarifying DEI
What makes DEI important and where it fails
11 months ago
What makes DEI important and where it fails
One Useful Thing
Thinking companion, companion for thinking
Some simple ways to use AI to break you out of biases
a year ago
Some simple ways to use AI to break you out of biases
AI Snake Oil
Evaluating LLMs is a minefield
Annotated slides from a recent talk
a year ago
Annotated slides from a recent talk
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
Society's Backend
All Machine Learning Resources and Updates 06/21/2024
Below are the machine learning resources and updates from the past few days you don't want to miss....
6 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Artificial Ignorance
LLMs are getting dumber and we have no idea why
Five theories that could explain how chatbots are getting worse.
3 months ago
Five theories that could explain how chatbots are getting worse.
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
Marcus on AI
Generative AI’s Continuing Copyright Problems, an Essay in Memory of Suchir Balaji, 1998 - 2024
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate...
a week ago
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate named Suchir Balaji, who had just left OpenAI.
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice
Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
One Useful Thing
Embracing weirdness: What it means to use AI as a (writing) tool
AI is strange. We need to learn to use it.
a year ago
AI is strange. We need to learn to use it.
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition
AI systems have gotten more capable and easier to use
6 months ago
AI systems have gotten more capable and easier to use
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
over a year ago
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another.
Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Daniel Miessler
NO. 363 | FrontView Mirror: 2023 Edition
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS...
a year ago
New Content 💡FRONTVIEW MIRROR: 2023 EDITION 💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS BREACHES SECURITY NEWS In a bit of Deja Vu from LastPass, Okta has now revealed that attackers have stolen source code from its GitHub repositories. This comes after it was hit by...
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
fast.ai
Can LLMs learn from a single example?
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Society's Backend
Godmother of AI Warns Against Regulation, Apple Intelligence System Prompts, Faster and Cheaper AI,...
Machine learning resources and updates 8/12/2024
4 months ago
Machine learning resources and updates 8/12/2024
Society's Backend
Coming soon!
Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
The Gradient
The Artificiality of Alignment
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk”...
a year ago
This essay first appeared in Reboot.
Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
Artificial Ignorance
Saving the world with AI and government grants
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
5 months ago
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
Artificial Ignorance
AI Roundup 066: AlphaFold 3
May 10, 2024.
7 months ago
Rozado’s Visual...
DepolarizingGPT
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
Society's Backend
Anti-Social Media
How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
Artificial Ignorance
I gave ChatGPT access to my Gmail
I'm sure this will end well.
a year ago
I'm sure this will end well.
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
8 months ago
Artificial Ignorance
Blade Runner 2024
Reddit's AI Hunters and the quest for authentic digital experiences.
3 months ago
Reddit's AI Hunters and the quest for authentic digital experiences.
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
10 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Daniel Miessler
The 2 Current Major AI Bottlenecks
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Rozado’s Visual...
Out-of-office Donald Trump still more prominent in news media content than the current U.S....
In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump...
a year ago
In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump in news media content (see here). I have recently updated that previous analysis. Briefly stated, no U.S. president in recent history has received a similar amount of media...
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI...
Machine learning resources and updates 2024-09-09
3 months ago
Machine learning resources and updates 2024-09-09
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
a month ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
3 weeks ago
Fantastic writeup of my views today at The Wall Street Journal:
Artificial Ignorance
AI Roundup 080: Grok 2
August 16, 2024.
4 months ago
One Useful Thing
Which AI should I use? Superpowers and the State of Play
And then there were three...
9 months ago
And then there were three...
Society's Backend
Founder Mode, How AI Impacts Education, Diffusion Models As Real-Time Game Engines, and More
Machine learning resources and updates 2024-09-03
3 months ago
Machine learning resources and updates 2024-09-03
Society's Backend
One Year of Society's Backend
The lessons I've learned along the way
4 months ago
The lessons I've learned along the way
Artificial Ignorance
What AI models really think about politics
Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
a month ago
Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
One Useful Thing
Magic for English Majors
Programming in prose in an AI-haunted world
a year ago
Programming in prose in an AI-haunted world
Matt Mazur
Preceden’s Spam Problem
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS...
a year ago
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS timeline maker tool. I’m honestly surprised it took spammers so long: Preceden is a freemium product (meaning people can sign up and try it for free), the product makes it very easy to...
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free
Announcing the ML Road Map-Turbo
6 months ago
Announcing the ML Road Map-Turbo
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
9 months ago
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
One Useful Thing
The Homework Apocalypse
Fall is going to be very different this year. Educators need to be ready.
a year ago
Fall is going to be very different this year. Educators need to be ready.
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination
Sample language model responses to different varieties of English and native speaker...
3 months ago
Sample language model responses to different varieties of English and native speaker reactions.
ChatGPT does amazingly well at communicating with people in English. But whose English?
Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
One Useful Thing
My class required AI. Here's what I've learned so far.
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
(Spoiler alert: it has been very successful, but there are some lessons to be learned)
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
The Berkeley...
Rethinking the Role of PPO in RLHF
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
8 months ago
From megaFLOPS to mega flops.
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
All of us, except the AI startups and VCs—unless a real war breaks out
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 