The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves.
What spending $2,000 can tell us about evaluating AI agents
7 months ago
What spending $2,000 can tell us about evaluating AI agents
Made by Ollin
HintBot
Hinting icons automatically with a neural network
over a year ago
Hinting icons automatically with a neural network
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection
Authors: PromptArmor
4 months ago
Rozado’s Visual...
The Political Preferences of LLMs
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
10 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
Sam Altman
Hard Startups
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
over a year ago
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one. A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
Daniel Miessler
Generate AI Art Using Your Own Writing
One of the most challenging parts of finishing a post is coming up with a good image. The AI art...
over a year ago
One of the most challenging parts of finishing a post is coming up with a good image. The AI art tools like DALL-E, Midjourney, and Stable Diffusion are cool, but a lot of the magic comes down to prompt engineering, which is non-trivial. Prompt Engineering is almost equal parts...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
Artificial Ignorance
The intern and the coach
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Society's Backend
All Machine Learning Resources and Updates 06/21/2024
Below are the machine learning resources and updates from the past few days you don't want to miss....
6 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Artificial Ignorance
Honey, I joined a cabal
Or: Mainstream media still isn't great at covering tech and AI ideologies
6 months ago
Or: Mainstream media still isn't great at covering tech and AI ideologies
One Useful Thing
One sentence.
Prompting for maximum impact (and why that is a bad idea)
a year ago
Prompting for maximum impact (and why that is a bad idea)
Society's Backend
Taking the AI to Consumers
The Google Pixel 8 Pro is a much bigger deal than you think
a year ago
The Google Pixel 8 Pro is a much bigger deal than you think
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
IEEE Spectrum
Video Friday: ICRA Turns 40
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good.
Turning models into products runs into five challenges
4 months ago
Turning models into products runs into five challenges
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
4 months ago
Weekly updates and resources 7/29/24
Artificial Ignorance
YC is now 80% AI startups (S24)
Analyzing the latest companies out of "AI Combinator"
2 months ago
Analyzing the latest companies out of "AI Combinator"
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Rozado’s Visual...
DepolarizingGPT
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
Artificial Ignorance
Tutorial: How to build an AI agent (Part 2)
Part 2: Giving our agent internet access.
a year ago
Part 2: Giving our agent internet access.
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
Rozado’s Visual...
El sesgo político de ChatGPT
A la izquierda del centro político
a year ago
A la izquierda del centro político
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Weighty Thoughts
I'm writing a book!
Why I've been gone over a month, and how you can help
3 weeks ago
Why I've been gone over a month, and how you can help
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Artificial Ignorance
AI Roundup 045: Google's just getting started
December 15, 2023.
a year ago
One Useful Thing
Embracing weirdness: What it means to use AI as a (writing) tool
AI is strange. We need to learn to use it.
a year ago
AI is strange. We need to learn to use it.
Sam Altman
A Clarification
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to...
over a year ago
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to clarify it.
I didn’t mean that we need to tolerate brilliant homophobic
jerks in the lab so that we can have scientific progress.
Although there are famous...
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
AI Snake Oil
OpenAI’s policies hinder reproducible research on language models
LLMs have become privately-controlled research infrastructure
a year ago
LLMs have become privately-controlled research infrastructure
Andrej Karpathy blog
Self-driving as a case study for AGI
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
11 months ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
Strange Loop Canon
State of the Canon
Onwards
11 months ago
Artificial Ignorance
AI Roundup 057: Claude 3
March 8, 2024.
9 months ago
Artificial Ignorance
How Shopify is making AI Magic
A case study on turning competitive advantages into useful AI.
a year ago
A case study on turning competitive advantages into useful AI.
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth?
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
3 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
Daniel Miessler
Your Experience is Your Creativity
Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Daniel Miessler
News & Analysis | NO. 352
over a year ago
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
fast.ai
nbdev+Quarto: A new secret weapon for productivity
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
over a year ago
Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
Society's Backend
Founder Mode, How AI Impacts Education, Diffusion Models As Real-Time Game Engines, and More
Machine learning resources and updates 2024-09-03
3 months ago
Machine learning resources and updates 2024-09-03
Rozado’s Visual...
Which is the Wokest AI?
A Wokeness Ranking of LLMs
9 months ago
A Wokeness Ranking of LLMs
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Society's Backend
The Unfortunate Truth Regarding AI Regulation
And the impact it'll have for decades to come
6 months ago
And the impact it'll have for decades to come
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
3 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
Strange Loop Canon
The age of access
the great polarisation theory, and the death of professions
a year ago
the great polarisation theory, and the death of professions
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
3 weeks ago
Made by Ollin
Mac Replacement Icons
A standardized, simplified, and beautiful icon set
over a year ago
A standardized, simplified, and beautiful icon set
Sam Altman
How To Be Successful
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter.
Here are 13 thoughts about how to achieve such outlier...
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice...
Society's Backend Reading List 11-18-2024
a month ago
Society's Backend Reading List 11-18-2024
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
4 months ago
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering
And isn't that we're all going to lose our jobs
9 months ago
And isn't that we're all going to lose our jobs
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
11 months ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
6 months ago
The mystery of why we don't dream of building perfect societies anymore
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards
Counterintuitively, start from how much money you need
over a year ago
Counterintuitively, start from how much money you need
Society's Backend
Clarifying DEI
What makes DEI important and where it fails
11 months ago
What makes DEI important and where it fails
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
11 months ago
Taking AI timelines seriously
Matt Mazur
The Kenya Quick Answer Goes Viral, Again
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps
I keep getting fooled by AI, and it seems like others are, too.
a year ago
I keep getting fooled by AI, and it seems like others are, too.
Artificial Ignorance
Bridging AI and human creativity
A conversation with Harrison Telyan, co-founder of NUMI.
9 months ago
A conversation with Harrison Telyan, co-founder of NUMI.
fast.ai
My family’s unlikely homeschooling journey
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
Weighty Thoughts
The AI Executive Order
AKA: “We’ll do something about it later”
a year ago
AKA: “We’ll do something about it later”
One Useful Thing
Scaling: The State of Play in AI
A brief intergenerational pause...
3 months ago
A brief intergenerational pause...
Weighty Thoughts
What I got Right or Wrong in 2020
Reflecting on the Past Year
over a year ago
Reflecting on the Past Year
The Berkeley...
2024 BAIR Graduate Directory
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most...
9 months ago
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most talented and innovative minds in artificial intelligence and machine learning. Our Ph.D. graduates have each expanded the frontiers of AI research and are now ready to embark on new...
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy
How speculation gets laundered through pseudo-quantification
4 months ago
How speculation gets laundered through pseudo-quantification
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
over a year ago
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
AI Snake Oil
Are open foundation models actually more risky than closed ones?
A policy brief on open foundation models
a year ago
A policy brief on open foundation models
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research?
Mentions of climate change in news media vastly outnumber other existential threats
a year ago
Mentions of climate change in news media vastly outnumber other existential threats
Weighty Thoughts
Open AI's Valuation and a Favor to Ask
A guest post and an in-person panel
4 months ago
A guest post and an in-person panel
One Useful Thing
A quick and sobering guide to cloning yourself
It took me a few minutes to create a fake me giving a fake lecture.
a year ago
It took me a few minutes to create a fake me giving a fake lecture.
AI Snake Oil
What is algorithmic amplification and why should we care?
A symposium and a primer on social media recommendation algorithms
a year ago
A symposium and a primer on social media recommendation algorithms
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and...
Society's Backend Reading List 11-11-2024
a month ago
Society's Backend Reading List 11-11-2024
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
Artificial Ignorance
Pitfalls of building with large language models
Dealing with more than just hallucinations.
a year ago
Dealing with more than just hallucinations.
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
5 months ago
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition
AI systems have gotten more capable and easier to use
6 months ago
AI systems have gotten more capable and easier to use
Artificial Ignorance
I gave ChatGPT access to my Gmail
I'm sure this will end well.
a year ago
I'm sure this will end well.
Daniel Miessler
Twitter’s Blue Checkmark Strategy Reduces Trust in Pursuit of Revenue
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month,...
over a year ago
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month, I was happy. As a legacy holder of the checkmark there’s a slight band-aid-sting of the check indicating specialness—who doesn’t want to feel special?—but I’d much rather see a...
Artificial Ignorance
AI Roundup 062: Data is the new oil
April 12, 2024.
8 months ago
Weighty Thoughts
China's AI Journey
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
Matt Mazur
When LTD Purchasers Meet an Inactive User Policy
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo...
a year ago
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo community. Maybe I’ll dive into my experience there in another post, but I wanted to share an interesting thing that’s happening now, a year after the deal ended. AppSumo has a policy...
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Artificial Ignorance
AI Roundup 078: Voice mode
August 2, 2024.
4 months ago
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
IEEE Spectrum
Video Friday: Mobile Robot Upgrades
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ROSCon 2024: 21–23 October 2024,...
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
11 months ago
Output similarity is a distraction
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications
And then there were two.
10 months ago
Artificial Ignorance
Tutorial: How to streamline your writing process with Whisper and GPT-4
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
7 months ago
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
7 months ago
How employees and CEOs alike can plan for the future.
One Useful Thing
What just happened, what is happening next
The tasks AI can do well are expanding rapidly
8 months ago
The tasks AI can do well are expanding rapidly
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
10 months ago
Rozado’s Visual...
The Political Biases of Google Bard
It is probably only a matter of time until a nation state purposely builds a biased AI system...
a year ago
It is probably only a matter of time until a nation state purposely builds a biased AI system designed to advance government interests
Artificial Ignorance
Jevons Paradox and the future of programming
Supply and demand in the Age of AI.
8 months ago
Supply and demand in the Age of AI.
Strange Loop Canon
Power, money and human nature
Thoughts on OpenAI, a tragedy
a year ago
Thoughts on OpenAI, a tragedy
Society's Backend
Why Machine Learning Terminology is So Confusing
And definitions for the most important terms you should know
10 months ago
And definitions for the most important terms you should know
Society's Backend
If You Understand Bananas, You Can Understand Machine Learning
A simplified high-level overview of primary machine learning algorithms for anyone to understand
11 months ago
A simplified high-level overview of primary machine learning algorithms for anyone to understand
Rozado’s Visual...
The Political Biases of GPT-4
Things are not always what they seem
a year ago
Things are not always what they seem
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
7 months ago
Inside Stability AI's roster of AI models.
Daniel Miessler
Companies as Alaskan Fishing Boats
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest...
over a year ago
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest Catch. So you have this tiny crew of total badasses. Everyone is a superhero at their particular role because the crew needs to stay extremely small to protect profits. The...
Artificial Ignorance
Distributing the future
A reminder that things take time.
6 months ago
A reminder that things take time.
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
AI Snake Oil
What the executive order means for openness in AI
Good news on paper, but the devil is in the details
a year ago
Good news on paper, but the devil is in the details
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too)
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
Society's Backend
The Method Google Used to Reduce LLM Size by 66%
A brief overview of knowledge distillation and its capabilities
5 months ago
A brief overview of knowledge distillation and its capabilities
AI Snake Oil
Starting reading the AI Snake Oil book online today
The book will be published on September 24
3 months ago
The book will be published on September 24
Society's Backend
LLM Research Recap of 2024, Fine-tuning LLM Judges, Amazon's Nova Models, Google's Genie 2, and More
Society's Backend Reading List 12-10-2024
a week ago
Society's Backend Reading List 12-10-2024
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
11 months ago
And why it might revolutionize the search industry.
Andrej Karpathy blog
A Survival Guide to a PhD
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Weighty Thoughts
Deep Tech Startups Are Not Software Startups
Or why AI and “Software/SaaS” are apples and oranges
10 months ago
Or why AI and “Software/SaaS” are apples and oranges
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter
Democratizing data analysis with AI
a year ago
Democratizing data analysis with AI
Sam Altman
PG and Jessica
A lot of people want to replicate YC in some other industry or some other place or with some other...
over a year ago
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
One Useful Thing
The future, soon: what I learned from Bing's AI
We had a brief glimpse of two different types of AI. Both are significant
a year ago
We had a brief glimpse of two different types of AI. Both are significant
Artificial Ignorance
AI Roundup 038: Preparedness
October 27, 2023.
a year ago
fast.ai
Can LLMs learn from a single example?
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
One Useful Thing
The Best Available Human Standard
What are the imperatives of the upside?
a year ago
What are the imperatives of the upside?
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water resources, and more
Matt Mazur
Redesigning Preceden’s Pricing Page
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
over a year ago
I ported Stable Diffusion to my phone
AI Snake Oil
AI scaling myths
Scaling will run out. The question is when.
5 months ago
Scaling will run out. The question is when.
Daniel Miessler
Summary: Andrej Kaparthy on Lex Fridman’s Podcast (Late 2022)
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My...
a year ago
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My One-Sentence Summary/Highlight The future of programming is not humans writing code, but neural nets creating weights. Capture Neural networks are mathematical expressions with many...
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
2 months ago
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
One Useful Thing
What just happened
A transformative month rewrites the capabilities of AI
3 days ago
A transformative month rewrites the capabilities of AI
Strange Loop Canon
AI embraces its product arc
fuzzy processors are entering mass production
7 months ago
fuzzy processors are entering mass production
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
4 months ago
What people (still) fundamentally misunderstand about AI search.
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1)
Part 1: What is an agent, and how do they work?
a year ago
Part 1: What is an agent, and how do they work?
Strange Loop Canon
Seeing Like A Network
Dark Forests, Dense Networks
6 months ago
Dark Forests, Dense Networks
Society's Backend
You Are What You Eat: Digital Edition
Why who you follow is more important than who follows you
a year ago
Why who you follow is more important than who follows you
The Gradient
Do text embeddings perfectly encode text?
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
9 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
Daniel Miessler
What Made the 90’s So Awesome?
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Weighty Thoughts
Let's talk about AI power costs
It's important, but a lot of recent attention has been concern-trolling
4 months ago
It's important, but a lot of recent attention has been concern-trolling
Artificial Ignorance
AI Roundup 073: Music make you lose control
June 28, 2024.
5 months ago
Artificial Ignorance
AI Roundup 081: Creative differences
August 23, 2024.
4 months ago
Marcus on AI
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a week ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
Strange Loop Canon
Predicting AI
I revisit past predictions
3 months ago
I revisit past predictions
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
10 months ago
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth so much
Sam Altman
How To Invest In Startups
There is a lot of advice about how to be a good startup founder. But there isn’t very much about...
over a year ago
There is a lot of advice about how to be a good startup founder. But there isn’t very much about how to be a good startup investor.
Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
One Useful Thing
Acceleration.
7 days of new AI technologies shows us that everything is happening very fast.
a year ago
7 days of new AI technologies shows us that everything is happening very fast.
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Artificial Ignorance
Blade Runner 2024
Reddit's AI Hunters and the quest for authentic digital experiences.
3 months ago
Reddit's AI Hunters and the quest for authentic digital experiences.
AI Snake Oil
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
a year ago
How the veneer of AI is used to legitimize awful ideas
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
3 weeks ago
Fantastic writeup of my views today at The Wall Street Journal:
AI Snake Oil
Scientists should use AI as a tool, not an oracle
How AI hype leads to flawed research that fuels more hype
6 months ago
How AI hype leads to flawed research that fuels more hype
Artificial Ignorance
AI Roundup 032: The Insight Forum
September 15, 2023.
a year ago
Artificial Ignorance
The State of AI Engineering
Notes from the first AI Engineer Summit.
a year ago
Notes from the first AI Engineer Summit.
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
9 months ago
Adding precision to the debate on openness in AI
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Matt Mazur
The Security Questionnaire Dilemma
About once a year I get an email from someone working in a security and compliance department at a...
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
Artificial Ignorance
AI Roundup 086: Llama 3.2
September 27, 2024.
2 months ago
Sam Altman
Keep the Internet Open
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon.
The internet is a public good, and I believe access should be a basic right. We've seen such great innovation in software because the internet has...
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Made by Ollin
Acapella Extraction with ConvNets
A working prototype
over a year ago
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
2 weeks ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition
A simple answer, and then a less simple one.
a year ago
A simple answer, and then a less simple one.
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
5 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
3 weeks ago
Scaling laws were supposed to be, well, laws.
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
One Useful Thing
Assigning AI: Seven Ways of Using AI in Class
Also prompts! And things to watch out for!
a year ago
Also prompts! And things to watch out for!
Society's Backend
Why Gemini's Struggles Aren't Straightforward
And an overview of LLM security issues
9 months ago
And an overview of LLM security issues
Marcus on AI
Two visions of AI’s future
It’s not looking good
2 weeks ago
Society's Backend
The State of AI in China
Is China winning the race to AGI?
5 months ago
Is China winning the race to AGI?
Society's Backend
The Metrics Machine Learning Engineers Care About That Modelers Don't
And a brief overview of TPUs in Google data centers
9 months ago
And a brief overview of TPUs in Google data centers
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
9 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
Strange Loop Canon
The agent principal problem
"Show me the incentive and I will show you the outcome."
a year ago
"Show me the incentive and I will show you the outcome."
Society's Backend
What Apple Intelligence Means for You
"We think you're gonna LOVE it"
6 months ago
"We think you're gonna LOVE it"
Artificial Ignorance
AI Roundup 050: Synthetic Geometry
January 19, 2024.
11 months ago
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there
Contra Hoel on AI and its supply paradox
a year ago
Contra Hoel on AI and its supply paradox
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Daniel Miessler
NO. 368 | ChinaBalloons, CustomGPT, 90s++…
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll...
a year ago
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll prevent the email from occasionally descending into the void. SECURITY The US shot down a Chinese spy balloon. They gathered the debris from the water it fell into, and it's currently...
Artificial Ignorance
Funding a new generation of AI companies
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
11 months ago
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
One Useful Thing
Blinded by Analogies
What is this AI thing? The wrong model can lead us astray
a year ago
What is this AI thing? The wrong model can lead us astray
Marcus on AI
An AI rumor you won’t want to miss
Converging evidence that the core hypothesis driving generative AI may be wrong
a month ago
Converging evidence that the core hypothesis driving generative AI may be wrong
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
4 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning
You probably know more about machine learning math than you think
10 months ago
You probably know more about machine learning math than you think
Artificial Ignorance
How to leverage long form content with AI
Specific tools and tactics for authors, podcasters, and videographers.
6 months ago
Specific tools and tactics for authors, podcasters, and videographers.
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
6 days ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Artificial Ignorance
Case Study: Scaling customer intelligence
Analyzing 10,000 sales calls with Claude
3 weeks ago
Analyzing 10,000 sales calls with Claude
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Sam Altman
Helion Needs You
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
over a year ago
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator.
The goals of the company are quite ambitious—clean, continuous energy for 1...
The Berkeley...
Interactive Fleet Learning
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time.
In the last few years we have seen an exciting development in robotics and artificial...
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
a month ago
One Useful Thing
Now is the time for grimoires
It isn't data that will unlock AI, it is human expertise
a year ago
It isn't data that will unlock AI, it is human expertise
Artificial Ignorance
AI Zoology: Why are there so many animal models?
Inside the emerging model menagerie.
a year ago
Inside the emerging model menagerie.
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
9 months ago
And effective ways to mitigate it
The Berkeley...
TinyAgent: Function Calling at the Edge
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
6 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
fast.ai
From Deep Learning Foundations to Stable Diffusion
Practical Deep Learning for Coders part 2, 2022
over a year ago
Practical Deep Learning for Coders part 2, 2022
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
2 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Weighty Thoughts
The Fall of Data Moats
AI actually makes most data moats weaker
a year ago
AI actually makes most data moats weaker
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
7 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design
Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled.
The development of tools and methods to guide this process is one of the...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT
December 1, 2023.
a year ago
AI Snake Oil
FAQ about the book and our writing process
What's in the book and how we wrote it
2 months ago
What's in the book and how we wrote it
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
IEEE Spectrum
Video Friday: Mars Chopper
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Stories by Andrej...
A Peek at Trends in Machine Learning
over a year ago
AI Snake Oil
Introducing the REFORMS checklist for ML-based science
ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
ML-based science is in trouble. Clear reporting standards for researchers could help.
Sam Altman
Tech Workers' Values
For good and bad, technology has become a central force in all
our lives.
As members of the...
over a year ago
For good and bad, technology has become a central force in all
our lives.
As members of the community, we're interested in ways in which
tech companies can use their collective power to protect privacy, rule of law,
freedom of expression, and other fundamental American rights....
Society's Backend
Anti-Social Media
How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
One Useful Thing
A prosthesis for imagination: Using AI to boost your creativity
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
a year ago
AI can already beat humans in many measures of creativity. Let's use that to our advantage.
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
2 weeks ago
Society's Backend Reading List 12-2-2024
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Artificial Ignorance
Why Claude 3 is a big upgrade
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks,...
9 months ago
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks, add multi-modal capabilities, and are a real competitor to GPT-4.
Society's Backend
All Machine Learning Resources and Updates 7/8/24
Everything I've been reading
5 months ago
Everything I've been reading
Made by Ollin
NVIDIA Internship (2017)
Notes on my internship at NVIDIA Redmond.
over a year ago
Notes on my internship at NVIDIA Redmond.
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received
And how it changed my personal life too
12 months ago
And how it changed my personal life too
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on...
a year ago
… glorified marketing for portfolio companies, that is
I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr:
The emerging LLM stack is composed of several elements centered...
One Useful Thing
When you give a Claude a mouse
Some quick impressions of an actual agent
2 months ago
Some quick impressions of an actual agent
Sam Altman
Join the YC Software Team
If you want to get funded by YC as a founder in the future, but you don't have a startup that's...
over a year ago
If you want to get funded by YC as a founder in the future, but you don't have a startup that's ready for that yet, joining the YC software team is a great hack to get there.
The YC software team is a small group of hackers in SF that write the software that makes all the parts...
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
2 months ago
The one good reason to do a PhD and two others that fall flat
Artificial Ignorance
AI Roundup 064: Big Tech's small models
April 26, 2024.
7 months ago
Artificial Ignorance
AI Roundup 055: Race conditions
February 23, 2023.
10 months ago
Artificial Ignorance
AI Roundup 037: The AI IPCC
October 20, 2023.
a year ago
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
Artificial Ignorance
Stop begging for JSON
How OpenAI's Structured Outputs makes building with AI much more reliable.
a week ago
How OpenAI's Structured Outputs makes building with AI much more reliable.
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
12 months ago
Hey Siri, set a reminder for 365 days.
Society's Backend
Why MLX is Important for the ML Community
And a step-by-step guide to train a machine learning model on your Mac
7 months ago
And a step-by-step guide to train a machine learning model on your Mac
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
8 months ago
AI Snake Oil
How Transparent Are Foundation Model Developers?
Introducing the Foundation Model Transparency Index
a year ago
Introducing the Foundation Model Transparency Index
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Artificial Ignorance
AI Roundup 096: Happy Shipmas
December 6, 2024.
2 weeks ago
Artificial Ignorance
AI Roundup 098: Flash Thinking
December 20, 2024.
2 days ago
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing
Introduction
Imagine yourself a decade ago, jumping directly into the present shock of conversing...
4 months ago
Introduction
Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
One Useful Thing
Latent Expertise: Everyone is in R&D
Ideas come from the edges, not the center
6 months ago
Ideas come from the edges, not the center
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
a month ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.”
Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a week ago
Exactly as I warned in February
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
over a year ago
A checklist for avoiding hype
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode
One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric...
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks
TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
The Berkeley...
Modeling Extremely Large Images with $x$T
As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat
November 22, 2024.
4 weeks ago
Matt Mazur
It’s Time to Build
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free
Announcing the ML Road Map-Turbo
6 months ago
Announcing the ML Road Map-Turbo
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
2 months ago
“Connectionist” vs. Knowledge-Based AI
Society's Backend
An AI Revolution Isn't Coming - We're Already In It
A small showcase of companies using AI in ways that will change your life
a year ago
A small showcase of companies using AI in ways that will change your life
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Strange Loop Canon
Symposium: On Building God
a year ago
Artificial Ignorance
10 of the most impactful AI stories of 2023
A quick look back on a very busy year in AI.
a year ago
A quick look back on a very busy year in AI.
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a week ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
AI Snake Oil
AI safety is not a model property
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
9 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Artificial Ignorance
Has YC hit peak AI? (F24)
The latest batch is up to 86% AI startups.
2 weeks ago
The latest batch is up to 86% AI startups.
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Artificial Ignorance
Tutorial: How to make and share custom GPTs
They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
They're not going to disrupt everything (yet), but they're a ton of fun.
Frank’s Ramblings
Vision Transformers are Overrated
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
11 months ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
Artificial Ignorance
How to fine-tune ChatGPT
No GPU cluster required.
a year ago
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
11 months ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Sam Altman
Project Covalence
Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
over a year ago
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.
Science remains the...
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 