Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
over a year ago
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
8 months ago
Matt Mazur
Preceden’s Spam Problem
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS...
a year ago
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS timeline maker tool. I’m honestly surprised it took spammers so long: Preceden is a freemium product (meaning people can sign up and try it for free), the product makes it very easy to...
The Gradient
Text-to-CAD: Risks and Opportunities
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
The Berkeley...
On the Stepwise Nature of <br> Self-Supervised Learning
Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we...
a year ago
Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we find that the loss descends in a stepwise fashion (top left) and the learned embeddings iteratively increase in dimensionality (bottom left). Direct visualization of embeddings...
Strange Loop Canon
OpenAI's Strawberry models can reason like an expert
When models can think
3 months ago
Artificial Ignorance
AI Roundup 072: The new new Claude
June 21, 2024.
6 months ago
Sam Altman
GPT-4o
There are two things from our announcement today I wanted to highlight.
First, a key part of our...
7 months ago
There are two things from our announcement today I wanted to highlight.
First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
-->
Figure 1: CoarsenConf architecture.
(I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Society's Backend
How to Know if Your Data is Being Used Maliciously
The information you should know about a company before gifting them your data
a year ago
The information you should know about a company before gifting them your data
The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
Artificial Ignorance
The fable of Reflection 70B
From groundbreaking to grifting.
3 months ago
From groundbreaking to grifting.
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
over a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
IEEE Spectrum
Zen and the Art of Aibo Engineering
Sony’s team made that happen. And since Aibo’s debut, the company has sold
more than 170,000 of...
a week ago
Sony’s team made that happen. And since Aibo’s debut, the company has sold
more than 170,000 of the cute little quadrupeds—a huge number considering their price of several thousand dollars each. From the start, Aibo could express a range of simulated emotions and learn through...
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water resources, and more
Strange Loop Canon
AI embraces its product arc
fuzzy processors are entering mass production
7 months ago
fuzzy processors are entering mass production
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
Made by Ollin
Game Emulation via Neural Network
over a year ago
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
Made by Ollin
Priors for Autonomous Vehicle Development
over a year ago
Rozado’s Visual...
Which is the Wokest AI?
A Wokeness Ranking of LLMs
9 months ago
A Wokeness Ranking of LLMs
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
4 months ago
Matt Mazur
Full Time Indie Hacking: Month 5 Update
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
One Useful Thing
Getting started with AI: Good enough prompting
Don't make this hard
3 weeks ago
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
9 months ago
Adding precision to the debate on openness in AI
Artificial Ignorance
Milestones, motivations, and miscellany
Some thoughts on the future of this newsletter.
5 months ago
Some thoughts on the future of this newsletter.
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
6 months ago
The mystery of why we don't dream of building perfect societies anymore
Artificial Ignorance
Bridging AI and human creativity
A conversation with Harrison Telyan, co-founder of NUMI.
9 months ago
A conversation with Harrison Telyan, co-founder of NUMI.
One Useful Thing
The future of education in a world of AI
A positive vision for the transformation to come
a year ago
A positive vision for the transformation to come
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
Weighty Thoughts
News Roundup: May 27, 2014 🧴
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
6 months ago
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Artificial Ignorance
A stroll through Google's Model Garden
What generative AI capabilities does Google offer to developers?
a year ago
What generative AI capabilities does Google offer to developers?
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested.
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Artificial Ignorance
AI Roundup 083: Bioacoustics
September 6, 2024.
3 months ago
AI Snake Oil
Can AI automate computational reproducibility?
A new benchmark to measure the impact of AI on improving science
3 months ago
A new benchmark to measure the impact of AI on improving science
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Daniel Miessler
News & Analysis | NO. 350
over a year ago
Society's Backend
The Slow, Painful Death of the Free Content Creator
It's happening as you read this
a year ago
It's happening as you read this
IEEE Spectrum
Forums, Competitions, Challenges: Inspiring Creativity in Robotics
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total...
2 months ago
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the...
The Berkeley...
The Shift from Models to Compound AI Systems
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
10 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
Jascha’s blog
Neural network training makes beautiful fractals
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
10 months ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
.vimeo-player {
position: relative;
width: 444px;
height: 444px;
...
AI Snake Oil
Will AI transform law?
The hype is not supported by current evidence
11 months ago
The hype is not supported by current evidence
Daniel Miessler
Humiliation is Deadly
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That...
over a year ago
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That is, people who not only feel like they have no respect and no options to gain any respect, but who also feel that: They deserve those things, and… That someone else is the cause of...
Artificial Ignorance
AI's invisible instructions
What meme prompts can teach us about better interface design.
a month ago
What meme prompts can teach us about better interface design.
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers
Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Content creation and networking lessons from a wildly successful freelance tech writer
Made by Ollin
HintBot
Hinting icons automatically with a neural network
over a year ago
Hinting icons automatically with a neural network
Artificial Ignorance
GPTs won't make you rich
But they'll make you more productive.
11 months ago
But they'll make you more productive.
Weighty Thoughts
What I got Right or Wrong in 2020
Reflecting on the Past Year
over a year ago
Reflecting on the Past Year
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
One Useful Thing
Democratizing the future of education
We are all EdTech designers, now
a year ago
We are all EdTech designers, now
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
Marcus on AI
Satya Nadella and the three stages of scientific truth
A textbook case in how good ideas are often initially throttled
4 weeks ago
A textbook case in how good ideas are often initially throttled
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches
If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
Artificial Ignorance
AI Roundup 073: Music make you lose control
June 28, 2024.
5 months ago
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text.
Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing
January 26, 2024.
11 months ago
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
...
over a year ago
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
font-weight: 300;
overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */
}
.post pre,
.post code {
background-color: #fafafa;
font-size: 13px; /*...
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
One Useful Thing
AI in organizations: Some tactics
Meet the Lab and the Crowd
2 months ago
Meet the Lab and the Crowd
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition
August 9, 2024.
4 months ago
Frank’s Ramblings
Vision Transformers are Overrated
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
11 months ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
Artificial Ignorance
Tutorial: How to chat with your documents
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
Artificial Ignorance
Lessons from 139 YC AI startups (S23)
The evolution of the AI landscape, and YC's Copilot era.
a year ago
The evolution of the AI landscape, and YC's Copilot era.
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages…
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
The Berkeley...
Modeling Extremely Large Images with $x$T
As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon
How your greatest asset is silently stolen by technology every day
a year ago
How your greatest asset is silently stolen by technology every day
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
fast.ai
My family’s unlikely homeschooling journey
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
Daniel Miessler
UL NO. 354 | THE NEWS & ANALYSIS SERIES
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from...
over a year ago
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from attaining advanced semiconductors. And now it looks like the bans will be expanded to quantum computing and AI as well. NYTIMES | MY ANALYSIS BELOW It appears Bytedance had a plan to...
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Artificial Ignorance
AI Roundup 029: Hug all the faces
August 25, 2023
a year ago
Daniel Miessler
GPT and Search
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
2 months ago
Machine learning highlights and resources 9-23-24
Society's Backend
Clarifying DEI
What makes DEI important and where it fails
11 months ago
What makes DEI important and where it fails
Society's Backend
Godmother of AI Warns Against Regulation, Apple Intelligence System Prompts, Faster and Cheaper AI,...
Machine learning resources and updates 8/12/2024
4 months ago
Machine learning resources and updates 8/12/2024
Artificial Ignorance
Funding a new generation of AI companies
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
11 months ago
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
Daniel Miessler
NO. 358 | NEWS, ANALYSIS & DISCOVERY
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But...
over a year ago
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But that's a Friday, so I'm going to enable the discount link earlier. How early, and how much of a discount? You'll have to find out. If the link works before the date, then it's...
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
2 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
Society's Backend
Backend Biweekly #3: 97 Updates and Resources
Huge Nvidia Updates, Gemini Hackathon for Money, and more
8 months ago
Huge Nvidia Updates, Gemini Hackathon for Money, and more
One Useful Thing
Gradually, then Suddenly: Upon the Threshold
Small improvements can lead to big changes
5 months ago
Small improvements can lead to big changes
One Useful Thing
Everyone is above average
Is AI a Leveler, King Maker, or Escalator?
a year ago
Is AI a Leveler, King Maker, or Escalator?
Rozado’s Visual...
What is the IQ of ChatGPT?
Making an AI model take an IQ test
over a year ago
Making an AI model take an IQ test
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Rozado’s Visual...
El sesgo político de ChatGPT
A la izquierda del centro político
a year ago
A la izquierda del centro político
One Useful Thing
The Homework Apocalypse
Fall is going to be very different this year. Educators need to be ready.
a year ago
Fall is going to be very different this year. Educators need to be ready.
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
Strange Loop Canon
The mystery of the garage
10 months ago
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
Society's Backend
Anti-Social Media
How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots
large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
a month ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation?
The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
The bottleneck isn't the cost of producing disinfo, which is already very low.
Rozado’s Visual...
The Great Awokening as a Global Phenomenon
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
One Useful Thing
Detecting the Secret Cyborgs
The AI Trap for Organizations
a year ago
The AI Trap for Organizations
Marcus on AI
AI influencer hype gone wild
Reality is quite the opposite
a month ago
Reality is quite the opposite
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴
Siri versus the machine god?
6 months ago
Siri versus the machine god?
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Society's Backend
A Privacy Review: Google
I read Google's privacy policy for you
a year ago
I read Google's privacy policy for you
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
Society's Backend
The Problem with American Emergency Alerts
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
The Gradient
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
8 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Rozado’s Visual...
The Political Preferences of LLMs
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
10 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Society's Backend
One Year of Society's Backend
The lessons I've learned along the way
4 months ago
The lessons I've learned along the way
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
3 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Artificial Ignorance
Tutorial: How to make and share custom GPTs
They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
They're not going to disrupt everything (yet), but they're a ton of fun.
Stories by Andrej...
ICLR 2017 vs arxiv-sanity
over a year ago
Daniel Miessler
News & Analysis | NO. 351
over a year ago
Daniel Miessler
Podcast Audio Quality: AI-based Post-processing vs. Hardware
I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much....
over a year ago
I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much. Anyway. I’ve been obsessed with podcast audio quality for years, and have been through so…many…iterations of my setup. I started with a Yeti (still a great mic). Did the...
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning
You probably know more about machine learning math than you think
10 months ago
You probably know more about machine learning math than you think
One Useful Thing
Thinking companion, companion for thinking
Some simple ways to use AI to break you out of biases
a year ago
Some simple ways to use AI to break you out of biases
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
2 months ago
finding the new equilibrium for the next superpower
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
3 weeks ago
Fantastic writeup of my views today at The Wall Street Journal:
Artificial Ignorance
Tutorial: How to streamline your writing process with Whisper and GPT-4
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
7 months ago
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
Artificial Ignorance
AI Roundup 052: AI, EO, DPA
February 2, 2024.
10 months ago
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a week ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Sam Altman
Idea Generation
The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup.
But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
IROS 2024: 14–18 October 2024, ABU...
Weighty Thoughts
I'm writing a book!
Why I've been gone over a month, and how you can help
3 weeks ago
Why I've been gone over a month, and how you can help
Weighty Thoughts
Why did the Prior Generations of AI Fail?
Diving into the History—Which is Kind of a Circle
3 months ago
Diving into the History—Which is Kind of a Circle
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection
Authors: PromptArmor
4 months ago
Artificial Ignorance
AI Roundup 098: Flash Thinking
December 20, 2024.
2 days ago
Daniel Miessler
Why Apple Keeps Winning
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Strange Loop Canon
We all live on a knife's edge, and it's fine
Or: How we weaponised serendipity
8 months ago
Or: How we weaponised serendipity
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Society's Backend
MatMul-free Machine Learning Can Improve Efficiency, Excellent Foundational Learning Resources, SSMs...
The top 10 most important updates of last week: 7/8/24
5 months ago
The top 10 most important updates of last week: 7/8/24
One Useful Thing
Signs and Portents
Some hints about what the next year of AI looks like
11 months ago
Some hints about what the next year of AI looks like
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a week ago
Exactly as I warned in February
Rozado’s Visual...
The Increasing Prominence of Prejudice and Social Justice Rhetoric in UK News Media
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice...
over a year ago
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice and social justice rhetoric in UK news media. Recent years have seen considerable debate about the rise of political polarization in British society. Specifically, over the last...
One Useful Thing
In Praise of Boring AI
Automation has always been about killing tedious work. AI can do the same.
a year ago
Automation has always been about killing tedious work. AI can do the same.
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI
March 22, 2023.
9 months ago
Artificial Ignorance
The Chatbot Trap
Why AI products really need some better UX.
a month ago
Why AI products really need some better UX.
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
11 months ago
And why it might revolutionize the search industry.
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
12 months ago
Hey Siri, set a reminder for 365 days.
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat
November 22, 2024.
4 weeks ago
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice...
Society's Backend Reading List 11-18-2024
a month ago
Society's Backend Reading List 11-18-2024
Artificial Ignorance
Lies, damned lies, and benchmarks
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
10 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis
“Connectionist” vs. Knowledge-Based AI
2 months ago
“Connectionist” vs. Knowledge-Based AI
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
Society's Backend
LLM-as-a-Judge, Instruction Pretraining, Solving Benchmarks Instead of Real-World ML Problems, and...
Weekly updates and resources 7/22/24
5 months ago
Weekly updates and resources 7/22/24
Strange Loop Canon
Discovery is the original sin of the modern age
technology, living post scarcity, and how to find what you want
a year ago
technology, living post scarcity, and how to find what you want
Strange Loop Canon
Power, money and human nature
Thoughts on OpenAI, a tragedy
a year ago
Thoughts on OpenAI, a tragedy
Artificial Ignorance
Stop begging for JSON
How OpenAI's Structured Outputs makes building with AI much more reliable.
a week ago
How OpenAI's Structured Outputs makes building with AI much more reliable.
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
Matt Mazur
Don’t Self Host Unlicensed Proxima Nova Fonts
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time...
a year ago
I’m a big fan of the Proxima Nova font and have been using it on Preceden for years: For a long time I was loading Proxima Nova on Preceden via Typekit (a hosted web font service) for $49.99/year, but at some point I decided to self-host it to avoid the third party request which...
The Berkeley...
2024 BAIR Graduate Directory
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most...
9 months ago
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most talented and innovative minds in artificial intelligence and machine learning. Our Ph.D. graduates have each expanded the frontiers of AI research and are now ready to embark on new...
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
One Useful Thing
Working with AI: Two paths to prompting
Don't overcomplicate things
a year ago
Don't overcomplicate things
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Artificial Ignorance
AI Roundup 068: The ScarJo thing
May 24, 2024.
7 months ago
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter
Democratizing data analysis with AI
a year ago
Democratizing data analysis with AI
One Useful Thing
Automating creativity
There is now strong evidence that AI can help make us more innovative.
a year ago
There is now strong evidence that AI can help make us more innovative.
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report
And my notes on why they’re important
8 months ago
And my notes on why they’re important
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
3 weeks ago
Andrej Karpathy blog
Short Story on AI: A Cognitive Discontinuity.
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind...
over a year ago
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at a story, and what better way to kick things off than with a story on AI and what that might look like if you...
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
Weighty Thoughts
Commentary on Technology, Startups, and Investing
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater...
over a year ago
Welcome to Weighty Thoughts by me, James Wang. General Partner at Creative Ventures. Ex-Bridgewater and Google X. Co-Founder Lioness. Sign up now so you don’t miss the first issue. In the meantime, tell your friends!
Artificial Ignorance
AI Roundup 070: AI whistleblowers
June 7, 2024.
6 months ago
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
11 months ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More
Weekly updates and resources 7/29/24
4 months ago
Weekly updates and resources 7/29/24
Artificial Ignorance
The subscriptionization of AI
Navigating the paid AI landscape.
9 months ago
Navigating the paid AI landscape.
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
7 months ago
Inside Stability AI's roster of AI models.
Sam Altman
Keep the Internet Open
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon.
The internet is a public good, and I believe access should be a basic right. We've seen such great innovation in software because the internet has...
Sam Altman
Tech Workers' Values
For good and bad, technology has become a central force in all
our lives.
As members of the...
over a year ago
For good and bad, technology has become a central force in all
our lives.
As members of the community, we're interested in ways in which
tech companies can use their collective power to protect privacy, rule of law,
freedom of expression, and other fundamental American rights....
Sam Altman
Quora
I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other. So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora.
Quora is doing extremely well. They now...
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0…
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
Society's Backend
Why Gemini's Struggles Aren't Straightforward
And an overview of LLM security issues
9 months ago
And an overview of LLM security issues
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
One Useful Thing
Superhuman?
What does it mean for AI to be better than a human? And how can we tell?
7 months ago
What does it mean for AI to be better than a human? And how can we tell?
Matt Mazur
Indie Hacking Week 1 Recap: Starting TimelineGPT, Ending LearnGPT
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good...
a year ago
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good groove as far as my daily routine, but I don’t think it’s quite sunk in yet how much flexibility I have in terms of my daily schedule. For example, I’m still waking up early to […]
Daniel Miessler
NO. 369 | Reddit Hack, Deepfake Scams, Embracing Change…
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank...
a year ago
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank you! SECURITY Reddit has confirmed it was hacked, and it’s recommending users add 2FA. The attack started by phishing Reddit employees and stealing credentials and 2FA codes. After...
Daniel Miessler
Frontview Mirror: 2023 Edition
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice
Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
Matt Mazur
Screw it, I’m Keeping Emergent Mind
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
The Gradient
Do text embeddings perfectly encode text?
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
9 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Strange Loop Canon
Why AI hasn’t shown up in the GDP statistics yet
AI is meant to bring us closer to utopia, according to its builders.
4 months ago
AI is meant to bring us closer to utopia, according to its builders.
The Gradient
Salmon in the Loop
On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
Weighty Thoughts
When the AI Bubble Bursts
It’s when, not if, for these kinds of new technologies
5 months ago
It’s when, not if, for these kinds of new technologies
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
9 months ago
The future of entertainment is going to be a wild ride.
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
Society's Backend
Run Your Own Race
What Bluey can teach us about machine learning
8 months ago
What Bluey can teach us about machine learning
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
2 months ago
VC funding, here we come.
Made by Ollin
A Video History of Self-Driving Cars
over a year ago
Artificial Ignorance
Case Study: Scaling customer intelligence
Analyzing 10,000 sales calls with Claude
3 weeks ago
Analyzing 10,000 sales calls with Claude
Weighty Thoughts
The AI Executive Order
AKA: “We’ll do something about it later”
a year ago
AKA: “We’ll do something about it later”
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
a month ago
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for their job
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
4 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition
AI systems have gotten more capable and easier to use
6 months ago
AI systems have gotten more capable and easier to use
Sam Altman
Join the YC Software Team
If you want to get funded by YC as a founder in the future, but you don't have a startup that's...
over a year ago
If you want to get funded by YC as a founder in the future, but you don't have a startup that's ready for that yet, joining the YC software team is a great hack to get there.
The YC software team is a small group of hackers in SF that write the software that makes all the parts...
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
2 weeks ago
Society's Backend Reading List 12-2-2024
Marcus on AI
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a week ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
The Gradient
Interpretability Creationism
On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
IEEE Spectrum
Robot Photographer Takes the Perfect Picture
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
10 months ago
Five analytical tasks in under a minute
Daniel Miessler
Something is Up With Meritocracy
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Artificial Ignorance
How Shopify is making AI Magic
A case study on turning competitive advantages into useful AI.
a year ago
A case study on turning competitive advantages into useful AI.
One Useful Thing
Using AI to make teaching easier & more impactful
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
3 weeks ago
The bullshit just keeps on coming.
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION The US accused 13 Chinese nationals of committing espionage-related...
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Weighty Thoughts
Let’s Talk About AI Compute
What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
What really matters and why AI computing is exactly the same as all other large-scale computing
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
Sam Altman
The Virus
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19.
I hope that society views this as a warning for the future. Covid-19 is bad, but only a warm-up. I think it’s...
Weighty Thoughts
The Real Risks of AI
Humans are really the ones to be scared of
7 months ago
Humans are really the ones to be scared of
Marcus on AI
o3, AGI, the art of the demo, and what you can expect in 2025
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived....
19 hours ago
OpenAI’s new model was revealed yesterday; its most fervent believers think AGI has already arrived. Here’s what you should pay attention to in the coming year.
Daniel Miessler
Using Custom Searches in Safari (in 2022)
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
One Useful Thing
Confronting Impossible Futures
We shouldn't be certain about what is next, but we should plan for it
5 months ago
We shouldn't be certain about what is next, but we should plan for it
The Berkeley...
The Berkeley Crossword Solver
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving...
over a year ago
We recently published the Berkeley Crossword Solver (BCS), the current state of the art for solving American-style crossword puzzles. The BCS combines neural question answering and probabilistic inference to achieve near-perfect performance on most American-style crossword...
fast.ai
Practical Deep Learning for Coders 2022
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
a week ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
9 months ago
And effective ways to mitigate it
Marcus on AI
Two visions of AI’s future
It’s not looking good
2 weeks ago
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
over a year ago
I ported Stable Diffusion to my phone
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
Artificial Ignorance
AI Roundup 065: The gpt2-chatbot mystery
May 3, 2024.
7 months ago
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm...
Machine learning resources and updates 8/26/2024
3 months ago
Machine learning resources and updates 8/26/2024
fast.ai
Mojo may be the biggest programming language advance in decades
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment...
a year ago
Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment problems.
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
4 months ago
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition
A simple answer, and then a less simple one.
a year ago
A simple answer, and then a less simple one.
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
AI Snake Oil
Scientists should use AI as a tool, not an oracle
How AI hype leads to flawed research that fuels more hype
6 months ago
How AI hype leads to flawed research that fuels more hype
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
4 months ago
What people (still) fundamentally misunderstand about AI search.
Artificial Ignorance
AI Roundup 088: Movie magic
October 11, 2024.
2 months ago
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Made by Ollin
Emojin
An infinite kaomoji generator
over a year ago
An infinite kaomoji generator
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and...
Society's Backend Reading List 11-04-2024
a month ago
Society's Backend Reading List 11-04-2024
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
Society's Backend
A Fundamental Overview of Machine Learning Experimentation [Part 1]
And how it differs from the software development you're familiar with
2 weeks ago
And how it differs from the software development you're familiar with
fast.ai
Can LLMs learn from a single example?
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
4 months ago
A critical question for investors in AI
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
3 weeks ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
Artificial Ignorance
AI Roundup 078: Voice mode
August 2, 2024.
4 months ago
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat."
What we can learn from a completely AI written & illustrated lecture
a year ago
What we can learn from a completely AI written & illustrated lecture
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
9 months ago
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
Strange Loop Canon
Predicting AI
I revisit past predictions
3 months ago
I revisit past predictions
Society's Backend
Top 10 Machine Learning Resources and Updates 06/14/2024
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
6 months ago
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
10 months ago
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth so much
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
Made by Ollin
Singing Style Transfer
Initial Experiments
over a year ago
One Useful Thing
On the necessity of a sin
Why treating AI like a person is the future
8 months ago
Why treating AI like a person is the future
AI Snake Oil
Four more things we worked on in 2022
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
a year ago
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
fast.ai
AI Harms are Societal, Not Just Individual
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
Rozado’s Visual...
An Analysis of AI Political Preferences from a European Perspective
Introduction
a month ago
IEEE Spectrum
Video Friday: Multiple MagicBots
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
Artificial Ignorance
AI Roundup 086: Llama 3.2
September 27, 2024.
2 months ago
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
over a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
One Useful Thing
Now is the time for grimoires
It isn't data that will unlock AI, it is human expertise
a year ago
It isn't data that will unlock AI, it is human expertise
Sam Altman
2017 YC Annual Letter
Dear YC Community:
In response to a comment on Hacker News, I’m going to try writing an annual...
over a year ago
Dear YC Community:
In response to a comment on Hacker News, I’m going to try writing an annual letter to the YC community with an update on our progress.
Our mission is to enable the most innovation of any company in the world in order to make the future great for everyone. We...
Weighty Thoughts
AI's Future in Lung Disease and Medicine
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Society's Backend
Why Software Engineers Need to Understand Machine Learning
And how ML helps software engineers in their daily work
6 months ago
And how ML helps software engineers in their daily work
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
Artificial Ignorance
AI Roundup 097: Model Mayhem
December 13, 2024.
a week ago
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and...
Society's Backend Reading List 11-11-2024
a month ago
Society's Backend Reading List 11-11-2024
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
Artificial Ignorance
AI Roundup 080: Grok 2
August 16, 2024.
4 months ago
Marcus on AI
Generative AI’s Continuing Copyright Problems, an Essay in Memory of Suchir Balaji, 1998 - 2024
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate...
a week ago
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate named Suchir Balaji, who had just left OpenAI.
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves.
What spending $2,000 can tell us about evaluating AI agents
7 months ago
What spending $2,000 can tell us about evaluating AI agents
Society's Backend
A Privacy Review: TikTok
You should stick to Instagram Reels and YouTube Shorts
a year ago
You should stick to Instagram Reels and YouTube Shorts
One Useful Thing
Setting time on fire and the temptation of The Button
We used to consider writing an indication of time and effort spent on a task. That isn't true...
a year ago
We used to consider writing an indication of time and effort spent on a task. That isn't true anymore.
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
Rozado’s Visual...
The political preferences of Grok
Elon Musk's response to ChatGPT
a year ago
Elon Musk's response to ChatGPT
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
7 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
over a year ago
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns
Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
Science, sociology, and the likely financial collapse of the Generative AI bubble
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 