Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
Top Categories > AI
#all #programming #history #startups #technology #science #life #literature #architecture #travel #creative #design #comics #cartography #finance #AI #indiehacker Muted Categories [alt+←][alt+→]
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
over a year ago
2
over a year ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); Increased efficiency can sometimes, counterintuitively, lead to worse outcomes. This is true almost everywhere. We will name...
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now .post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; ...
over a year ago
36
over a year ago
.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
64
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
Weighty Thoughts
Why did the Prior Generations of AI Fail? Diving into the History—Which is Kind of a Circle
3 months ago
AI Snake Oil
I set up a ChatGPT voice interface for my 3-year old. Here’s how it went. Chatbots are likely to revive familiar debates about kids and apps
a year ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing January 26, 2024.
11 months ago
Strange Loop Canon
Soul nullius in verba
10 months ago
Artificial Ignorance
Lies, damned lies, and benchmarks While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
10 months ago
85
10 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
Society's Backend
OpenAI's o1, Model Merging, California Approves AI Regulation, and More Machine learning resources and updates 2024-09-17
3 months ago
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth? Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
3 months ago
46
3 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
Matt Mazur
Sharing small, incremental updates with users I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
32
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Daniel Miessler
NO. 358 | NEWS, ANALYSIS & DISCOVERY 🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But...
over a year ago
34
over a year ago
🦃 We're doing our second-ever discount on UL Membership starting the day after Thanksgiving. But that's a Friday, so I'm going to enable the discount link earlier. How early, and how much of a discount? You'll have to find out. If the link works before the date, then it's...
Society's Backend
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI... Machine learning resources and updates 2024-09-09
3 months ago
Artificial Ignorance
GPT-4o and the illusion of AGI Why speed and multimodality is becoming the name of the game.
7 months ago
AI Snake Oil
What is algorithmic amplification and why should we care? A symposium and a primer on social media recommendation algorithms
a year ago
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0… 🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
60
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
fast.ai
My family’s unlikely homeschooling journey Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Artificial Ignorance
AI Roundup 075: Levels of AGI July 12, 2024.
5 months ago
Rozado’s Visual...
El sesgo político de ChatGPT A la izquierda del centro político
a year ago
Artificial Ignorance
AI Roundup 037: The AI IPCC October 20, 2023.
a year ago
Artificial Ignorance
What President Biden's AI executive order actually means I read all 111 pages so you don't have to.
a year ago
One Useful Thing
The Homework Apocalypse Fall is going to be very different this year. Educators need to be ready.
a year ago
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
One Useful Thing
Scaling: The State of Play in AI A brief intergenerational pause...
3 months ago
One Useful Thing
Something New: On OpenAI's "Strawberry" and Reasoning Solving hard problems in new ways
3 months ago
Andrej Karpathy blog
(started posting on Medium instead) The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
over a year ago
30
over a year ago
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but whenever I do get a chance to post something I have recently been defaulting to doing it on Medium because...
Artificial Ignorance
Stop begging for JSON How OpenAI's Structured Outputs makes building with AI much more reliable.
a week ago
Weighty Thoughts
Let’s Talk About AI Compute What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
Artificial Ignorance
How to fine-tune ChatGPT No GPU cluster required.
a year ago
Weighty Thoughts
One Definite Sign of a Bad Startup Idea If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
13
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Sam Altman
The United Slate I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
7
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state.  A team of aligned people has a chance to make a real change. I believe in creating prosperity...
Daniel Miessler
The 2 Current Major AI Bottlenecks I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
38
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Artificial Ignorance
AI Roundup 077: A good week for open-source July 26, 2024.
4 months ago
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,... Machine learning highlights and resources 9-23-24
2 months ago
fast.ai
Practical Deep Learning for Coders 2022 A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
7
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
AI Snake Oil
Introducing the REFORMS checklist for ML-based science ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
Artificial Ignorance
AI Roundup 074: Amazon's Adept acquisition July 5, 2024.
5 months ago
Jascha’s blog
Neural network training makes beautiful fractals window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
10 months ago
1
10 months ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); .md h2 { font-size: 20px; } .vimeo-player { position: relative; width: 444px; height: 444px; ...
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
a year ago
45
a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW) (Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we...
a year ago
12
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
AI Snake Oil
The bait and switch behind AI risk prediction tools Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
13
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
47
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI What makes machine learning infra so important and why I find it so interesting
a year ago
Society's Backend
You Are What You Eat: Digital Edition Why who you follow is more important than who follows you
a year ago
AI Snake Oil
Will AI transform law? The hype is not supported by current evidence
11 months ago
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning function reveal() { const replay = document.querySelector('.ddpo-replay'); ...
a year ago
56
a year ago
function reveal() { const replay = document.querySelector('.ddpo-replay'); replay.style.display = 'flex'; } window.onload = () => { const replay = document.querySelector('.ddpo-replay'); replay.addEventListener('click', () => { ...
Strange Loop Canon
Evaluations are all we need On analysing talent in LLMs
11 months ago
IEEE Spectrum
Video Friday: Mars Chopper Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a week ago
4
a week ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICRA 2025: 19–23 May 2025, ATLANTA,...
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
over a year ago
38
over a year ago
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another. Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...
Society's Backend
OpenAI's Strawberry May Enhance AI Reasoning, Optimization of Vision Language Models, Info on... Weekly updates and resources 7/15/24
5 months ago
fast.ai
From Deep Learning Foundations to Stable Diffusion We’ve released our new course with over 30 hours of video content.
a year ago
Weighty Thoughts
Is AI a Winner-Take-All Market? A critical question for investors in AI
4 months ago
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric...
a year ago
62
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
Society's Backend
Should You Get a PhD? The one good reason to do a PhD and two others that fall flat
2 months ago
Daniel Miessler
What Made the 90’s So Awesome? I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
58
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Matt Mazur
Running Mistral 7B Instruct on a Macbook Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to...
a year ago
59
a year ago
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct...
The Berkeley...
Interactive Fleet Learning Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
53
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time. In the last few years we have seen an exciting development in robotics and artificial...
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
41
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION  The US accused 13 Chinese nationals of committing espionage-related...
Society's Backend
Top 10 Machine Learning Resources and Updates 06/14/2024 A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
6 months ago
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a week ago
4
a week ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
fast.ai
Masks for COVID: Updating the evidence Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
9
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
One Useful Thing
My class required AI. Here's what I've learned so far. (Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
43
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
AI Snake Oil
Does the UK’s liver transplant matching algorithm systematically exclude younger patients? Seemingly minor technical decisions can have life-or-death effects
a month ago
Artificial Ignorance
AI Roundup 029: Hug all the faces August 25, 2023
a year ago
One Useful Thing
A quick and sobering guide to cloning yourself It took me a few minutes to create a fake me giving a fake lecture.
a year ago
Sam Altman
Funding for COVID-19 Projects I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
12
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help.  I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on: Producing a lot of ventilators or...
Made by Ollin
NVIDIA Internship (2017) Notes on my internship at NVIDIA Redmond.
over a year ago
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
42
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Artificial Ignorance
AI Roundup 081: Creative differences August 23, 2024.
4 months ago
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
6 days ago
6
6 days ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Artificial Ignorance
AI Roundup 031: Think of the children September 8, 2023
a year ago
Society's Backend
AI Reading List 3: Meta's Self-Taught Evaluator, AI for Cancer Diagnosis, and a Technical... Society's Backend Reading List 10-21-2024
2 months ago
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a week ago
4
a week ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
74
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Daniel Miessler
Companies as Alaskan Fishing Boats What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest...
over a year ago
42
over a year ago
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest Catch. So you have this tiny crew of total badasses. Everyone is a superhero at their particular role because the crew needs to stay extremely small to protect profits. The...
Artificial Ignorance
AI's invisible instructions What meme prompts can teach us about better interface design.
a month ago
One Useful Thing
Feats to astonish and amaze A compendium of things I didn't think AI should be able to do
a year ago
Society's Backend
An AI Revolution Isn't Coming - We're Already In It A small showcase of companies using AI in ways that will change your life
a year ago
One Useful Thing
Latent Expertise: Everyone is in R&D Ideas come from the edges, not the center
6 months ago
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
9 months ago
Society's Backend
How to Use Benchmarks to Build Successful Machine Learning Systems And what benchmarks mean for real-world applications
4 months ago
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
a month ago
2
a month ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task. This video is notable because it’s the first real look we’ve had at the new Atlas doing...
Society's Backend
Clarifying DEI What makes DEI important and where it fails
11 months ago
Society's Backend
If You Understand Bananas, You Can Understand Machine Learning A simplified high-level overview of primary machine learning algorithms for anyone to understand
11 months ago
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing … glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on...
a year ago
18
a year ago
… glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr: The emerging LLM stack is composed of several elements centered...
Society's Backend
JAX is for More Than Just Machine Learning What JAX is and its potential applications
6 months ago
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
44
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Strange Loop Canon
The agent principal problem "Show me the incentive and I will show you the outcome."
a year ago
The Berkeley...
The Shift from Models to Compound AI Systems AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
10 months ago
84
10 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news... I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
38
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Artificial Ignorance
Distributing the future A reminder that things take time.
6 months ago
Rozado’s Visual...
DepolarizingGPT A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
Stories by Andrej...
Virtual Reality: still not quite there, again.
over a year ago
One Useful Thing
Signs and Portents Some hints about what the next year of AI looks like
11 months ago
Matt Mazur
Emergent Mind finally went viral Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
62
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Matt Mazur
“Monthly Billed Annually” is Cursed Copy There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS...
a year ago
77
a year ago
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS for not refunding an accidental annual payment he made on their service. He intended to purchase the monthly plan, but due to an unclear UI and poor copy, he unintentionally...
The Berkeley...
Modeling Extremely Large Images with $x$T As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
93
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Weighty Thoughts
News Roundup: May 27, 2014 🧴 Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
6 months ago
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
103
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Matt Mazur
Full Time Indie Hacking: Month 5 Update At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
93
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
IEEE Spectrum
Video Friday: Happy Holidays! Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 days ago
5
2 days ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICRA 2025: 19–23 May 2025, ATLANTA,...
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection Authors: PromptArmor
4 months ago
fast.ai
In defense of screen time Pundits say my husband and I are parenting wrong.
a month ago
IEEE Spectrum
Zen and the Art of Aibo Engineering Sony’s team made that happen. And since Aibo’s debut, the company has sold more than 170,000 of...
a week ago
5
a week ago
Sony’s team made that happen. And since Aibo’s debut, the company has sold more than 170,000 of the cute little quadrupeds—a huge number considering their price of several thousand dollars each. From the start, Aibo could express a range of simulated emotions and learn through...
Society's Backend
Backend Biweekly #2: 112 Total Updates and Resources Details on Metas training clusters, analysis of ML competitions in 2023, AI's impact on water...
9 months ago
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis “Connectionist” vs. Knowledge-Based AI
2 months ago
Artificial Ignorance
AI Roundup 073: Music make you lose control June 28, 2024.
5 months ago
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation? The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More Discussions from the past week: 09/16/2024
3 months ago
Artificial Ignorance
Tutorial: How to make and share custom GPTs They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
Society's Backend
Anti-Social Media How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
34
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
The Berkeley...
Virtual Personas for Language Models via an Anthology of Backstories Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual...
a month ago
26
a month ago
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual personas by generating and utilizing naturalistic backstories with rich details of individual values and experience. --> We introduce Anthology, a method for conditioning LLMs to...
fast.ai
A New Chapter for fast.ai: How To Solve It With Code fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
24
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
One Useful Thing
Four Singularities for Research The rise of AI is creating both crisis and opportunity
6 months ago
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection Authors: PromptArmor and Kai Greshake
a year ago
Artificial Ignorance
The SearchGPT Paradigm What people (still) fundamentally misunderstand about AI search.
4 months ago
Artificial Ignorance
AI and the workplace How employees and CEOs alike can plan for the future.
7 months ago
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
43
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Artificial Ignorance
GPTs won't make you rich But they'll make you more productive.
11 months ago
Artificial Ignorance
What AI models really think about politics Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
a month ago
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good. Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Artificial Ignorance
How Shopify is making AI Magic A case study on turning competitive advantages into useful AI.
a year ago
Stories by Andrej...
CS183c Assignment #3
over a year ago
Artificial Ignorance
The AI email startup that's taking on Gmail A conversation with Andrew Lee, CEO of Shortwave and cofounder of Firebase.
a year ago
IEEE Spectrum
Robot Photographer Takes the Perfect Picture Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
3
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
Strange Loop Canon
Whither Utopia? The mystery of why we don't dream of building perfect societies anymore
6 months ago
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research? Mentions of climate change in news media vastly outnumber other existential threats
a year ago
Artificial Ignorance
How to build an AI search engine (Part 1) Working with Claude, Brave, and streaming responses.
2 months ago
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free Announcing the ML Road Map-Turbo
6 months ago
AI Snake Oil
Are open foundation models actually more risky than closed ones? A policy brief on open foundation models
a year ago
Daniel Miessler
Would You Put AI Art In Your House? I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
72
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Strange Loop Canon
The mystery of the garage
10 months ago
Artificial Ignorance
AI Roundup 076: Grand theft audio July 19, 2024.
5 months ago
One Useful Thing
The future, soon: what I learned from Bing's AI We had a brief glimpse of two different types of AI. Both are significant
a year ago
fast.ai
Can LLMs learn from a single example? We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
25
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested. On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
55
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received And how it changed my personal life too
12 months ago
Weighty Thoughts
The Real Risks of AI Humans are really the ones to be scared of
7 months ago
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
34
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
46
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
The Berkeley...
Goal Representations for Instruction Following Goal Representations for Instruction Following Figure title. Figure caption. This image is...
a year ago
86
a year ago
Goal Representations for Instruction Following Figure title. Figure caption. This image is centered and set to 50% page width. --> A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Artificial Ignorance
OpenAI’s DevDay: The biggest announcements New models, new products, and new pricing.
a year ago
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and... Machine learning resources and updates 8/19/2024
4 months ago
IEEE Spectrum
Video Friday: Multiple MagicBots Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
3
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids Summit: 11–12 December...
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
Rozado’s Visual...
Pessimism in News Media Headlines In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
64
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave November 8, 2024.
a month ago
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition A simple answer, and then a less simple one.
a year ago
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
59
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves. What spending $2,000 can tell us about evaluating AI agents
7 months ago
Sam Altman
Project Covalence Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
over a year ago
13
over a year ago
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.  Science remains the...
Artificial Ignorance
Saving the world with AI and government grants Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
5 months ago
Artificial Ignorance
I gave ChatGPT access to my Gmail I'm sure this will end well.
a year ago
One Useful Thing
The Lazy Tyranny of the Wait Calculation Taking AI timelines seriously
11 months ago
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
32
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Artificial Ignorance
Dealing with AI fatigue Notes for myself, and maybe you too.
10 months ago
Society's Backend
All Machine Learning Resources and Updates 06/21/2024 Below are the machine learning resources and updates from the past few days you don't want to miss....
6 months ago
34
6 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022) This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT December 1, 2023.
a year ago
Sam Altman
Helion I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
over a year ago
10
over a year ago
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen. David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem December 22, 2023.
a year ago
Marcus on AI
Two visions of AI’s future It’s not looking good
2 weeks ago
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
51
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
63
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
Weighty Thoughts
Software Engineering is Doomed Or is it?
5 months ago
Artificial Ignorance
The State of AI Engineering (2024) Notes from the AI Engineer World's Fair.
5 months ago
One Useful Thing
In Praise of Boring AI Automation has always been about killing tedious work. AI can do the same.
a year ago
One Useful Thing
What just happened, what is happening next The tasks AI can do well are expanding rapidly
8 months ago
Society's Backend
No One Should Be GPU Poor For everyone to have access to AGI, everyone must also have access to the compute to use it
7 months ago
Sam Altman
How To Be Successful I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
13
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter. Here are 13 thoughts about how to achieve such outlier...
One Useful Thing
Thinking companion, companion for thinking Some simple ways to use AI to break you out of biases
a year ago
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning You probably know more about machine learning math than you think
10 months ago
Artificial Ignorance
AI Roundup 096: Happy Shipmas December 6, 2024.
2 weeks ago
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for... Society's Backend Reading List 10-28-2024
a month ago
Made by Ollin
Acapella Extraction with ConvNets A working prototype
over a year ago
Andrej Karpathy blog
A Survival Guide to a PhD This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
35
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
Weighty Thoughts
Most AI startups are doomed Just because it matters doesn’t mean it’s defensible or profitable
a year ago
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
18
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
Daniel Miessler
GPT and Search There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
35
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice... Society's Backend Reading List 11-18-2024
a month ago
Society's Backend
The Metrics Machine Learning Engineers Care About That Modelers Don't And a brief overview of TPUs in Google data centers
9 months ago
fast.ai
The Jupyter+git problem is now solved Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
12
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Weighty Thoughts
Fear and Loathing in 7nm How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
The Berkeley...
How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could...
3 months ago
48
3 months ago
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak frontier LLMs simply by translating forbidden prompts into obscure languages. Excited by this result, we attempted to reproduce it and found something unexpected. The...
Rozado’s Visual...
The political preferences of Grok Elon Musk's response to ChatGPT
a year ago
Weighty Thoughts
Consider the Llama Are closed source AI models doomed?
4 months ago
Artificial Ignorance
AI Roundup 095: QwQ November 29, 2024.
3 weeks ago
Strange Loop Canon
When we become cogs on motivation and technology
a month ago
Artificial Ignorance
Small newsletters, big ideas A subscriber showcase full of hidden gems on Substack.
6 days ago
Weighty Thoughts
Who’s Winning the AI War? All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
Made by Ollin
Mac Replacement Icons A standardized, simplified, and beautiful icon set
over a year ago
Artificial Ignorance
AI Roundup 071: How do you like them AIs June 14, 2024.
6 months ago
One Useful Thing
What OpenAI did A new model opens up new possibilities
7 months ago
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
46
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Society's Backend
What Apple Intelligence Means for You "We think you're gonna LOVE it"
6 months ago
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
Strange Loop Canon
Seeing Like A Network Dark Forests, Dense Networks
6 months ago
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
3
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Artificial Ignorance
Bridging AI and human creativity A conversation with Harrison Telyan, co-founder of NUMI.
9 months ago
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm... Machine learning resources and updates 8/26/2024
3 months ago
Strange Loop Canon
The age of access the great polarisation theory, and the death of professions
a year ago
Daniel Miessler
Your Experience is Your Creativity Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
51
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
56
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
2 months ago
2
2 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
a month ago
29
a month ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
39
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Marcus on AI
Humanity’s “Oh shit!” AI moment? Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a week ago
3
a week ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
Marcus on AI
AI influencer hype gone wild Reality is quite the opposite
a month ago
Artificial Ignorance
AI Roundup 040: GPTs November 10, 2023.
a year ago
Artificial Ignorance
AI Roundup 085: You win some, you Newsom September 20, 2024.
3 months ago
AI Snake Oil
AI safety is not a model property Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
9 months ago
89
9 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
Artificial Ignorance
AI Roundup 065: The gpt2-chatbot mystery May 3, 2024.
7 months ago
The Gradient
Mamba Explained Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
8 months ago
52
8 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
The Gradient
Why Doesn’t My Model Work? Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
49
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Artificial Ignorance
AI Roundup 072: The new new Claude June 21, 2024.
6 months ago
Daniel Miessler
Twitter’s Blue Checkmark Strategy Reduces Trust in Pursuit of Revenue When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month,...
over a year ago
56
over a year ago
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month, I was happy. As a legacy holder of the checkmark there’s a slight band-aid-sting of the check indicating specialness—who doesn’t want to feel special?—but I’d much rather see a...
Artificial Ignorance
How to reverse engineer the Substack (or any!) web API Building an unauthorized Substack client with Claude.
4 months ago
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
a month ago
2
a month ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
One Useful Thing
The Best Available Human Standard What are the imperatives of the upside?
a year ago
fast.ai
AI Safety and the Age of Dislightenment Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
21
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba… SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
45
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
The Gradient
Salmon in the Loop On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
48
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
Society's Backend
LLM-as-a-Judge, Instruction Pretraining, Solving Benchmarks Instead of Real-World ML Problems, and... Weekly updates and resources 7/22/24
5 months ago
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
3 months ago
52
3 months ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Artificial Ignorance
AI Roundup 052: AI, EO, DPA February 2, 2024.
10 months ago
Marcus on AI
Which CEO will be the last to see it? What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
2 weeks ago
3
2 weeks ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
Weighty Thoughts
China's AI Journey Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Sam Altman
Reinforcement Learning Progress Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general...
over a year ago
14
over a year ago
Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros. This is the game that to me feels closest to the real world and complex...
Daniel Miessler
Using Custom Searches in Safari (in 2022) I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
29
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
One Useful Thing
The Present Future: AI's Impact Long Before Superintelligence You can start to see the outlines of an AI future, for better and worse
a month ago
One Useful Thing
AI is not good software. It is pretty good people. A pragmatic approach to thinking about AI
a year ago
Stories by Andrej...
Yes you should understand backprop
over a year ago
One Useful Thing
The future of education in a world of AI A positive vision for the transformation to come
a year ago
Artificial Ignorance
AI Roundup 078: Voice mode August 2, 2024.
4 months ago
Marcus on AI
An epidemic of weirdly precise AI butt facts The parade of made-up numbers never stops
a month ago
Society's Backend
The Method Google Used to Reduce LLM Size by 66% A brief overview of knowledge distillation and its capabilities
5 months ago
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
10 months ago
Artificial Ignorance
10 of the most impactful AI stories of 2023 A quick look back on a very busy year in AI.
a year ago
Artificial Ignorance
From Stable Diffusion to Stable Everything Inside Stability AI's roster of AI models.
7 months ago
Artificial Ignorance
YC is now 80% AI startups (S24) Analyzing the latest companies out of "AI Combinator"
2 months ago
One Useful Thing
On the necessity of a sin Why treating AI like a person is the future
8 months ago
Daniel Miessler
Frontview Mirror: 2023 Edition This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
53
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
Run Your Own Race What Bluey can teach us about machine learning
8 months ago
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Sam Altman
Productivity I think I am at least somewhat more productive than average, and people sometimes ask me...
over a year ago
10
over a year ago
I think I am at least somewhat more productive than average, and people sometimes ask me for productivity tips.  So I decided to just write them all down in one place. Compound growth gets discussed as a financial concept, but it works in careers as well, and it is magic.  A...
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
17
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
One Useful Thing
On speaking to AI Voice changes a lot of things
4 months ago
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
a week ago
17
a week ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
Andrej Karpathy blog
Biohacking Lite Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew...
over a year ago
28
over a year ago
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that (“mom said”-) level of abstraction. I also knew that I can probably get away with...
One Useful Thing
The Machines of Mastery "Anyone can learn anything they want..." and how technology can help
a year ago
One Useful Thing
Now is the time for grimoires It isn't data that will unlock AI, it is human expertise
a year ago
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
40
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
fast.ai
I was an AI researcher. Now, I am an immunology student. Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
14
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Society's Backend
Why Gemini's Struggles Aren't Straightforward And an overview of LLM security issues
9 months ago
Weighty Thoughts
Deep Tech Startups Are Not Software Startups Or why AI and “Software/SaaS” are apples and oranges
10 months ago
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
81
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Artificial Ignorance
AI Roundup 039: The governance issue November 3, 2023.
a year ago
Artificial Ignorance
AI Roundup 045: Google's just getting started December 15, 2023.
a year ago
Artificial Ignorance
How to leverage long form content with AI Specific tools and tactics for authors, podcasters, and videographers.
6 months ago
The Gradient
A Brief Overview of Gender Bias in AI A brief overview and discussion on gender bias in AI
8 months ago
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia And how our media is failing, wildly, in one of the most important stories in US history
a month ago
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
2 months ago
4
2 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy How speculation gets laundered through pseudo-quantification
4 months ago
Artificial Ignorance
AI Roundup 038: Preparedness October 27, 2023.
a year ago
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
4 months ago
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering And isn't that we're all going to lose our jobs
9 months ago
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs Also, we have a prompt library!
9 months ago
One Useful Thing
Almost an Agent: What GPTs can do Also, my book has a cover (also I have a book coming out)
a year ago
Sam Altman
American Equity I’d like feedback on the following idea. I think that every adult US citizen should get an annual...
over a year ago
11
over a year ago
I’d like feedback on the following idea. I think that every adult US citizen should get an annual share of the US GDP. I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and... Society's Backend Reading List 11-11-2024
a month ago
Strange Loop Canon
AI bill vetoed; what's next? Make AI regulations evidence based
2 months ago
The Gradient
Why transformative artificial intelligence is really, really hard to achieve A collection of the best technical, social, and economic arguments Humans have a good track record...
a year ago
18
a year ago
A collection of the best technical, social, and economic arguments Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
Sam Altman
Please Fund More Science Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
9
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.  Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
Artificial Ignorance
AI Roundup 087: DevDay SF October 4, 2024.
2 months ago
One Useful Thing
On-boarding your AI Intern There's a somewhat weird alien who wants to work for free for you. You should probably get started.
a year ago
109
a year ago
There's a somewhat weird alien who wants to work for free for you. You should probably get started.
Society's Backend
Know Your Benchmarks How the Chatbot Arena leaderboard for LLMs works and why it’s important to understand
8 months ago
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with... TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
71
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image. Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Society's Backend
One Year of Society's Backend The lessons I've learned along the way
4 months ago
Sam Altman
The Strength of Being Misunderstood A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
over a year ago
9
over a year ago
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question. Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
Society's Backend
What Makes Machine Learning so Hard for Software Engineers How decades of learning a mindset makes adapting difficult
4 months ago
Made by Ollin
HintBot Hinting icons automatically with a neural network
over a year ago
AI Snake Oil
Is AI-generated disinformation a threat to democracy? An essay on the future of generative AI on social media
a year ago
Strange Loop Canon
No, LLMs are not "scheming"
3 days ago
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
49
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Artificial Ignorance
AI Roundup 060: Another CEO gone March 29, 2024.
8 months ago
Strange Loop Canon
State of the Canon Onwards
11 months ago
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
72
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
One Useful Thing
The shape of the shadow of The Thing We can start to see, dimly, what the near future of AI looks like.
a year ago
Sam Altman
A Clarification I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to...
over a year ago
12
over a year ago
I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to clarify it. I didn’t mean that we need to tolerate brilliant homophobic jerks in the lab so that we can have scientific progress.  Although there are famous...
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough. Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture The actual takeaways from the iPhone 15 event
a year ago
Weighty Thoughts
Open AI's Valuation and a Favor to Ask A guest post and an in-person panel
4 months ago
Artificial Ignorance
AI Roundup 062: Data is the new oil April 12, 2024.
8 months ago
Weighty Thoughts
AI's Future in Lung Disease and Medicine A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
a week ago
18
a week ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Artificial Ignorance
AI Roundup 090: Computer Use October 25, 2024.
a month ago
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty. “Life can only be understood backwards, but it must be lived forwards.”
9 months ago