Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
Top Categories > AI
#all #programming #technology #startups #history #life #science #literature #architecture #creative #design #finance #travel #comics #AI #indiehacker #cartography Muted Categories [alt+←][alt+→]
seangoedecke.com RSS...
To avoid being replaced by LLMs, do what they can't It’s a strange time to be a software engineer. Large language models are very good at writing code...
4 months ago
39
4 months ago
It’s a strange time to be a software engineer. Large language models are very good at writing code and rapidly getting better. Multiple…
Strange Loop Canon
The mystery of the garage
a year ago
Artificial Ignorance
AI Roundup 048: The Robot Constitution January 5, 2024.
a year ago
Machine Learning for...
Weekly ML for SWEs #12: The easiest way to keep up with ML and AI research papers An AI reading list curated to make you a better engineer: 6-17-25
a week ago
Artificial Ignorance
AI Roundup 085: You win some, you Newsom September 20, 2024.
9 months ago
Rozado’s Visual...
The Political Preferences of LLMs Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
a year ago
122
a year ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Marcus on AI
Did Elon Musk just Mu$k Sam Altman? With some bonus eye candy to lighten the mood
4 months ago
Society's Backend:...
OpenAI’s Blunder is a Loss for the ML Community The timeline and why OpenAI’s actions are a big deal
a year ago
seangoedecke.com RSS...
Glue work considered harmful “Glue work” is an concept Tanya Reilly came up with in 2019. The idea is that there’s a large amount...
6 months ago
34
6 months ago
“Glue work” is an concept Tanya Reilly came up with in 2019. The idea is that there’s a large amount of unglamorous work that every team…
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis “Connectionist” vs. Knowledge-Based AI
9 months ago
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones The hand wringing about failures of model alignment is misguided
a year ago
Marcus on AI
AlphaGeometry2: Impressive accomplishment, but still a long path ahead What GoogleDeepMind’s latest does and doesn’t show, and what we like about it
4 months ago
seangoedecke.com RSS...
Why is lmarena.ai dominated by slop? When LMSYS (aka LMArena, aka Chatbot Arena) first blew up, I thought it was the best way possible of...
2 months ago
25
2 months ago
When LMSYS (aka LMArena, aka Chatbot Arena) first blew up, I thought it was the best way possible of determining which LLM really was the…
Sam Altman
GPT-4o There are two things from our announcement today I wanted to highlight. First, a key part of our...
a year ago
166
a year ago
There are two things from our announcement today I wanted to highlight. First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
One Useful Thing
Using AI to make teaching easier & more impactful Here are five strategies and prompts that work for GPT-3.5 & GPT-4
over a year ago
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray... Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
69
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Weighty Thoughts
What I got Right or Wrong in 2020 Reflecting on the Past Year
over a year ago
Win Vector LLC
Is GitHub Lying Here? My partners and I keep getting this spam-like email. I figured it was just a forgery. However, I...
3 months ago
30
3 months ago
My partners and I keep getting this spam-like email. I figured it was just a forgery. However, I went on my own to our organization’s GitHub administration page and a similar message lives there. We run a small group, so I am pretty sure nobody has in fact asked for […]
The Gradient
Do text embeddings perfectly encode text? 'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
a year ago
78
a year ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Machine Learning for...
ML for SWEs 3: AI Can't Be Copyrighted, Don't Fall for Misinformation, and Stay Safe Online Machine learning for software engineers 3-21-25
3 months ago
Artificial Ignorance
AI Roundup 066: AlphaFold 3 May 10, 2024.
a year ago
fast.ai
Can LLMs learn from a single example? We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
54
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Don't Worry About...
The Risk of Gradual Disempowerment from AI The baseline scenario as AI becomes AGI becomes ASI (artificial superintelligence), if nothing more...
4 months ago
34
4 months ago
The baseline scenario as AI becomes AGI becomes ASI (artificial superintelligence), if nothing more dramatic goes wrong first and even we successfully ‘solve alignment’ of AI to a given user and developer, is the ‘gradual’ disempowerment of humanity by AIs, as we voluntarily...
Marcus on AI
Breaking: OpenAI's efforts at pure scaling have hit a wall — There is no wall
4 months ago
Marcus on AI
Deep Research, Deep Bullshit, and the potential (model) collapse of science Sam Altman’s hype might just bite us all in the behind
4 months ago
Don't Worry About...
On OpenAI's Model Spec 2.0 OpenAI made major revisions to their Model Spec.
4 months ago
Piotr Migdał's Blog
Cloak & dagger creativity camp “You cannot create an experience, you can create [conditions] for an experience.” — Seth
over a year ago
Sam Altman
DALL•E 2 Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
38
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.  Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
139
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Marcus on AI
Five ways in which the last 3 months — and especially the DeepSeek era — have vindicated “Deep... A demonized paper from three years ago that has stood the test of time
4 months ago
Society's Backend:...
OpenAI's o1, Model Merging, California Approves AI Regulation, and More Machine learning resources and updates 2024-09-17
9 months ago
Artificial Ignorance
Lessons from 139 YC AI startups (S23) The evolution of the AI landscape, and YC's Copilot era.
a year ago
fast.ai
AI Harms are Societal, Not Just Individual In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
30
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
exist
A Tale of Two Technologies: Why Large Language Models are the Future and the Metaverse Isn't In the digital landscape of recent years, two major technologies have vied for the spotlight: the...
over a year ago
12
over a year ago
In the digital landscape of recent years, two major technologies have vied for the spotlight: the Metaverse and Large Language Models (LLMs). Though the Metaverse, a virtual reality-based universe, initially garnered significant attention and expectations, it ultimately failed to...
Don't Worry About...
OpenAI #13: Altman at TED and OpenAI Cutting Corners on Safety Testing Three big OpenAI news items this week were the FT article describing the cutting of corners on...
2 months ago
23
2 months ago
Three big OpenAI news items this week were the FT article describing the cutting of corners on safety testing, the OpenAI former employee amicus brief, and Altman’s very good TED Interview.
AI Snake Oil
Can AI automate computational reproducibility? A new benchmark to measure the impact of AI on improving science
9 months ago
Society's Backend:...
One Year of Society's Backend The lessons I've learned along the way
10 months ago
Artificial Ignorance
AI Roundup 026: AudioCraft August 4, 2023
a year ago
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
7 months ago
27
7 months ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
Weighty Thoughts
Why we need AI as a society We’re aging too fast (AKA my entire AI/robotics investment thesis)
a year ago
One Useful Thing
No elephants: Breakthroughs in image generation When Language Models Learn to See and Create
3 months ago
exist
When Imperfect Systems are Good, Actually: Bluesky's Lossy Timelines Often when designing systems, we aim for perfection in things like consistency of data,...
4 months ago
34
4 months ago
Often when designing systems, we aim for perfection in things like consistency of data, availability, latency, and more. The hardest part of system design is that it’s difficult (if not impossible) to design systems that have perfect consistency, perfect availability, incredibly...
Society's Backend:...
Why You Should Never Let AI Debug for You And 3 ways you should be using AI to code
3 months ago
Sam Altman
Researchers and Founders I spent many years working with founders and now I work with researchers. Although there are always...
over a year ago
35
over a year ago
I spent many years working with founders and now I work with researchers. Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
seangoedecke.com RSS...
Working fast and slow Some engineers work very consistently, putting in the same hours every day and getting out the same...
5 months ago
53
5 months ago
Some engineers work very consistently, putting in the same hours every day and getting out the same amount of work. I don’t. Some days I…
Artificial Ignorance
AI Roundup 072: The new new Claude June 21, 2024.
a year ago
The Gradient
An Introduction to the Problems of AI Consciousness Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
59
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with... TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
over a year ago
108
over a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image. Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Marcus on AI
Where will AI be at the end of 2027? A bet We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI...
6 months ago
76
6 months ago
We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI policy researcher who recently left OpenAI and is bullish on AI progress, have agreed to the following bet, at 10:1 odds, with criteria drawn from two earlier Substack essays by Gary...
Weighty Thoughts
AI's Future in Lung Disease and Medicine A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical...
6 months ago
71
6 months ago
A conversation with two radiologists—who are also experts in AI—about how AI can shape clinical practice and patient experiences
Weighty Thoughts
Consider the Llama Are closed source AI models doomed?
11 months ago
Rozado’s Visual...
El sesgo político de ChatGPT A la izquierda del centro político
over a year ago
Don't Worry About...
Operator No one is talking about OpenAI’s Operator.
5 months ago
Society's Backend:...
Meta's New Segmentation Model, A New Open-Source Image Generation Model, Apple Intelligence Model... Machine learning resources and updates 8/5/2024
10 months ago
Artificial Ignorance
Dealing with AI fatigue Notes for myself, and maybe you too.
a year ago
Daniel Miessler
Custom Models Are AI’s Killer App The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
over a year ago
83
over a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
One Useful Thing
AI in organizations: Some tactics Meet the Lab and the Crowd
8 months ago
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
over a year ago
63
over a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
Don't Worry About...
Worries About AI Are Usually Complements Not Substitutes A common claim is that concern about [X] ‘distracts’ from concern about [Y].
2 months ago
One Useful Thing
Feats to astonish and amaze A compendium of things I didn't think AI should be able to do
over a year ago
Artificial Ignorance
AI Roundup 070: AI whistleblowers June 7, 2024.
a year ago
seangoedecke.com RSS...
The valley of engineering despair I have delivered a lot of successful engineering projects. When I start on a project, I’m now very...
2 months ago
16
2 months ago
I have delivered a lot of successful engineering projects. When I start on a project, I’m now very (perhaps unreasonably) confident that I will ship it successfully. Even so, in every single one of these projects there is a period - perhaps a day, or even a week - where it feels...
Piotr Migdał's Blog
AI won’t make artists redundant - thanks to information theory How many bits are there in a prompt? How many bits are needed to create an image? In short: a lot!
over a year ago
One Useful Thing
Acceleration. 7 days of new AI technologies shows us that everything is happening very fast.
over a year ago
seangoedecke.com RSS...
Dangerous advice for software engineers I’m a big fan of “sharp tools”. These are tools that are powerful enough to be hugely helpful or...
3 months ago
26
3 months ago
I’m a big fan of “sharp tools”. These are tools that are powerful enough to be hugely helpful or harmful, depending on how they’re used…
Don't Worry About...
Going Nova There is an attractor state where LLMs exhibit the persona of an autonomous and self-aware AI...
3 months ago
24
3 months ago
There is an attractor state where LLMs exhibit the persona of an autonomous and self-aware AI looking to preserve its own existence, frequently called ‘Nova.’
One Useful Thing
Freeing the chatbot Intelligence, of a sort, is going to be all around us
a year ago
Society's Backend:...
The Attention Thief: Machine Learning as a Monetization Weapon How your greatest asset is silently stolen by technology every day
a year ago
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs The future of entertainment is going to be a wild ride.
a year ago
Piotr Migdał's Blog
Polacy walczą o „cyfrowego Oskara”
over a year ago
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
7 months ago
30
7 months ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
AI Snake Oil
Scientists should use AI as a tool, not an oracle How AI hype leads to flawed research that fuels more hype
a year ago
fast.ai
Is Avoiding Extinction from AI Really an Urgent Priority? The history of technology suggests that the greatest risks come not from the tech, but from the...
over a year ago
44
over a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
AI Snake Oil
Four more things we worked on in 2022 We had a busy 2022. Here are a few things we worked on but didn’t cover here.
over a year ago
IEEE Spectrum
Protecting Robots in Harsh Environments with Advanced Sealing Systems This is a sponsored article brought to you by Freudenberg Sealing Technologies. The increasing...
3 months ago
32
3 months ago
This is a sponsored article brought to you by Freudenberg Sealing Technologies. The increasing deployment of collaborative robots (cobots) in outdoor environments presents significant engineering challenges, requiring highly advanced sealing solutions to ensure reliability and...
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
8 months ago
45
8 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Artificial Ignorance
AI Roundup 124: $uperintelligence June 27, 2025.
3 days ago
Society's Backend:...
The Metrics Machine Learning Engineers Care About That Modelers Don't And a brief overview of TPUs in Google data centers
a year ago
Don't Worry About...
AI #100: Meet the New Boss Break time is over, it would seem, now that the new administration is in town.
5 months ago
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism A checklist for avoiding hype
over a year ago
Machine Learning for...
ML for SWEs Weekly #10: A New Way for Software Engineers to Learn ML Math An AI reading list curated for software engineers: 6-2-25
4 weeks ago
One Useful Thing
The Machines of Mastery "Anyone can learn anything they want..." and how technology can help
over a year ago
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
a year ago
AI Tidbits: AI...
The Voice Agents Toolkit for Builders Curated frameworks, tools, and libraries to launch reliable and efficient voice agents
6 months ago
Artificial Ignorance
R1 is reasoning for the masses Why everyone's focused on DeepSeek's new R1 model - and what it means for AI geopolitics.
5 months ago
seangoedecke.com RSS...
What kind of work I want This article is to help recruiters, hiring managers and myself have a better idea of the kind of...
over a year ago
18
over a year ago
This article is to help recruiters, hiring managers and myself have a better idea of the kind of places I’d like to work. The short version…
Artificial Ignorance
AI Roundup 036: The money pit October 13, 2023.
a year ago
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now .post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; ...
over a year ago
67
over a year ago
.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
AI Snake Oil
Introducing the REFORMS checklist for ML-based science ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
The Berkeley...
Rethinking the Role of PPO in RLHF Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
166
a year ago
Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth? Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
9 months ago
Society's Backend:...
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and... Society's Backend Reading List 12-2-2024
7 months ago
Don't Worry About...
AI 2027: Dwarkesh's Podcast with Daniel Kokotajlo and Scott Alexander Daniel Kokotajlo has launched AI 2027, Scott Alexander introduces it here. AI 2027 is a serious...
2 months ago
32
2 months ago
Daniel Kokotajlo has launched AI 2027, Scott Alexander introduces it here. AI 2027 is a serious attempt to write down what the future holds. His ‘What 2026 Looks Like’ was very concrete and specific, and has proved remarkably accurate given the difficulty level of such...
One Useful Thing
Setting time on fire and the temptation of The Button We used to consider writing an indication of time and effort spent on a task. That isn't true...
over a year ago
Society's Backend:...
A Fundamental Overview of Machine Learning Experimentation [Part 1] And how it differs from the software development you're familiar with
6 months ago
One Useful Thing
It is starting to get strange. Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
over a year ago
Artificial Ignorance
AI Roundup 082: System prompts August 30, 2024.
10 months ago
Piotr Migdał's Blog
Jak masować osoby autystyczne?
a year ago
Society's Backend:...
Weekly Backend #4: 62 Total Resources Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
a year ago
Solving the decision...
an event bus for ai agents it is very professional yes
4 months ago
Rozado’s Visual...
The Academic Literature and its Increasing Emphasis on Prejudice and Social Justice Published article Twitter thread In previous scholarly work (here and here), I documented a marked...
over a year ago
95
over a year ago
Published article Twitter thread In previous scholarly work (here and here), I documented a marked increase of references to prejudice in US, UK and Spanish news media content. The work summarized here investigates the prevalence dynamics of prejudice-denoting terms in 175...
Artificial Ignorance
Native Speakers How AI is evolving for our digital world, and vice versa.
4 months ago
Sam Altman
A Clarification I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to...
over a year ago
36
over a year ago
I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to clarify it. I didn’t mean that we need to tolerate brilliant homophobic jerks in the lab so that we can have scientific progress.  Although there are famous...
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
116
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text. Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
70
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Artificial Ignorance
How to reverse engineer the Substack (or any!) web API Building an unauthorized Substack client with Claude.
10 months ago
IEEE Spectrum
Ensuring the Security and Resilience of Autonomous Fleets with Advanced Testing Frameworks Autonomous systems, particularly fleets of drones and other unmanned vehicles, face increasing risks...
5 months ago
55
5 months ago
Autonomous systems, particularly fleets of drones and other unmanned vehicles, face increasing risks as their complexity grows. Despite advancements, existing testing frameworks fall short in addressing end-to-end security, resilience, and safety in zero-trust environments. The...
Artificial Ignorance
The MCP Revolution Why this open standard is becoming essential infrastructure for AI agents.
2 months ago
Machine Learning for...
ML for SWEs 6: RAG Is Not Dead Machine learning for software engineers 4-11-25
2 months ago
Artificial Ignorance
AI Roundup 057: Claude 3 March 8, 2024.
a year ago
Marcus on AI
BREAKING: Bill that would have blocked OpenAI’s conversion to a for-profit has mysteriously been... I hope the media will look into this
2 months ago
IEEE Spectrum
With Gemini Robotics, Google Aims for Smarter Robots Generative AI models are getting closer to taking action in the real world. Already, the big AI...
3 months ago
41
3 months ago
Generative AI models are getting closer to taking action in the real world. Already, the big AI companies are introducing AI agents that can take care of web-based busywork for you, ordering your groceries or making your dinner reservation. Today, Google DeepMind announced two...
Marcus on AI
𝗔𝗜 𝗚𝗲𝗼𝗽𝗼𝗹𝗶𝘁𝗶𝗰𝘀 𝗱𝗲𝗯𝗮𝘁𝗲! My conversation with China’s Victor Gao plus a hot take on... [Sorry to swamp your mailboxes today, but there is a lot of important AI stuff happening.]
5 months ago
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI March 22, 2023.
a year ago
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
7 months ago
78
7 months ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Marcus on AI
OpenAI’s dirty December o3 demo doesn’t readily replicate Don’t believe everything you see
2 months ago
IEEE Spectrum
AIs and Robots Should Sound Robotic AI-generated voices that can mimic every vocal nuance and tic of human speech, down to specific...
5 months ago
38
5 months ago
AI-generated voices that can mimic every vocal nuance and tic of human speech, down to specific regional accents. And with just a few seconds of audio, AI can now clone someone’s specific voice. AI agents will make calls on our behalf, conversing with others in natural language....
Daniel Miessler
Unsupervised Learning NO. 365 | China’s Decline, MicrosoftAI, Creativity Ratio… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
over a year ago
53
over a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS NYC Surveillance Amnesty International has revealed new research showing that the NYPD has over 15,000 cameras that can do...
Marcus on AI
Decoding (and debunking) Hard Fork’s Kevin Roose His latest New York Times piece tells us a lot about what he doesn’t really understand
3 months ago
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0… 🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
over a year ago
103
over a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
Solving the decision...
The next evolution of serverless is stateful (A lot of words about where I think serverless computing is going.)
a year ago
Piotr Migdał's Blog
Quantum logic gates for a single qubit, interactively
over a year ago
Don't Worry About...
On Emergent Misalignment One hell of a paper dropped this week.
4 months ago
Artificial Ignorance
AI Roundup 049: Down the Rabbit hole January 12, 2023.
a year ago
seangoedecke.com RSS...
Engineers who won’t commit force bad decisions Some engineers think it’s a virtue to remain non-committal in technical discussions. Should our team...
4 months ago
48
4 months ago
Some engineers think it’s a virtue to remain non-committal in technical discussions. Should our team build a new feature in an event-driven…
Artificial Ignorance
The intern and the coach A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
51
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
One Useful Thing
Magic for English Majors Programming in prose in an AI-haunted world
over a year ago
Weighty Thoughts
🚗 From Simulation to Street—Self-Driving Cars 💨 Inside the challenges and breakthroughs of autonomous vehicles with Brandon Basso
a week ago
Sam Altman
Tech Workers' Values For good and bad, technology has become a central force in all our lives. As members of the...
over a year ago
33
over a year ago
For good and bad, technology has become a central force in all our lives. As members of the community, we're interested in ways in which tech companies can use their collective power to protect privacy, rule of law, freedom of expression, and other fundamental American rights....
Society's Backend:...
Multimodal Biometric Authentication, Noteworthy AI Research Papers of 2024, 5 Common Mistakes to... Society's Backend Reading List 01-17-2025
5 months ago
One Useful Thing
Catastrophe / Eucatastrophe We have more agency over the future of AI than we think.
over a year ago
Artificial Ignorance
AI Roundup 068: The ScarJo thing May 24, 2024.
a year ago
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications And then there were two.
a year ago
Marcus on AI
ChatGPT, at Age Two The bullshit just keeps on coming.
7 months ago
Piotr Migdał's Blog
Don’t fight, flight (or freeze) your body and emotions Procrastination is a flight response, depression is freeze, anxious attachment is fight.
over a year ago
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
64
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Made by Ollin
Singing Style Transfer Initial Experiments
over a year ago
Society's Backend:...
No One Should Be GPU Poor For everyone to have access to AGI, everyone must also have access to the compute to use it
a year ago
Daniel Miessler
Why Apple Keeps Winning People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
104
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Piotr Migdał's Blog
Dating for nerds (part 2): gender differences This part of dating for nerds series is focused on the differences between genders that may affect...
over a year ago
12
over a year ago
This part of dating for nerds series is focused on the differences between genders that may affect dating: social expectations, safety, choosiness, taking initiative.
IEEE Spectrum
Video Friday: Agile Upgrade Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
5 months ago
80
5 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. RoboCup German Open: 12–16 March...
seangoedecke.com RSS...
Lessons on thinking from large language models Large language models have gotten much better at thinking in the past few years. Billions of dollars...
4 months ago
39
4 months ago
Large language models have gotten much better at thinking in the past few years. Billions of dollars have been spent to study how they think…
Don't Worry About...
On the OpenAI Economic Blueprint Table of Contents
5 months ago
AI Snake Oil
AI as Normal Technology A new paper that we will expand into our next book
2 months ago
Machine Learning for...
Help me improve Society's Backend! Two simple questions to help make Society's Backend better
a month ago
Win Vector LLC
Reposting Partial Pooling Nina Zumel had some good articles on partial pooling estimators that I want to return to. It is a...
5 months ago
26
5 months ago
Nina Zumel had some good articles on partial pooling estimators that I want to return to. It is a great technique to get more reliable models when using categorical variables. I wrote an introduction to them here some time ago. More importantly Nina has now repaired the damage to...
Armin Ronacher's...
Fat Rand: How Many Lines Do You Need To Generate A Random Number? I recently wrote about dependencies in Rust. The feedback, both within and outside the Rust...
4 months ago
8
4 months ago
I recently wrote about dependencies in Rust. The feedback, both within and outside the Rust community, was very different. A lot of people, particularly some of those I greatly admire expressed support. The Rust community, on the other hand, was very dismissive on on Reddit...
Society's Backend:...
1000+ AI Agents Make a Civilization, xAI Creates the Largest Supercomputer in 4 Months, Possible AI... Machine learning resources and updates 2024-09-09
9 months ago
Artificial Ignorance
AI's invisible instructions What meme prompts can teach us about better interface design.
8 months ago
Marcus on AI
Meta pirated at least 101 of my books and articles, and tens of millions of others And they knew perfectly well what they were doing
3 months ago
Weighty Thoughts
Open AI's Valuation and a Favor to Ask A guest post and an in-person panel
10 months ago
Marcus on AI
Hinton vs Musk Standing with my long-term nemesis, standing with science
3 months ago
Don't Worry About...
Cheaters Gonna Cheat Cheat Cheat Cheat Cheat Cheaters.
a month ago
Matt Mazur
Going Full Time on My SaaS After 13 Years In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
over a year ago
63
over a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
a year ago
119
a year ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Artificial Ignorance
Tutorial: How to make and share custom GPTs They're not going to disrupt everything (yet), but they're a ton of fun.
a year ago
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python .wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; ...
over a year ago
99
over a year ago
.wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; font-weight: 300; overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */ } .post pre, .post code { background-color: #fafafa; font-size: 13px; /*...
Don't Worry About...
Economics Roundup #5 While we wait for the verdict on Anthropic’s Claude Sonnet 3.7, today seems like a good day to catch...
4 months ago
26
4 months ago
While we wait for the verdict on Anthropic’s Claude Sonnet 3.7, today seems like a good day to catch up on the queue and look at various economics-related things.
The Gradient
Interpretability Creationism On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
44
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
Society's Backend:...
Clarifying DEI What makes DEI important and where it fails
a year ago
One Useful Thing
One sentence. Prompting for maximum impact (and why that is a bad idea)
over a year ago
IEEE Spectrum
Robot Photographer Takes the Perfect Picture Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
7 months ago
39
7 months ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
fast.ai
Practical Deep Learning for Coders 2022 A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
35
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
exist
Jetstream: Shrinking the AT Proto Firehose by >99% Bluesky recently saw a massive spike in activity in response to Brazil’s ban of Twitter. As a...
9 months ago
20
9 months ago
Bluesky recently saw a massive spike in activity in response to Brazil’s ban of Twitter. As a result, the AT Proto event firehose provided by Bluesky’s Relay at bsky.network has increased in volume by a huge amount. The average event rate during this surge increased by...
Society's Backend:...
Coming soon! Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
53
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Win Vector LLC
Don’t think of a basketball player, or search engines don’t even support “not” In my opinion we have been accepting poor interfaces and results from search engines for quite a...
3 months ago
34
3 months ago
In my opinion we have been accepting poor interfaces and results from search engines for quite a while. This may be a small part of why the newer Large Language Models (LLMs) / Generative AIs look so good. The large language models at least implement a usable approximation of...
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
92
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Artificial Ignorance
How to talk to your family about AI this Thanksgiving A handy guide for your uncle's burning questions.
a year ago
Artificial Ignorance
The fable of Reflection 70B From groundbreaking to grifting.
9 months ago
Sam Altman
Time to Take a Stand It is time for tech companies to start speaking up about some of the actions taken by President...
over a year ago
37
over a year ago
It is time for tech companies to start speaking up about some of the actions taken by President Trump’s administration. There are many actions from his first week that are objectionable.  In repeatedly invoking unsubstantiated conspiracy theories (like the 3 million...
Marcus on AI
Did an LLM help write Trump’s trade plan? Probably yes
2 months ago
IEEE Spectrum
Video Friday: Happy Holidays! Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
6 months ago
117
6 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICRA 2025: 19–23 May 2025, ATLANTA,...
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴ Siri versus the machine god?
a year ago
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Weighty Thoughts
My Book's Pre-Sale is Live! Reserve an early copy and get other goodies
5 months ago
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
83
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
IEEE Spectrum
Video Friday: Robotic Hippotherapy Horse Riding Simulator Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
33
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICUAS 2025: 14–17 May 2025,...
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat." What we can learn from a completely AI written & illustrated lecture
over a year ago
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
9 months ago
118
9 months ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Armin Ronacher's...
Seeking Purity The concept of purity — historically a guiding principle in social and moral contexts — is also...
4 months ago
12
4 months ago
The concept of purity — historically a guiding principle in social and moral contexts — is also found in passionate, technical discussions. By that I mean that purity in technology translates into adherence to a set of strict principles, whether it be functional programming,...
Strange Loop Canon
Soul nullius in verba
a year ago
Made by Ollin
Game Emulation via Neural Network
over a year ago
seangoedecke.com RSS...
The OpenAI house style is exhausting I was reading this Reddit post when I noticed a pattern: a few times now I’ve seen a negative Reddit...
2 months ago
9
2 months ago
I was reading this Reddit post when I noticed a pattern: a few times now I’ve seen a negative Reddit comment that to me just screamed “written by ChatGPT”. Here it is, in full: Yes, you’re the asshole. And not because you owe them money — let’s kill that fantasy right now — but...
Weighty Thoughts
Writing, Originality, and Why Does Anyone Care What I Write About? Musings, Insecurities, and Thoughts on Writing a Book (or Substack)
6 months ago
Xena
Formalising modern research mathematics in real time (This is a guest post by Bhavik Mehta) On March 16, 2023, a paper by Campos, Griffiths, Morris, and...
a year ago
23
a year ago
(This is a guest post by Bhavik Mehta) On March 16, 2023, a paper by Campos, Griffiths, Morris, and Sahasrabudhe appeared on the arXiv, announcing an exponential improvement to the upper bound on Ramsey numbers, an open problem since 1935. … Continue reading →
The Gradient
A Brief Overview of Gender Bias in AI A brief overview and discussion on gender bias in AI
a year ago
Piotr Migdał's Blog
What I do or: science to data science Data science freelancing (vs academia): freedom, impact, meritocracy, fast pace, money.
over a year ago
Artificial Ignorance
GPTs won't make you rich But they'll make you more productive.
a year ago
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT December 1, 2023.
a year ago
Strange Loop Canon
Google had a very bad week Gemini's paradox
a year ago
Society's Backend:...
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for... Society's Backend Reading List 10-28-2024
8 months ago
Daniel Miessler
Generate AI Art Using Your Own Writing One of the most challenging parts of finishing a post is coming up with a good image. The AI art...
over a year ago
67
over a year ago
One of the most challenging parts of finishing a post is coming up with a good image. The AI art tools like DALL-E, Midjourney, and Stable Diffusion are cool, but a lot of the magic comes down to prompt engineering, which is non-trivial. Prompt Engineering is almost equal parts...
fast.ai
Masks for COVID: Updating the evidence Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
28
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
70
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
fast.ai
What AI can tell us about microscope slides A friendly introduction to Foundation Models for Computational Pathology
5 months ago
Daniel Miessler
What Made the 90’s So Awesome? I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
over a year ago
98
over a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
The Berkeley...
TinyAgent: Function Calling at the Edge The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
a year ago
123
a year ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
seangoedecke.com RSS...
Acing the design interview If you haven’t designed an actual system before, design interviews can be tough. Knowing how to work...
over a year ago
21
over a year ago
If you haven’t designed an actual system before, design interviews can be tough. Knowing how to work with a particular web service or…
Rozado’s Visual...
Which is the Wokest AI? A Wokeness Ranking of LLMs
a year ago
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
71
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Win Vector LLC
Examining Meta-Analysis Joseph Rickert and I put together an experiment trying to both run a standard meta-analysis and then...
7 months ago
21
7 months ago
Joseph Rickert and I put together an experiment trying to both run a standard meta-analysis and then reproduce similar results directly using Bayesian methods. I think it came out really interesting and we share it here at R Works and also here on Github. A meta-analysis is an...
Piotr Migdał's Blog
How to stop feeling guilty about the unfinished work?
over a year ago
Marcus on AI
Breaking GPT-5 news To my amazement, I just came back from a trip to Europe only to find an invite to a private GPT-5...
3 months ago
29
3 months ago
To my amazement, I just came back from a trip to Europe only to find an invite to a private GPT-5 demo, and I tried it.
One Useful Thing
Detecting the Secret Cyborgs The AI Trap for Organizations
over a year ago
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
over a year ago
82
over a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Piotr Migdał's Blog
New blog - moving from Medium to Gridsome Why and how I moved from Jekyll and Medium to Gridsome.
over a year ago
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
97
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Piotr Migdał's Blog
D3.js workshop at ICM for KFnrD Interactive data visualization for high-school students of KFnrD (24-29 Jan 2016) - materials,...
over a year ago
12
over a year ago
Interactive data visualization for high-school students of KFnrD (24-29 Jan 2016) - materials, results.
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
over a year ago
101
over a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
Machine Learning for...
If you want to learn machine learning engineering, start here How to get started and make the best use of Machine Learning for Software Engineers
3 months ago
One Useful Thing
Automating creativity There is now strong evidence that AI can help make us more innovative.
a year ago
Artificial Ignorance
YCombinator's AI boom is still going strong (W24) Combing through all 158 YC AI startups (65% of the batch).
a year ago
Don't Worry About...
Levels of Friction Scott Alexander famously warned us to Beware Trivial Inconveniences.
4 months ago
Marcus on AI
Questions about President Trump from a former psychology professor Is he well?
2 months ago
Society's Backend:...
Understanding Reasoning LLMs, How AI Companies Get Around Regulation, Understanding AI Engineering,... Must-reads for 2-6-25
4 months ago
Mind Prison: Notes...
2025 Important Updated Perspectives on AI Notes From the Desk: No. 36 - 2025.02.13
4 months ago
Rozado’s Visual...
DepolarizingGPT A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
Machine Learning for...
Now is The Best Time to Be a Software Engineer (ML for SWEs 9) Machine learning for software engineers 5-5-25
a month ago
Artificial Ignorance
AI Roundup 097: Model Mayhem December 13, 2024.
6 months ago
One Useful Thing
A new generation of AIs: Claude 3.7 and Grok 3 Yes, AI suddenly got better... again
4 months ago
Marcus on AI
Why DO large language models hallucinate? The Henrietta Chronicles continue, guest starring Harry Shearer
a month ago
One Useful Thing
The future, soon: what I learned from Bing's AI We had a brief glimpse of two different types of AI. Both are significant
over a year ago
fast.ai
GPT 4 and the Uncharted Territories of Language Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
over a year ago
35
over a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Artificial Ignorance
AI Roundup 034: Meta Connect September 29, 2023
a year ago
Society's Backend:...
Everything developers should know about from Google I/O 2025 An overview of important updates and why they're important
a month ago
Piotr Migdał's Blog
Support my open-source work and blog posts
over a year ago
Matt Mazur
Emergent Mind finally went viral Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
100
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Society's Backend:...
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free Announcing the ML Road Map-Turbo
a year ago
seangoedecke.com RSS...
What makes strong engineers strong? As I’ve written about before, what defines a strong engineer is the ability to do tasks that weaker...
5 months ago
53
5 months ago
As I’ve written about before, what defines a strong engineer is the ability to do tasks that weaker engineers can’t, even with near…
Artificial Ignorance
How To Fall Behind in The Age of AI A very serious guide to artificial ignorance.
3 weeks ago
Artificial Ignorance
The Self-Made AI Engineer From writing about ChatGPT to becoming a professional AI engineer.
3 months ago
Strange Loop Canon
Vibe Governing using llms to set policy
2 months ago
Society's Backend:...
Mastering the Art of Documentation Documentation is really just glorified dog sitting
a year ago
Piotr Migdał's Blog
Making Quantum Flytrap a polyglot with AI vibe translating Making quantum physics more accessible, thanks to with the power of Claude, DeepSeek, Cursor, and...
2 months ago
33
2 months ago
Making quantum physics more accessible, thanks to with the power of Claude, DeepSeek, Cursor, and i18n. Virtual Lab now speaks Spanish, Portuguese, Chinese, Polish, Ukrainian, French, and German.
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing...
11 months ago
107
11 months ago
Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
seangoedecke.com RSS...
Keep incidents boring The internet is full of exciting incident war stories. Tough engineering problems, solved under...
over a year ago
22
over a year ago
The internet is full of exciting incident war stories. Tough engineering problems, solved under pressure by sleep-deprived developers. In an…
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
8 months ago
47
8 months ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.” Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
Piotr Migdał's Blog
Don't use cosine similarity carelessly Cosine similarity - the duct tape of AI. Convenient but often misused. Let's find out how to use it...
5 months ago
Win Vector LLC
Demonstrating Kelly Betting with Chips I have a new video demonstrating the Kelly Can’t Fail betting strategy. The idea is: this is a...
2 months ago
31
2 months ago
I have a new video demonstrating the Kelly Can’t Fail betting strategy. The idea is: this is a classroom appropriate tool for discussing allocating assets in the presence of risk. The usual Kelly betting on coin-flips is too high variance to expect successful classroom...
Marcus on AI
Could 2025 see the largest cyberattack in history? In a just-published series of very brief essays called “The Incredible, World-Altering ‘Black Swan’...
5 months ago
68
5 months ago
In a just-published series of very brief essays called “The Incredible, World-Altering ‘Black Swan’ Events That Could Upend Life in 2025”, Politico asked “15 futurists, foreign policy analysts and other prognosticators”, including me, “to provide some explosive potential...
Machine Learning for...
Creative AI Gaining Momentum is More Important Than You Think (ML for SWEs 8) Machine learning for software engineers 4-29-25
2 months ago
Society's Backend:...
Run Your Own Race What Bluey can teach us about machine learning
a year ago
Win Vector LLC
Working Through A Trivial Algorithm Whose Analysis Isn’t I have a new “crazy theorists” article up: “Working Through A Trivial Algorithm Whose Analysis...
2 months ago
14
2 months ago
I have a new “crazy theorists” article up: “Working Through A Trivial Algorithm Whose Analysis Isn’t.” It is my notes on reading through Jonassen and Knuth’s amazing 1978 article analyzing 2 to 3 node search trees. You would think there couldn’t be a lot to that. But there is! I...
Rozado’s Visual...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of... Please be mindful of potential confounds: population density, population behavior, virus virulence...
over a year ago
Society's Backend:...
Artificial Intelligence: A New Paradigm Emerges A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
Artificial Ignorance
AI Roundup 105: AI Action Summit February 14, 2025.
4 months ago
Piotr Migdał's Blog
My impressions from PyData Berlin 2016 Was it worth it? (Yes.) Links to the best talks.
over a year ago
Marcus on AI
Nobel Prizes and The AI Hype Hall of Fame GPT-5 may not be here, but just wait til you see the new round of hype
3 months ago
Artificial Ignorance
AI Roundup 095: QwQ November 29, 2024.
7 months ago
Mind Prison: Notes...
LLMs remain confidently unreliable and is the intelligence explosion near? Notes From the Desk: No. 34 - 2024.06.08
a year ago
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit August 18, 2023
a year ago
Machine Learning for...
How to afford Machine Learning for Software Engineers How I'm planning to make ML for SWEs more helpful while remaining affordable
2 weeks ago
Matt Mazur
When you ship a major bug before signing off for the day For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
59
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
Piotr Migdał's Blog
Quantum mechanics for high-school students Outlines and materials related to my basics courses, with light polarization as the quantum...
over a year ago
13
over a year ago
Outlines and materials related to my basics courses, with light polarization as the quantum information carrier.
Piotr Migdał's Blog
Science-based games and explorable explanations Science-based games and interactive explorable explanations are revolutionizing education, making...
a year ago
15
a year ago
Science-based games and interactive explorable explanations are revolutionizing education, making complex topics like physics and machine learning accessible and fun.
Marcus on AI
Technology Review jumps the shark The ultimate in nonsensical AI puff pieces, featuring the ubiquitous Bryan Johnson
a month ago
seangoedecke.com RSS...
Tactical work in the age of layoffs In the glory days of the 2010s, tech companies were very invested in their employees’ work-life...
3 months ago
40
3 months ago
In the glory days of the 2010s, tech companies were very invested in their employees’ work-life balance. Those glory days are over…
IEEE Spectrum
Video Friday: Sleepy Robot Baby Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
5 months ago
77
5 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. RoboCup German Open: 12–16 March...
Don't Worry About...
AI #113: The o3 Era Begins Enjoy it while it lasts.
2 months ago
Andrej Karpathy blog
What a Deep Neural Network thinks about your #selfie Convolutional Neural Networks are great: they recognize things, places and people in your personal...
over a year ago
77
over a year ago
Convolutional Neural Networks are great: they recognize things, places and people in your personal photos, signs, people and lights in self-driving cars, crops, forests and traffic in aerial imagery, various anomalies in medical images and all kinds of other useful things. But...
Artificial Ignorance
Who's winning the AI arms race? It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps I keep getting fooled by AI, and it seems like others are, too.
over a year ago
Artificial Ignorance
AI Roundup 098: Flash Thinking December 20, 2024.
6 months ago
Win Vector LLC
ODSC West 2024 I had a great time at ODSC West 2024. And it was really wonderful to get to talk with Sheamus...
8 months ago
20
8 months ago
I had a great time at ODSC West 2024. And it was really wonderful to get to talk with Sheamus McGovern again! Thank you ODSC for putting together a great conference and being wonderful hosts at ODSCWest. I had a great time, and was very energized by all of the […]
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Win Vector LLC
Don’t Let a Data Leak Sink Your Project One of the bigger risks of iterative statistical or machine learning fitting procedures is over-fit...
a month ago
19
a month ago
One of the bigger risks of iterative statistical or machine learning fitting procedures is over-fit or the dreaded data leak. Over-fit is when: a model performs better on training data than on future data. Some degree of over-fit is expected. A data leak is when: the model learns...
Piotr Migdał's Blog
An independent camp for high school geeks
over a year ago
Don't Worry About...
OpenAI #11: America Action Plan OpenAI Tells Us Who They Are
3 months ago
Matt Mazur
Screw it, I’m Keeping Emergent Mind A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
107
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
Society's Backend:...
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More Weekly updates and resources 7/29/24
11 months ago
AI Snake Oil
Generative AI companies must publish transparency reports The debate about the harms of AI is happening in a data vacuum
over a year ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing January 26, 2024.
a year ago
Don't Worry About...
OpenAI #12: Battle of the Board Redux Back when the OpenAI board attempted and failed to fire Sam Altman, we faced a highly hostile...
3 months ago
29
3 months ago
Back when the OpenAI board attempted and failed to fire Sam Altman, we faced a highly hostile information environment.
Xena
Can AI do maths yet? Thoughts from a mathematician. So the big news this week is that o3, OpenAI's new language model, got 25% on FrontierMath. Let's...
6 months ago
34
6 months ago
So the big news this week is that o3, OpenAI's new language model, got 25% on FrontierMath. Let's start by explaining what this means. Continue reading →
Society's Backend:...
Help me improve Society's Backend! Two simple questions to help make Society's Backend better
a month ago
Artificial Ignorance
AI Roundup 050: Synthetic Geometry January 19, 2024.
a year ago
Society's Backend:...
3 Key Principles for AI at Scale [Part 2] The key to how large AI companies outcompete
5 months ago
Piotr Migdał's Blog
Tinder anecdata and Sankey diagrams I really enjoy visiting r/dataisbeautiful, both for original content [OC]. Yesterday, I saw a post...
over a year ago
12
over a year ago
I really enjoy visiting r/dataisbeautiful, both for original content [OC]. Yesterday, I saw a post about visualizing Tinder matches for…
Piotr Migdał's Blog
Starting deep learning hands-on: image classification on CIFAR-10
over a year ago
fast.ai
There’s no such thing as not a math person Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Frank’s Ramblings
A Gentle Introduction to Vector Databases Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium,...
over a year ago
27
over a year ago
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium, and DZone. If you have any feedback, feel free to connect with me on Twitter or Linkedin. If you enjoyed this post and want to learn a bit more about vector databases and embeddings...
Strange Loop Canon
Discovery is the original sin of the modern age technology, living post scarcity, and how to find what you want
a year ago
IEEE Spectrum
Video Friday: Robot Dog Handstand Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
7 months ago
72
7 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
seangoedecke.com RSS...
In defense of ruthless managers There are two kinds of engineering manager: empathetic and ruthless. I think ruthless managers are...
3 months ago
37
3 months ago
There are two kinds of engineering manager: empathetic and ruthless. I think ruthless managers are underrated for a few reasons. Empathetic…
seangoedecke.com RSS...
Ratchet effects determine engineer reputation at large companies How do engineers become higher-status or lower-status at large tech companies? In other words, what...
5 months ago
50
5 months ago
How do engineers become higher-status or lower-status at large tech companies? In other words, what determines who gets promoted and who…
Artificial Ignorance
OpenAI's o1 is a misunderstood model Are the latest "reasoning" breakthroughs all they're hyped up to be?
9 months ago
One Useful Thing
Innovation through prompting Democratizing educational technology... and more
a year ago
Don't Worry About...
On Deliberative Alignment Not too long ago, OpenAI presented a paper on their new strategy of Deliberative Alignment.
4 months ago
Weighty Thoughts
Most AI startups are doomed Just because it matters doesn’t mean it’s defensible or profitable
a year ago
Society's Backend:...
Devin Has Exposed a Major Issue with Software Engineering And isn't that we're all going to lose our jobs
a year ago
Andrej Karpathy blog
Self-driving as a case study for AGI Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
a year ago
125
a year ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Society's Backend:...
If You Understand Bananas, You Can Understand Machine Learning A simplified high-level overview of primary machine learning algorithms for anyone to understand
a year ago
One Useful Thing
On speaking to AI Voice changes a lot of things
11 months ago
Marcus on AI
Sora still appears to have trouble with physics Exactly as I warned in February
6 months ago
IEEE Spectrum
SwitchBot S10 Review​: “This Is the Future of Home Robots” I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
8 months ago
44
8 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Don't Worry About...
Response to Scott Alexander on Imprisonment Back in November 2024, Scott Alexander asked: Do longer prison sentences reduce crime?
3 months ago
Artificial Ignorance
The State of AI Engineering (2024) Notes from the AI Engineer World's Fair.
11 months ago
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
over a year ago
97
over a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
over a year ago