Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
Top Categories > AI
#all #programming #history #startups #technology #science #life #literature #architecture #travel #creative #design #comics #finance #cartography #AI #indiehacker Muted Categories [alt+←][alt+→]
Artificial Ignorance
AI Roundup 054: Ten million tokens February 16, 2024.
10 months ago
Matt Mazur
Redesigning Preceden’s Pricing Page Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
107
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
One Useful Thing
Blinded by Analogies What is this AI thing? The wrong model can lead us astray
a year ago
The Gradient
Do text embeddings perfectly encode text? 'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
10 months ago
54
10 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Society's Backend
All Machine Learning Resources and Updates 06/21/2024 Below are the machine learning resources and updates from the past few days you don't want to miss....
6 months ago
44
6 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Weighty Thoughts
News Roundup: May 27, 2014 🧴 Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
7 months ago
One Useful Thing
The future, soon: what I learned from Bing's AI We had a brief glimpse of two different types of AI. Both are significant
a year ago
Rozado’s Visual...
The Political Biases of GPT-4 Things are not always what they seem
a year ago
Artificial Ignorance
A stroll through Google's Model Garden What generative AI capabilities does Google offer to developers?
a year ago
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research? Mentions of climate change in news media vastly outnumber other existential threats
a year ago
Andrej Karpathy blog
A Recipe for Training Neural Networks Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
over a year ago
34
over a year ago
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
Society's Backend
Should You Get a PhD? The one good reason to do a PhD and two others that fall flat
3 months ago
Weighty Thoughts
The Fall of Data Moats AI actually makes most data moats weaker
a year ago
Made by Ollin
Singing Style Transfer Initial Experiments
over a year ago
Weighty Thoughts
When the AI Bubble Bursts It’s when, not if, for these kinds of new technologies
6 months ago
One Useful Thing
What OpenAI did A new model opens up new possibilities
8 months ago
The Berkeley...
Rethinking the Role of PPO in RLHF Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
116
a year ago
Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
One Useful Thing
Detecting the Secret Cyborgs The AI Trap for Organizations
a year ago
Sam Altman
Time to Take a Stand It is time for tech companies to start speaking up about some of the actions taken by President...
over a year ago
19
over a year ago
It is time for tech companies to start speaking up about some of the actions taken by President Trump’s administration. There are many actions from his first week that are objectionable.  In repeatedly invoking unsubstantiated conspiracy theories (like the 3 million...
Society's Backend
JAX is for More Than Just Machine Learning What JAX is and its potential applications
7 months ago
Society's Backend
A Privacy Review: Google I read Google's privacy policy for you
a year ago
Sam Altman
Reinforcement Learning Progress Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general...
over a year ago
21
over a year ago
Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros. This is the game that to me feels closest to the real world and complex...
Artificial Ignorance
AI Roundup 034: Meta Connect September 29, 2023
a year ago
One Useful Thing
The Lazy Tyranny of the Wait Calculation Taking AI timelines seriously
11 months ago
Frank’s Ramblings
Vision Transformers are Overrated Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
a year ago
56
a year ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
AI Snake Oil
AI cannot predict the future. But companies keep trying (and failing). A new paper on how AI companies make false promises and how we can challenge them
a year ago
IEEE Spectrum
Video Friday: Robot Dog Handstand Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
8
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
Society's Backend
The Unfortunate Truth Regarding AI Regulation And the impact it'll have for decades to come
7 months ago
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
11 months ago
One Useful Thing
I, Cyborg: Using Co-Intelligence How I used AI in my book about AI
10 months ago
Artificial Ignorance
Pitfalls of building with large language models Dealing with more than just hallucinations.
a year ago
Artificial Ignorance
AI Roundup 098: Flash Thinking December 20, 2024.
2 weeks ago
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More Discussions from the past week: 09/16/2024
3 months ago
One Useful Thing
Which AI should I use? Superpowers and the State of Play And then there were three...
9 months ago
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
67
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Weighty Thoughts
The EU is making itself an economic backwater Regulation is not a real export
6 months ago
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and... Society's Backend Reading List 11-11-2024
a month ago
fast.ai
Can LLMs learn from a single example? We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
29
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Artificial Ignorance
AI Roundup 091: Search wars November 1, 2024.
2 months ago
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat November 22, 2024.
a month ago
IEEE Spectrum
Video Friday: Multiple MagicBots Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
10
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids Summit: 11–12 December...
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free Announcing the ML Road Map-Turbo
6 months ago
Strange Loop Canon
We all live on a knife's edge, and it's fine Or: How we weaponised serendipity
9 months ago
IEEE Spectrum
Video Friday: Reachy 2 IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few...
3 months ago
9
3 months ago
IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. IROS 2024: 14–18 October 2024, ABU DHABI, UAE ICSR 2024: 23–26 October 2024, ODENSE, DENMARK Cybathlon 2024: 25–27 October 2024,...
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022) This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
Strange Loop Canon
Slouching Towards Utopia by Brad DeLong
a year ago
Daniel Miessler
My Philosophy and Recommendations Around the LastPass Breaches If you follow Information Security at all you are surely aware of the LastPass breach situation. It...
over a year ago
62
over a year ago
If you follow Information Security at all you are surely aware of the LastPass breach situation. It started back in August of 2022 as a fairly common breach notification on a blog, but it, unfortunately, turned into more of a blog series. The initial blog was on August 25th,...
Artificial Ignorance
AI Roundup 097: Model Mayhem December 13, 2024.
3 weeks ago
One Useful Thing
The practical guide to using AI to do stuff A resource for students in my classes (and other interested people).
a year ago
Sam Altman
American Equity I’d like feedback on the following idea. I think that every adult US citizen should get an annual...
over a year ago
13
over a year ago
I’d like feedback on the following idea. I think that every adult US citizen should get an annual share of the US GDP. I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
AI Snake Oil
Generative AI companies must publish transparency reports The debate about the harms of AI is happening in a data vacuum
a year ago
Rozado’s Visual...
El sesgo político de ChatGPT A la izquierda del centro político
a year ago
Sam Altman
Tech Workers' Values For good and bad, technology has become a central force in all our lives. As members of the...
over a year ago
14
over a year ago
For good and bad, technology has become a central force in all our lives. As members of the community, we're interested in ways in which tech companies can use their collective power to protect privacy, rule of law, freedom of expression, and other fundamental American rights....
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes Several states just banned deepfakes in political ads and porn.
9 months ago
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
50
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Daniel Miessler
UL NO. 354 | THE NEWS & ANALYSIS SERIES SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from...
over a year ago
56
over a year ago
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from attaining advanced semiconductors. And now it looks like the bans will be expanded to quantum computing and AI as well. NYTIMES | MY ANALYSIS BELOW It appears Bytedance had a plan to...
fast.ai
GPT 4 and the Uncharted Territories of Language Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
18
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Sam Altman
Idea Generation The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
17
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup. But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
Daniel Miessler
Twitter’s Blue Checkmark Strategy Reduces Trust in Pursuit of Revenue When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month,...
over a year ago
61
over a year ago
When I heard that Twitter was going to open the blue checkmark up to anyone willing to pay $8/month, I was happy. As a legacy holder of the checkmark there’s a slight band-aid-sting of the check indicating specialness—who doesn’t want to feel special?—but I’d much rather see a...
One Useful Thing
AI is not good software. It is pretty good people. A pragmatic approach to thinking about AI
a year ago
Artificial Ignorance
AI Roundup 036: The money pit October 13, 2023.
a year ago
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
60
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
fast.ai
Practical Deep Learning for Coders 2022 A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
12
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news... I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
40
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
over a year ago
50
over a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Stories by Andrej...
Virtual Reality: still not quite there, again.
over a year ago
Artificial Ignorance
AI Roundup 087: DevDay SF October 4, 2024.
3 months ago
Daniel Miessler
NO. 369 | Reddit Hack, Deepfake Scams, Embracing Change… ✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank...
a year ago
69
a year ago
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank you! SECURITY Reddit has confirmed it was hacked, and it’s recommending users add 2FA. The attack started by phishing Reddit employees and stealing credentials and 2FA codes. After...
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python .wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; ...
over a year ago
62
over a year ago
.wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; font-weight: 300; overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */ } .post pre, .post code { background-color: #fafafa; font-size: 13px; /*...
Sam Altman
DALL•E 2 Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
11
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.  Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray... Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
44
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Artificial Ignorance
Lies, damned lies, and benchmarks While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to...
11 months ago
91
11 months ago
While benchmarks (and leaderboards) are useful tools, they are but a small facet when it comes to evaluating large language models. Often, they're not the best indicators of real-world utility - and I want to dig into why (and what other approaches exist).
Marcus on AI
25 AI Predictions for 2025, from Marcus on AI With a review of last year’s predictions
a week ago
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
40
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
IEEE Spectrum
SwitchBot S10 Review​: “This Is the Future of Home Robots” I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
3 months ago
9
3 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Society's Backend
Why Machine Learning Terminology is So Confusing And definitions for the most important terms you should know
10 months ago
fast.ai
nbdev+Quarto: A new secret weapon for productivity Our favorite tool for software engineering productivity–nbdev, now re-written with Quarto
over a year ago
Weighty Thoughts
Fear and Loathing in 7nm How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
Daniel Miessler
The UL Boost Protocol This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe...
over a year ago
59
over a year ago
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe Already a member? Login
Made by Ollin
Emojin An infinite kaomoji generator
over a year ago
Strange Loop Canon
Ode to software
9 months ago
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report And my notes on why they’re important
8 months ago
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
26
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
2 months ago
10
2 months ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.” Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
Artificial Ignorance
AI Roundup 078: Voice mode August 2, 2024.
5 months ago
Society's Backend
Why MLX is Important for the ML Community And a step-by-step guide to train a machine learning model on your Mac
8 months ago
Rozado’s Visual...
The Political Preferences of LLMs Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
11 months ago
84
11 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority? The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
One Useful Thing
Working with AI: Two paths to prompting Don't overcomplicate things
a year ago
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
7 months ago
One Useful Thing
AI in organizations: Some tactics Meet the Lab and the Crowd
3 months ago
AI Snake Oil
The bait and switch behind AI risk prediction tools Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
17
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Rozado’s Visual...
DepolarizingGPT A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
Artificial Ignorance
AI Roundup 070: AI whistleblowers June 7, 2024.
7 months ago
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs The future of entertainment is going to be a wild ride.
10 months ago
One Useful Thing
I hope you weren't getting too comfortable. I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits...
a year ago
67
a year ago
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits of AI were wrong.
Artificial Ignorance
How to fine-tune ChatGPT No GPU cluster required.
a year ago
Artificial Ignorance
AI Roundup 041: Lyria November 17, 2023.
a year ago
One Useful Thing
Post-apocalyptic education What comes after the Homework Apocalypse
4 months ago
Society's Backend
What Makes Machine Learning so Hard for Software Engineers How decades of learning a mindset makes adapting difficult
5 months ago
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and... Society's Backend Reading List 11-04-2024
2 months ago
Weighty Thoughts
News Roundup: May 15, 2024 Open AI announcements, DeepSeek-v2, and TSMC Arizona
7 months ago
Sam Altman
Please Fund More Science Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health,...
over a year ago
12
over a year ago
Experts on the COVID-19 pandemic seem to think there are three ways out—that is, for life, health, and the economy to return roughly to normal.  Either we get a vaccine good enough that R0 for the world goes below 1, a good enough treatment that people no longer need to be...
fast.ai
From Deep Learning Foundations to Stable Diffusion Practical Deep Learning for Coders part 2, 2022
over a year ago
fast.ai
AI Harms are Societal, Not Just Individual In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
12
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
Rozado’s Visual...
Out-of-office Donald Trump still more prominent in news media content than the current U.S.... In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump...
a year ago
63
a year ago
In 2019, I helped my colleague Musa al-Gharbi document the extraordinary prominence of Donald Trump in news media content (see here). I have recently updated that previous analysis. Briefly stated, no U.S. president in recent history has received a similar amount of media...
Artificial Ignorance
AI Roundup 093: Diminishing returns November 15, 2024.
a month ago
One Useful Thing
Automating creativity There is now strong evidence that AI can help make us more innovative.
a year ago
Sam Altman
How To Be Successful I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
15
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter. Here are 13 thoughts about how to achieve such outlier...
Weighty Thoughts
One Definite Sign of a Bad Startup Idea If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
Strange Loop Canon
What can LLMs never do? On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
8 months ago
One Useful Thing
My class required AI. Here's what I've learned so far. (Spoiler alert: it has been very successful, but there are some lessons to be learned)
a year ago
One Useful Thing
What people ask me most. Also, some answers. A FAQ of sorts
a year ago
Artificial Ignorance
Groq, Gemini, and 10x improvements As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When...
10 months ago
105
10 months ago
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When you scale your inputs (users, page views, messages, etc) by 10x, something breaks. Usually, it's something pretty fundamental. And the end result is that you need to replace a...
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
69
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
Artificial Ignorance
AI Roundup 088: Movie magic October 11, 2024.
3 months ago
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
AI Snake Oil
Is GPT-4 getting worse over time? A new paper going viral has been widely misinterpreted
a year ago
Society's Backend
What you need to understand about LLM creativity An simple overview of temperature and its effect on LLM output
8 months ago
Daniel Miessler
News, Analysis, and Discovery | NO. 356 SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
63
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
69
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
48
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
AI Snake Oil
AI safety is not a model property Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
10 months ago
96
10 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
Daniel Miessler
Stadia is Google’s Product Strategy Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
36
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI March 22, 2023.
9 months ago
IEEE Spectrum
The Top 7 Robotics Stories of 2024 2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said...
a week ago
21
a week ago
2024 was the best year ever for robotics, which I’m pretty sure is not something that I’ve ever said before. But that’s the great thing about robotics—it’s always new, and it’s always exciting. What may be different about this year is the real sense that not only is AI going to...
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024 The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
71
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Daniel Miessler
News & Analysis | NO. 353
over a year ago
Artificial Ignorance
AI Roundup 064: Big Tech's small models April 26, 2024.
8 months ago
The Berkeley...
Modeling Extremely Large Images with $x$T As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
106
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Strange Loop Canon
The agent principal problem "Show me the incentive and I will show you the outcome."
a year ago
Artificial Ignorance
AI Roundup 053: Bye bye Bard February 9, 2024.
11 months ago
Artificial Ignorance
AI Roundup 082: System prompts August 30, 2024.
4 months ago
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough. Opting out is the latest example of generative AI developers externalizing costs.
a year ago
The Gradient
Salmon in the Loop On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
52
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
One Useful Thing
What just happened A transformative month rewrites the capabilities of AI
3 weeks ago
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a month ago
10
a month ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
Artificial Ignorance
Workshop: Prompt Engineering for Claude Watch now | If you’ve ever wanted to level up your AI prompting skills, this is the workshop for...
3 months ago
Sam Altman
The United Slate I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
10
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state.  A team of aligned people has a chance to make a real change. I believe in creating prosperity...
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24] Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
6 months ago
50
6 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
One Useful Thing
Power and Weirdness: How to Use Bing AI Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
over a year ago
63
over a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
Artificial Ignorance
Small newsletters, big ideas A subscriber showcase full of hidden gems on Substack.
3 weeks ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing January 26, 2024.
11 months ago
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
65
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
Society's Backend
Ask Stupid Questions I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
38
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
Artificial Ignorance
AI Roundup 039: The governance issue November 3, 2023.
a year ago
Daniel Miessler
Using Custom Searches in Safari (in 2022) I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
33
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Rozado’s Visual...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of... Please be mindful of potential confounds: population density, population behavior, virus virulence...
over a year ago
The Gradient
Financial Market Applications of LLMs The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
71
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
102
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Artificial Ignorance
AI Zoology: Why are there so many animal models? Inside the emerging model menagerie.
a year ago
Weighty Thoughts
I'm writing a book! Why I've been gone over a month, and how you can help
a month ago
Society's Backend
All Machine Learning Resources and Updates 7/8/24 Everything I've been reading
6 months ago
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy How speculation gets laundered through pseudo-quantification
5 months ago
Matt Mazur
LearnGPT is now EmergentMind Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
50
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
Daniel Miessler
What Made the 90’s So Awesome? I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
61
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Rozado’s Visual...
Pessimism in News Media Headlines In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
69
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
AI Snake Oil
Is AI progress slowing down? Making sense of recent technology trends and claims
3 weeks ago
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there Contra Hoel on AI and its supply paradox
a year ago
Weighty Thoughts
Review of AI in 2024 and Updates Guest Post in AI Supremacy
2 hours ago
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
over a year ago
43
over a year ago
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
a month ago
37
a month ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
AI Snake Oil
New paper: AI agents that matter Rethinking AI agent benchmarking and evaluation
6 months ago
Artificial Ignorance
Milestones, motivations, and miscellany Some thoughts on the future of this newsletter.
6 months ago
Society's Backend
Founder Mode, How AI Impacts Education, Diffusion Models As Real-Time Game Engines, and More Machine learning resources and updates 2024-09-03
4 months ago
Artificial Ignorance
AI Roundup 060: Another CEO gone March 29, 2024.
9 months ago
Matt Mazur
Sharing small, incremental updates with users I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
35
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Artificial Ignorance
Workshop: Midjourney Masterclass with Daniel Nest “This is one of the only webinars where I've actually been glued to my screen for the entire time,...
4 months ago
55
4 months ago
“This is one of the only webinars where I've actually been glued to my screen for the entire time, not distracted by passing whimsies...
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Strange Loop Canon
Predicting AI I revisit past predictions
4 months ago
Stories by Andrej...
A Peek at Trends in Machine Learning
over a year ago
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
37
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good. Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Sam Altman
Project Covalence Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
over a year ago
16
over a year ago
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.  Science remains the...
Weighty Thoughts
Is AI a Winner-Take-All Market? A critical question for investors in AI
4 months ago
Artificial Ignorance
Stop begging for JSON How OpenAI's Structured Outputs makes building with AI much more reliable.
4 weeks ago
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received And how it changed my personal life too
a year ago
Weighty Thoughts
Writing, Originality, and Why Does Anyone Care What I Write About? Musings, Insecurities, and Thoughts on Writing a Book (or Substack)
2 weeks ago
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
a month ago
Society's Backend
5 Highlights From Society's Backend in 2024 The top 5 articles and resources
a week ago
Marcus on AI
An AI rumor you won’t want to miss Converging evidence that the core hypothesis driving generative AI may be wrong
a month ago
AI Snake Oil
On the Societal Impact of Open Foundation Models Adding precision to the debate on openness in AI
10 months ago
Society's Backend
Google Leads New AI Releases, OpenAI Gives First Glimpse of AGI with o3, AI Policy Will Be... Society's Backend Reading List 12-23-2024
2 weeks ago
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
49
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
Artificial Ignorance
Tutorial: How to chat with your documents A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
Marcus on AI
AI still lacks “common” sense, 70 years later What’s obvious to people still isn’t always obvious to machines
4 days ago
Artificial Ignorance
The AI research tool that saves me hours every week And why it might revolutionize the search industry.
a year ago
Artificial Ignorance
AI Roundup 033: DALL·E 3 September 22, 2023.
a year ago
Artificial Ignorance
From Stable Diffusion to Stable Everything Inside Stability AI's roster of AI models.
7 months ago
One Useful Thing
How to use AI to do practical stuff: A new guide People often ask me how to use AI. Here's an overview with lots of links.
a year ago
Weighty Thoughts
Consider the Llama Are closed source AI models doomed?
5 months ago
Sam Altman
The Merge A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
19
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075. People used to call this the...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
52
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
Strange Loop Canon
AI bill vetoed; what's next? Make AI regulations evidence based
3 months ago
One Useful Thing
A quick and sobering guide to cloning yourself It took me a few minutes to create a fake me giving a fake lecture.
a year ago
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested. On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
63
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks Non-proliferation only benefits incumbents
a year ago
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
2 months ago
7
2 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition August 9, 2024.
5 months ago
Andrej Karpathy blog
(started posting on Medium instead) The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
over a year ago
34
over a year ago
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but whenever I do get a chance to post something I have recently been defaulting to doing it on Medium because...
AI Snake Oil
People keep anthropomorphizing AI. Here’s why Companies and journalists both contribute to the confusion
a year ago
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
81
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Stories by Andrej...
CS183c Assignment #3
over a year ago
AI Snake Oil
Three Ideas for Regulating Generative AI Policy input to the federal government from a Stanford-Princeton team
a year ago
Weighty Thoughts
What I got Right or Wrong in 2020 Reflecting on the Past Year
over a year ago
Weighty Thoughts
Why ChatGPT Strawberry o1 (and other LLMs) will Never be Good at Diagnosis “Connectionist” vs. Knowledge-Based AI
3 months ago
Artificial Ignorance
AI Roundup 069: Project Greymatter May 31, 2024.
7 months ago
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
37
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Strange Loop Canon
Symposium: On Building God
a year ago
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
over a year ago
4
over a year ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); Increased efficiency can sometimes, counterintuitively, lead to worse outcomes. This is true almost everywhere. We will name...
Sam Altman
Funding for COVID-19 Projects I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
17
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help.  I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on: Producing a lot of ventilators or...
AI Snake Oil
Evaluating LLMs is a minefield Annotated slides from a recent talk
a year ago
Sam Altman
2017 YC Annual Letter Dear YC Community: In response to a comment on Hacker News, I’m going to try writing an annual...
over a year ago
12
over a year ago
Dear YC Community: In response to a comment on Hacker News, I’m going to try writing an annual letter to the YC community with an update on our progress. Our mission is to enable the most innovation of any company in the world in order to make the future great for everyone.  We...
Society's Backend
How to Use Benchmarks to Build Successful Machine Learning Systems And what benchmarks mean for real-world applications
5 months ago
One Useful Thing
Reshaping the tree: rebuilding organizations for AI Technological change brings organizational change.
a year ago
Daniel Miessler
The 2 Current Major AI Bottlenecks I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
42
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
65
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
Stories by Andrej...
AlphaGo, in context
over a year ago
Artificial Ignorance
AI Roundup 055: Race conditions February 23, 2023.
10 months ago
fast.ai
Mojo may be the biggest programming language advance in decades Mojo is a new programming language, based on Python, which fixes Python’s performance and deployment...
a year ago
Sam Altman
How To Invest In Startups There is a lot of advice about how to be a good startup founder.  But there isn’t very much about...
over a year ago
14
over a year ago
There is a lot of advice about how to be a good startup founder.  But there isn’t very much about how to be a good startup investor. Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
Strange Loop Canon
No, LLMs are not "scheming"
3 weeks ago
Matt Mazur
Looking to sell Emergent Mind I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
64
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
3 months ago
65
3 months ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
57
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Daniel Miessler
Custom Models Are AI’s Killer App The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
51
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
Marcus on AI
Update re: Microsoft and training data Relevant to the post I sent earlier today,...
a month ago
11
a month ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
9
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications And then there were two.
11 months ago
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing … glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on...
a year ago
22
a year ago
… glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr: The emerging LLM stack is composed of several elements centered...
fast.ai
A New Chapter for fast.ai: How To Solve It With Code fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
2 months ago
31
2 months ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Sam Altman
Helion Needs You Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
over a year ago
14
over a year ago
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator. The goals of the company are quite ambitious—clean, continuous energy for 1...
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse? Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Rozado’s Visual...
Which is the Wokest AI? A Wokeness Ranking of LLMs
10 months ago
Strange Loop Canon
Is AI hitting a wall?
3 weeks ago
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition AI systems have gotten more capable and easier to use
7 months ago
Daniel Miessler
My Prediction For Twitter I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
65
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Daniel Miessler
Podcast Audio Quality: AI-based Post-processing vs. Hardware I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much....
over a year ago
33
over a year ago
I’ve been podcasting since 2015 and got really into audio when the plague started. Like…too much. Anyway. I’ve been obsessed with podcast audio quality for years, and have been through so…many…iterations of my setup. I started with a Yeti (still a great mic). Did the...
fast.ai
A new old kind of R&D lab Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on...
a year ago
49
a year ago
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughs.
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
a year ago
80
a year ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
Matt Mazur
Emergent Mind finally went viral Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
69
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More Weekly updates and resources 7/29/24
5 months ago
One Useful Thing
How to... use AI to unstick yourself We often lose momentum because of something small. AI can help.
a year ago
Artificial Ignorance
AI Roundup 052: AI, EO, DPA February 2, 2024.
11 months ago
Artificial Ignorance
AI Roundup 038: Preparedness October 27, 2023.
a year ago
fast.ai
My family’s unlikely homeschooling journey Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba… SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
50
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
Daniel Miessler
Humiliation is Deadly
over a year ago
One Useful Thing
Assigning AI: Seven Ways of Using AI in Class Also prompts! And things to watch out for!
a year ago
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis… SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
43
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
Artificial Ignorance
I gave ChatGPT access to my Gmail I'm sure this will end well.
a year ago
Society's Backend
Why everyone loves Spider-Man Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Artificial Ignorance
What AI models really think about politics Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
2 months ago
Matt Mazur
Running Mistral 7B Instruct on a Macbook Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to...
a year ago
67
a year ago
Similar to yesterday’s post on running Mistral 8x7Bs Mixture of Experts (MOE) model, I wanted to document the steps I took to run Mistral’s 7B-Instruct-v0.2 model on a Mac for anyone else interested in playing around with it. Unlike yesterday’s post though, this 7B Instruct...
The Gradient
Why transformative artificial intelligence is really, really hard to achieve A collection of the best technical, social, and economic arguments Humans have a good track record...
a year ago
20
a year ago
A collection of the best technical, social, and economic arguments Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
One Useful Thing
Innovation through prompting Democratizing educational technology... and more
8 months ago
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
2 months ago
8
2 months ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task. This video is notable because it’s the first real look we’ve had at the new Atlas doing...
PromptArmor Blog
Slack AI data exfiltration from private channels via indirect prompt injection Authors: PromptArmor
4 months ago
Sam Altman
Quora I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
17
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other.  So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora. Quora is doing extremely well. They now...
Strange Loop Canon
Strange Loop Canon Commencement Address
5 months ago
One Useful Thing
One sentence. Prompting for maximum impact (and why that is a bad idea)
a year ago
Strange Loop Canon
Mind the Gap from empire to umpire
a year ago
Daniel Miessler
GPT and Search There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
40
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Daniel Miessler
Frontview Mirror: 2023 Edition This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
over a year ago
58
over a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
The Berkeley...
Goal Representations for Instruction Following Goal Representations for Instruction Following Figure title. Figure caption. This image is...
a year ago
89
a year ago
Goal Representations for Instruction Following Figure title. Figure caption. This image is centered and set to 50% page width. --> A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Society's Backend
Weekly Backend #4: 62 Total Resources Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
8 months ago
Society's Backend
Updates to Society's Backend New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and...
10 months ago
84
10 months ago
New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and more
Daniel Miessler
NO. 363 | FrontView Mirror: 2023 Edition New Content 💡FRONTVIEW MIRROR: 2023 EDITION  💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS...
over a year ago
51
over a year ago
New Content 💡FRONTVIEW MIRROR: 2023 EDITION  💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS BREACHES SECURITY NEWS In a bit of Deja Vu from LastPass, Okta has now revealed that attackers have stolen source code from its GitHub repositories. This comes after it was hit by...
AI Snake Oil
Tech policy is only frustrating 90% of the time That’s what makes it worthwhile
9 months ago
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem December 22, 2023.
a year ago
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with... TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
75
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image. Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Rozado’s Visual...
The Great Awokening as a Global Phenomenon The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
Matt Mazur
When LTD Purchasers Meet an Inactive User Policy Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo...
a year ago
32
a year ago
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo community. Maybe I’ll dive into my experience there in another post, but I wanted to share an interesting thing that’s happening now, a year after the deal ended. AppSumo has a policy...
Weighty Thoughts
Why did the Prior Generations of AI Fail? Diving into the History—Which is Kind of a Circle
3 months ago
Society's Backend
Weekly Backend #5: 55 Resources The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful...
8 months ago
49
8 months ago
The inner workings of transformers, Machine Learning Q and AI, machine learning classifies harmful viruses, and more
Artificial Ignorance
AI Roundup 037: The AI IPCC October 20, 2023.
a year ago
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
12
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
Artificial Ignorance
AI Roundup 050: Synthetic Geometry January 19, 2024.
11 months ago
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation? The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
47
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Sam Altman
E Pur Si Muove Earlier this year, I noticed something in China that really surprised me.  I realized I felt more...
over a year ago
17
over a year ago
Earlier this year, I noticed something in China that really surprised me.  I realized I felt more comfortable discussing controversial ideas in Beijing than in San Francisco.  I didn’t feel completely comfortable—this was China, after all—just more comfortable than at home. That...
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion 4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
16
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
56
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now .post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; ...
over a year ago
38
over a year ago
.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
The Gradient
Mamba Explained Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
9 months ago
58
9 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty. “Life can only be understood backwards, but it must be lived forwards.”
10 months ago
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon How your greatest asset is silently stolen by technology every day
a year ago
Society's Backend
Why Gemini's Struggles Aren't Straightforward And an overview of LLM security issues
9 months ago
The Gradient
Neural algorithmic reasoning In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
41
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
AI Snake Oil
A safe harbor for AI evaluation and red teaming An argument for legal and technical safe harbors for AI safety and trustworthiness research
10 months ago
Artificial Ignorance
AI Roundup 044: Google Gemini December 8, 2023.
a year ago
One Useful Thing
On speaking to AI Voice changes a lot of things
5 months ago
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 months ago
8
3 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. IROS 2024: 14–18 October 2024, ABU...
IEEE Spectrum
Video Friday: Happy Holidays! Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
39
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICRA 2025: 19–23 May 2025, ATLANTA,...
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
Artificial Ignorance
Saving the world with AI and government grants Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
6 months ago
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for... Society's Backend Reading List 10-28-2024
2 months ago