Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
Top Categories > AI
#all #programming #history #startups #technology #science #life #literature #architecture #travel #creative #design #comics #cartography #finance #AI #indiehacker Muted Categories [alt+←][alt+→]
Daniel Miessler
Humiliation is Deadly I’ve been thinking for a few years about the danger presented by humiliated people and groups. That...
over a year ago
47
over a year ago
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That is, people who not only feel like they have no respect and no options to gain any respect, but who also feel that: They deserve those things, and… That someone else is the cause of...
Made by Ollin
HintBot Hinting icons automatically with a neural network
over a year ago
Daniel Miessler
5 Things I’m Still Waiting for With the iPhone, Apple Watch, and AirPods I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty...
over a year ago
46
over a year ago
I just camped for the new lineup of Apple products, as I have every year since 2007, and I am pretty impressed. As many have said, this year was an incremental update. The iPhones look nearly identical. And so do the AirPods Pro 2. The exception was the Apple Watch Ultra, which...
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
over a year ago
37
over a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
Made by Ollin
Emojin An infinite kaomoji generator
over a year ago
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
9 months ago
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python .wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; ...
over a year ago
59
over a year ago
.wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; font-weight: 300; overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */ } .post pre, .post code { background-color: #fafafa; font-size: 13px; /*...
IEEE Spectrum
This Inventor Is Molding Tomorrow’s Inventors This article is part of our special report, “Reinventing Invention: Stories from Innovation’s...
a month ago
3
a month ago
This article is part of our special report, “Reinventing Invention: Stories from Innovation’s Edge.” Marina Umaschi Bers has long been at the forefront of technological innovation for kids. In the 2010s, while teaching at Tufts University, in Massachusetts, she codeveloped the...
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
72
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
Artificial Ignorance
AI Roundup 033: DALL·E 3 September 22, 2023.
a year ago
The Gradient
Why Doesn’t My Model Work? Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
49
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
Artificial Ignorance
AI Roundup 036: The money pit October 13, 2023.
a year ago
Artificial Ignorance
AI Roundup 091: Search wars November 1, 2024.
a month ago
Strange Loop Canon
AI bill vetoed; what's next? Make AI regulations evidence based
2 months ago
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications And then there were two.
10 months ago
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks Non-proliferation only benefits incumbents
a year ago
Weighty Thoughts
China's AI Journey Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Weighty Thoughts
What I got Right or Wrong in 2020 Reflecting on the Past Year
over a year ago
Artificial Ignorance
How to leverage long form content with AI Specific tools and tactics for authors, podcasters, and videographers.
6 months ago
Artificial Ignorance
Blade Runner 2024 Reddit's AI Hunters and the quest for authentic digital experiences.
3 months ago
IEEE Spectrum
Video Friday: Extreme Off-Road Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
3
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
Weighty Thoughts
Most AI startups are doomed Just because it matters doesn’t mean it’s defensible or profitable
a year ago
Society's Backend
All Machine Learning Resources and Updates 06/21/2024 Below are the machine learning resources and updates from the past few days you don't want to miss....
6 months ago
35
6 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Artificial Ignorance
How Intercom is transforming customer support with AI A conversation with Fergal Reid, VP of AI at Intercom.
8 months ago
Artificial Ignorance
Dealing with AI fatigue Notes for myself, and maybe you too.
10 months ago
Marcus on AI
Sora still appears to have trouble with physics Exactly as I warned in February
a week ago
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck You can’t just blindly extrapolate compute requirements
a year ago
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now .post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; ...
over a year ago
36
over a year ago
.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
Weighty Thoughts
The Fall of Data Moats AI actually makes most data moats weaker
a year ago
Society's Backend
I Enjoy Technical Interviews and You Can Too A simple change in mindset that completely changed the way I interview
a year ago
Strange Loop Canon
LLMs breach a threshold Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
4 months ago
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
over a year ago
2
over a year ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); Increased efficiency can sometimes, counterintuitively, lead to worse outcomes. This is true almost everywhere. We will name...
Society's Backend
OpenAI's o1, Model Merging, California Approves AI Regulation, and More Machine learning resources and updates 2024-09-17
3 months ago
Daniel Miessler
News & Analysis | NO. 351
over a year ago
Matt Mazur
Emergent Mind finally went viral Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
62
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Artificial Ignorance
How to reverse engineer the Substack (or any!) web API Building an unauthorized Substack client with Claude.
4 months ago
Daniel Miessler
NO. 369 | Reddit Hack, Deepfake Scams, Embracing Change… ✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank...
a year ago
62
a year ago
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank you! SECURITY Reddit has confirmed it was hacked, and it’s recommending users add 2FA. The attack started by phishing Reddit employees and stealing credentials and 2FA codes. After...
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon How your greatest asset is silently stolen by technology every day
a year ago
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
47
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Artificial Ignorance
AI Roundup 034: Meta Connect September 29, 2023
a year ago
Daniel Miessler
AI Art Will Push the Top 1% to Human Artists One effect I think we’ll see from all this AI-generated art is magnified status for those who insist...
over a year ago
41
over a year ago
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist on the opposite, i.e., manual, human art. The more manual the better. The more human the better. Ideally there’d only be one of whatever you have, and it’d only be yours. Why is...
The Berkeley...
Modeling Extremely Large Images with $x$T As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
93
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Weighty Thoughts
News Roundup: May 15, 2024 Open AI announcements, DeepSeek-v2, and TSMC Arizona
7 months ago
Made by Ollin
Bare-bones Diffusion Models
a year ago
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide Covering the state of play as of Summer, 2023
a year ago
Weighty Thoughts
One Definite Sign of a Bad Startup Idea If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
Artificial Ignorance
AI Roundup 061: The AI innovator's dilemma April 5, 2024.
8 months ago
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and... Society's Backend Reading List 12-2-2024
2 weeks ago
Artificial Ignorance
The intern and the coach A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
32
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
One Useful Thing
The future of education in a world of AI A positive vision for the transformation to come
a year ago
One Useful Thing
On the necessity of a sin Why treating AI like a person is the future
8 months ago
IEEE Spectrum
Forums, Competitions, Challenges: Inspiring Creativity in Robotics This is a sponsored article brought to you by Khalifa University of Science and Technology. A total...
2 months ago
3
2 months ago
This is a sponsored article brought to you by Khalifa University of Science and Technology. A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the...
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards Counterintuitively, start from how much money you need
over a year ago
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴ Siri versus the machine god?
6 months ago
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
81
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Artificial Ignorance
AI Roundup 027: Challenge accepted August 11, 2023
a year ago
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy How speculation gets laundered through pseudo-quantification
4 months ago
Society's Backend
Godmother of AI Warns Against Regulation, Apple Intelligence System Prompts, Faster and Cheaper AI,... Machine learning resources and updates 8/12/2024
4 months ago
Artificial Ignorance
AI Roundup 044: Google Gemini December 8, 2023.
a year ago
Sam Altman
GPT-4o There are two things from our announcement today I wanted to highlight. First, a key part of our...
7 months ago
106
7 months ago
There are two things from our announcement today I wanted to highlight. First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
The Gradient
Neural algorithmic reasoning In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
38
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
One Useful Thing
AI is not good software. It is pretty good people. A pragmatic approach to thinking about AI
a year ago
Sam Altman
The United Slate I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
8
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state.  A team of aligned people has a chance to make a real change. I believe in creating prosperity...
Daniel Miessler
Frontview Mirror: 2023 Edition This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
54
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
Chinese AI is Less Expensive, What it's Like to Work in AI, an Evaluation Framework for Voice... Society's Backend Reading List 11-18-2024
a month ago
Artificial Ignorance
AI Roundup 087: DevDay SF October 4, 2024.
2 months ago
Marcus on AI
An AI rumor you won’t want to miss Converging evidence that the core hypothesis driving generative AI may be wrong
a month ago
Artificial Ignorance
AI Roundup 073: Music make you lose control June 28, 2024.
5 months ago
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
2 months ago
3
2 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
One Useful Thing
How to use AI to do practical stuff: A new guide People often ask me how to use AI. Here's an overview with lots of links.
a year ago
The Gradient
An Introduction to the Problems of AI Consciousness Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
33
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
One Useful Thing
The Homework Apocalypse Fall is going to be very different this year. Educators need to be ready.
a year ago
Matt Mazur
Indie Hacking Week 1 Recap: Starting TimelineGPT, Ending LearnGPT Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good...
a year ago
45
a year ago
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good groove as far as my daily routine, but I don’t think it’s quite sunk in yet how much flexibility I have in terms of my daily schedule. For example, I’m still waking up early to […]
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and... Society's Backend Reading List 11-04-2024
a month ago
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
17
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
Strange Loop Canon
We all live on a knife's edge, and it's fine Or: How we weaponised serendipity
8 months ago
Marcus on AI
Casey (Newton) Strikes Out His continued skepticism of AI skepticism continues to miss the mark
a week ago
Society's Backend
Weekly Backend #4: 62 Total Resources Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
8 months ago
Strange Loop Canon
Why AI hasn’t shown up in the GDP statistics yet AI is meant to bring us closer to utopia, according to its builders.
4 months ago
Daniel Miessler
NO. 363 | FrontView Mirror: 2023 Edition New Content 💡FRONTVIEW MIRROR: 2023 EDITION  💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS...
a year ago
48
a year ago
New Content 💡FRONTVIEW MIRROR: 2023 EDITION  💡MY PHILOSOPHY AND RECOMMENDATIONS ON THE LASTPASS BREACHES SECURITY NEWS In a bit of Deja Vu from LastPass, Okta has now revealed that attackers have stolen source code from its GitHub repositories. This comes after it was hit by...
IEEE Spectrum
Where’s My Robot? See the interactive version of this story on our site →
a month ago
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
3
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
Andrej Karpathy blog
A Survival Guide to a PhD This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
35
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
34
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Artificial Ignorance
The AI research tool that saves me hours every week And why it might revolutionize the search industry.
11 months ago
Daniel Miessler
My Prediction For Twitter I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
58
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Society's Backend
The Metrics Machine Learning Engineers Care About That Modelers Don't And a brief overview of TPUs in Google data centers
9 months ago
Artificial Ignorance
AI Roundup 026: AudioCraft August 4, 2023
a year ago
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
16
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
IEEE Spectrum
Unlock the Power of Agile for Hardware Teams The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware...
6 days ago
6
6 days ago
The Modified Agile for Hardware Development (MAHD) Framework is the ultimate solution for hardware teams seeking the benefits of Agile without the pitfalls of applying software-centric methods. Traditional development approaches, like waterfall, often result in delayed timelines,...
Weighty Thoughts
VC Office Hours Talk to James Wang, author of Weighty Thoughts and General Partner of Creative Ventures
10 months ago
AI Snake Oil
Does the UK’s liver transplant matching algorithm systematically exclude younger patients? Seemingly minor technical decisions can have life-or-death effects
a month ago
Artificial Ignorance
AI Roundup 064: Big Tech's small models April 26, 2024.
8 months ago
Society's Backend
The Slow, Painful Death of the Free Content Creator It's happening as you read this
a year ago
Sam Altman
The Virus Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
12
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19. I hope that society views this as a warning for the future.  Covid-19 is bad, but only a warm-up.  I think it’s...
Matt Mazur
The Kenya Quick Answer Goes Viral, Again On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
85
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
fast.ai
Qualitative humanities research is crucial to AI Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
13
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
Marcus on AI
Update re: Microsoft and training data Relevant to the post I sent earlier today,...
3 weeks ago
4
3 weeks ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
One Useful Thing
The shape of the shadow of The Thing We can start to see, dimly, what the near future of AI looks like.
a year ago
Society's Backend
MASSIVE New Model Releases from Google, OpenAI, and Meta Change the AI Landscape Society's Backend Reading List 12-16-2024
6 days ago
One Useful Thing
The practical guide to using AI to do stuff A resource for students in my classes (and other interested people).
a year ago
Society's Backend
Why everyone loves Spider-Man Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Society's Backend
Run Your Own Race What Bluey can teach us about machine learning
8 months ago
One Useful Thing
I, Cyborg: Using Co-Intelligence How I used AI in my book about AI
9 months ago
Artificial Ignorance
Stop begging for JSON How OpenAI's Structured Outputs makes building with AI much more reliable.
a week ago
Daniel Miessler
News, Analysis, and Discovery | NO. 356 SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
56
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
fast.ai
A New Chapter for fast.ai: How To Solve It With Code fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
24
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Rozado’s Visual...
The Great Awokening as a Global Phenomenon The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
Matt Mazur
LearnGPT is now EmergentMind Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
45
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
Matt Mazur
Sharing small, incremental updates with users I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
33
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Strange Loop Canon
The age of access the great polarisation theory, and the death of professions
a year ago
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter Democratizing data analysis with AI
a year ago
Weighty Thoughts
When the AI Bubble Bursts It’s when, not if, for these kinds of new technologies
6 months ago
Weighty Thoughts
What is Defensibility? Back to basics for AI startups and others
8 months ago
One Useful Thing
Not much is changing, a lot is changing OpenAI, Microsoft, and the OpenOffspring
a year ago
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones The hand wringing about failures of model alignment is misguided
a year ago
The Berkeley...
Koala: A Dialogue Model for Academic Research In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
a year ago
57
a year ago
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
One Useful Thing
Getting started with AI: Good enough prompting Don't make this hard
4 weeks ago
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning You probably know more about machine learning math than you think
10 months ago
One Useful Thing
Blinded by Analogies What is this AI thing? The wrong model can lead us astray
a year ago
Matt Mazur
It’s Time to Build It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
94
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
The Gradient
Do text embeddings perfectly encode text? 'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
9 months ago
49
9 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Sam Altman
Join the YC Software Team If you want to get funded by YC as a founder in the future, but you don't have a startup that's...
over a year ago
9
over a year ago
If you want to get funded by YC as a founder in the future, but you don't have a startup that's ready for that yet, joining the YC software team is a great hack to get there. The YC software team is a small group of hackers in SF that write the software that makes all the parts...
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
fast.ai
AI Harms are Societal, Not Just Individual In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
8
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
78
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text. Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Society's Backend
LLM-as-a-Judge, Instruction Pretraining, Solving Benchmarks Instead of Real-World ML Problems, and... Weekly updates and resources 7/22/24
5 months ago
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
42
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
Matt Mazur
Going Full Time on My SaaS After 13 Years In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
a year ago
35
a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
One Useful Thing
Secret Cyborgs: The Present Disruption in Three Papers The future is already here, we just need to figure out a few details.
a year ago
Artificial Ignorance
AI Roundup 042: sama drama November 24, 2023.
a year ago
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps I keep getting fooled by AI, and it seems like others are, too.
a year ago
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse? Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
54
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Strange Loop Canon
People want competence, seemingly over everything else All elections are about state capacity
a month ago
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
32
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
Society's Backend
An AI Revolution Isn't Coming - We're Already In It A small showcase of companies using AI in ways that will change your life
a year ago
Society's Backend
The Problem with American Emergency Alerts In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
29
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
AI Snake Oil
Is GPT-4 getting worse over time? A new paper going viral has been widely misinterpreted
a year ago
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1) Part 1: What is an agent, and how do they work?
a year ago
Daniel Miessler
Your Experience is Your Creativity Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
51
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Sam Altman
Greg A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg...
over a year ago
8
over a year ago
A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg Brockman. Every successful startup I know has at least one person who provides the force of will to make the startup happen.  I’d thought a lot about this in the abstract while advising YC...
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received And how it changed my personal life too
12 months ago
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave November 8, 2024.
a month ago
Artificial Ignorance
Funding a new generation of AI companies Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
11 months ago
Daniel Miessler
Using Custom Searches in Safari (in 2022) I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
30
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air “Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
2 weeks ago
4
2 weeks ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat November 22, 2024.
a month ago
One Useful Thing
Gradually, then Suddenly: Upon the Threshold Small improvements can lead to big changes
5 months ago
One Useful Thing
Change blindness 21 months later
4 months ago
Society's Backend
Top 10 Machine Learning Resources and Updates 06/14/2024 A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
6 months ago
Weighty Thoughts
Let’s Talk About AI Compute What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
The Berkeley...
Goal Representations for Instruction Following Goal Representations for Instruction Following Figure title. Figure caption. This image is...
a year ago
86
a year ago
Goal Representations for Instruction Following Figure title. Figure caption. This image is centered and set to 50% page width. --> A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good. Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Artificial Ignorance
AI Roundup 069: Project Greymatter May 31, 2024.
6 months ago
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat." What we can learn from a completely AI written & illustrated lecture
a year ago
Andrej Karpathy blog
Biohacking Lite Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew...
over a year ago
29
over a year ago
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that (“mom said”-) level of abstraction. I also knew that I can probably get away with...
Society's Backend
What Apple Intelligence Means for You "We think you're gonna LOVE it"
6 months ago
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
34
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...
IEEE Spectrum
Video Friday: Robot Dog Handstand Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
4
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
over a year ago
38
over a year ago
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
Matt Mazur
Full Time Indie Hacking: Month 5 Update At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
93
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
AI Snake Oil
What is algorithmic amplification and why should we care? A symposium and a primer on social media recommendation algorithms
a year ago
Artificial Ignorance
AI Roundup 031: Think of the children September 8, 2023
a year ago
The Berkeley...
2024 BAIR Graduate Directory Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most...
9 months ago
79
9 months ago
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most talented and innovative minds in artificial intelligence and machine learning. Our Ph.D. graduates have each expanded the frontiers of AI research and are now ready to embark on new...
Society's Backend
Welcome to 2024: The Year Where AI is No Longer an Option Why everyone should learn about machine learning
11 months ago
Artificial Ignorance
Groq, Gemini, and 10x improvements As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When...
10 months ago
96
10 months ago
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When you scale your inputs (users, page views, messages, etc) by 10x, something breaks. Usually, it's something pretty fundamental. And the end result is that you need to replace a...
Andrej Karpathy blog
Short Story on AI: Forward Pass p { text-align: justify; } .post pre, .post code { border: none; background-color:...
over a year ago
33
over a year ago
p { text-align: justify; } .post pre, .post code { border: none; background-color: #eee; } The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Artificial Ignorance
AI Roundup 082: System prompts August 30, 2024.
3 months ago
Society's Backend
OpenAI’s Blunder is a Loss for the ML Community The timeline and why OpenAI’s actions are a big deal
7 months ago
Marcus on AI
Two visions of AI’s future It’s not looking good
2 weeks ago
Rozado’s Visual...
Mentions of Political Extremism in English Wikipedia A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader...
a week ago
16
a week ago
A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader societal/historical dynamics?
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
38
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray... Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
38
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
One Useful Thing
The Lazy Tyranny of the Wait Calculation Taking AI timelines seriously
11 months ago
Weighty Thoughts
Who’s Winning the AI War? All of us, except the AI startups and VCs—unless a real war breaks out
11 months ago
Artificial Ignorance
AI Roundup 098: Flash Thinking December 20, 2024.
2 days ago
Matt Mazur
“Monthly Billed Annually” is Cursed Copy There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS...
a year ago
77
a year ago
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS for not refunding an accidental annual payment he made on their service. He intended to purchase the monthly plan, but due to an unclear UI and poor copy, he unintentionally...
The Berkeley...
Interactive Fleet Learning Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
54
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time. In the last few years we have seen an exciting development in robotics and artificial...
Society's Backend
Why Software Engineers Need to Understand Machine Learning And how ML helps software engineers in their daily work
6 months ago
Strange Loop Canon
Life in India is a series of bilateral negotiations finding the new equilibrium for the next superpower
2 months ago
Daniel Miessler
The UL Boost Protocol This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe...
over a year ago
53
over a year ago
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe Already a member? Login
One Useful Thing
A quick and sobering guide to cloning yourself It took me a few minutes to create a fake me giving a fake lecture.
a year ago
Strange Loop Canon
State of the Canon Onwards
11 months ago
Sam Altman
2017 YC Annual Letter Dear YC Community: In response to a comment on Hacker News, I’m going to try writing an annual...
over a year ago
10
over a year ago
Dear YC Community: In response to a comment on Hacker News, I’m going to try writing an annual letter to the YC community with an update on our progress. Our mission is to enable the most innovation of any company in the world in order to make the future great for everyone.  We...
One Useful Thing
Thinking companion, companion for thinking Some simple ways to use AI to break you out of biases
a year ago
Artificial Ignorance
LLMs are getting dumber and we have no idea why Five theories that could explain how chatbots are getting worse.
3 months ago
AI Snake Oil
Quantifying ChatGPT’s gender bias Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Marcus on AI
A new AI scaling law shell game? Scaling laws were supposed to be, well, laws.
4 weeks ago
Matt Mazur
Introducing Preceden’s new AI-Powered Timeline Generator For the past few months I’ve been heads down building an AI-powered timeline generator tool for...
a year ago
55
a year ago
For the past few months I’ve been heads down building an AI-powered timeline generator tool for Preceden, my SaaS timeline maker software: The tool – which is free to use and available on Preceden’s homepage – lets you type in a topic or detailed description of a timeline and it...
Daniel Miessler
Something is Up With Meritocracy I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
46
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels --> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
40
over a year ago
--> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Society's Backend
All Machine Learning Resources and Updates 06/14/2024 Below are all machine learning resources and updates from the past week you don't want to miss. I’ve...
6 months ago
44
6 months ago
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve decided to try out separating paid/free updates. I’m constantly trying new ways to make information consumption easier for you while working within the confines of the platforms...
Made by Ollin
Mac Replacement Icons A standardized, simplified, and beautiful icon set
over a year ago
Artificial Ignorance
AI Roundup 080: Grok 2 August 16, 2024.
4 months ago
One Useful Thing
Using AI to make teaching easier & more impactful Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there Contra Hoel on AI and its supply paradox
a year ago
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and... Society's Backend Reading List 11-11-2024
a month ago
Daniel Miessler
Custom Models Are AI’s Killer App The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
48
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
Sam Altman
American Equity I’d like feedback on the following idea. I think that every adult US citizen should get an annual...
over a year ago
11
over a year ago
I’d like feedback on the following idea. I think that every adult US citizen should get an annual share of the US GDP. I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
a month ago
4
a month ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task. This video is notable because it’s the first real look we’ve had at the new Atlas doing...
Rozado’s Visual...
What is the IQ of ChatGPT? Making an AI model take an IQ test
over a year ago
Artificial Ignorance
AI's invisible instructions What meme prompts can teach us about better interface design.
2 months ago
Artificial Ignorance
AI Roundup 084: Strawberry / o1 September 13, 2024.
3 months ago
Sam Altman
PG and Jessica A lot of people want to replicate YC in some other industry or some other place or with some other...
over a year ago
15
over a year ago
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
Artificial Ignorance
Bridging AI and human creativity A conversation with Harrison Telyan, co-founder of NUMI.
10 months ago
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good. Turning models into products runs into five challenges
4 months ago
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
52
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Artificial Ignorance
Pitfalls of building with large language models Dealing with more than just hallucinations.
a year ago
Rozado’s Visual...
Pessimism in News Media Headlines In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
65
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
Rozado’s Visual...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of... Please be mindful of potential confounds: population density, population behavior, virus virulence...
over a year ago
IEEE Spectrum
Robot Photographer Takes the Perfect Picture Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
4 weeks ago
4
4 weeks ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
9 months ago
Society's Backend
The Method Google Used to Reduce LLM Size by 66% A brief overview of knowledge distillation and its capabilities
5 months ago
Strange Loop Canon
Slouching Towards Utopia by Brad DeLong
a year ago
Society's Backend
JAX is for More Than Just Machine Learning What JAX is and its potential applications
6 months ago
AI Snake Oil
Is Avoiding Extinction from AI Really an Urgent Priority? The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
Sam Altman
Helion I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
over a year ago
10
over a year ago
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen. David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Daniel Miessler
Companies as Alaskan Fishing Boats What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest...
over a year ago
42
over a year ago
What if companies are supposed to be like Alaskan fishing boats? You know, the kind on The Deadliest Catch. So you have this tiny crew of total badasses. Everyone is a superhero at their particular role because the crew needs to stay extremely small to protect profits. The...
Andrej Karpathy blog
A Recipe for Training Neural Networks Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
over a year ago
27
over a year ago
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
AI Snake Oil
AI Snake Oil is now available to preorder What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
fast.ai
GPT 4 and the Uncharted Territories of Language Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
15
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
AI Snake Oil
Generative AI companies must publish transparency reports The debate about the harms of AI is happening in a data vacuum
a year ago
One Useful Thing
Acceleration. 7 days of new AI technologies shows us that everything is happening very fast.
a year ago
Sam Altman
Quora I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
14
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other.  So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora. Quora is doing extremely well. They now...
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
50
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Marcus on AI
𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁... Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course...
5 hours ago
Stories by Andrej...
CS183c Assignment #3
over a year ago
Artificial Ignorance
AI Roundup 086: Llama 3.2 September 27, 2024.
2 months ago
PromptArmor Blog
Coming soon This is PromptArmor Blog.
a year ago
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
3 months ago
46
3 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
Matt Mazur
When you ship a major bug before signing off for the day For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
35
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention --> Figure 1: CoarsenConf architecture. (I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
54
a year ago
--> Figure 1: CoarsenConf architecture. (I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Sam Altman
How To Be Successful I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
over a year ago
13
over a year ago
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter. Here are 13 thoughts about how to achieve such outlier...
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
7 months ago
103
7 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition A simple answer, and then a less simple one.
a year ago
AI Snake Oil
Are open foundation models actually more risky than closed ones? A policy brief on open foundation models
a year ago
Artificial Ignorance
Honey, I joined a cabal Or: Mainstream media still isn't great at covering tech and AI ideologies
6 months ago
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
58
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
Artificial Ignorance
AI Roundup 037: The AI IPCC October 20, 2023.
a year ago
One Useful Thing
An AI Haunted World Intelligence, everywhere.
a year ago
Artificial Ignorance
10 of the most impactful AI stories of 2023 A quick look back on a very busy year in AI.
a year ago
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
a month ago
29
a month ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric...
a year ago
63
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
One Useful Thing
AI in organizations: Some tactics Meet the Lab and the Crowd
2 months ago
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion 4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
12
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Artificial Ignorance
AI Roundup 053: Bye bye Bard February 9, 2024.
10 months ago
Daniel Miessler
Would You Put AI Art In Your House? I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
73
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Strange Loop Canon
Is AI hitting a wall?
a week ago
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs The future of entertainment is going to be a wild ride.
9 months ago
AI Snake Oil
A safe harbor for AI evaluation and red teaming An argument for legal and technical safe harbors for AI safety and trustworthiness research
9 months ago
Daniel Miessler
My Mom Died on Saturday My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
44
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too) Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
One Useful Thing
Freeing the chatbot Intelligence, of a sort, is going to be all around us
7 months ago
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
11 months ago
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Weighty Thoughts
Scaling is a Choice Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
43
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
19
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
Rozado’s Visual...
DepolarizingGPT A Political Chatbot that Gives 3 Politically Diverse Answers to Every Prompt
a year ago
Marcus on AI
ChatGPT, at Age Two The bullshit just keeps on coming.
3 weeks ago
Artificial Ignorance
AI Roundup 057: Claude 3 March 8, 2024.
9 months ago
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW) (Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we...
a year ago
12
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
44
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
fast.ai
From Deep Learning Foundations to Stable Diffusion We’ve released our new course with over 30 hours of video content.
a year ago
Artificial Ignorance
AI Roundup 081: Creative differences August 23, 2024.
4 months ago
Artificial Ignorance
GPT-4o and the illusion of AGI Why speed and multimodality is becoming the name of the game.
7 months ago
Society's Backend
Coming soon! Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
26
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
One Useful Thing
What just happened A transformative month rewrites the capabilities of AI
3 days ago
fast.ai
The Jupyter+git problem is now solved Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
12
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
40
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
AI Snake Oil
On the Societal Impact of Open Foundation Models Adding precision to the debate on openness in AI
9 months ago
Made by Ollin
Maple Diffusion I ported Stable Diffusion to my phone
over a year ago
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with... TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
72
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image. Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
One Useful Thing
What OpenAI did A new model opens up new possibilities
7 months ago
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
over a year ago
45
over a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Society's Backend
MatMul-free Machine Learning Can Improve Efficiency, Excellent Foundational Learning Resources, SSMs... The top 10 most important updates of last week: 7/8/24
5 months ago
One Useful Thing
Superhuman: What can AI do in 30 minutes? AI multiplies your efforts. I found out by how much...
a year ago
Sam Altman
Researchers and Founders I spent many years working with founders and now I work with researchers. Although there are always...
over a year ago
12
over a year ago
I spent many years working with founders and now I work with researchers. Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
One Useful Thing
In Praise of Boring AI Automation has always been about killing tedious work. AI can do the same.
a year ago
IEEE Spectrum
This Mobile 3D Printer Can Print Directly on Your Floor Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then...
a month ago
2
a month ago
Waiting for each part of a 3D-printed project to finish, taking it out of the printer, and then installing it on location can be tedious for multi-part projects. What if there was a way for your printer to print its creation exactly where you needed it? That’s the promise of...
IEEE Spectrum
Fish-Inspired Sensor "Touches" Using Electric Fields The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s...
a week ago
4
a week ago
The ability to detect a nearby presence without seeing or touching it may sound fantastical—but it’s a real ability that some creatures have. A family of African fish known as Mormyrids are weakly electric, and have special organs that can locate a nearby prey, whether it’s in...
Strange Loop Canon
Evaluations are all we need On analysing talent in LLMs
11 months ago
Artificial Ignorance
I gave ChatGPT access to my Gmail I'm sure this will end well.
a year ago
Weighty Thoughts
Apple Wins Apple Intelligence and aggregation puts Apple in a dominant AI position
6 months ago
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
34
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
3 months ago
52
3 months ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report And my notes on why they’re important
8 months ago
Sam Altman
How To Invest In Startups There is a lot of advice about how to be a good startup founder.  But there isn’t very much about...
over a year ago
11
over a year ago
There is a lot of advice about how to be a good startup founder.  But there isn’t very much about how to be a good startup investor. Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
Society's Backend
Weekly Backend #7: 39 Resources and Updates GPT-4o, Google I/O, Fugaku LLM, Prep for Machine Learning Interviews, and more
7 months ago
Artificial Ignorance
Tutorial: How to build an AI agent (Part 2) Part 2: Giving our agent internet access.
a year ago
One Useful Thing
Confronting Impossible Futures We shouldn't be certain about what is next, but we should plan for it
5 months ago
Artificial Ignorance
AI Roundup 066: AlphaFold 3 May 10, 2024.
7 months ago
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
11 months ago
76
11 months ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
The Gradient
The Artificiality of Alignment This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk”...
a year ago
35
a year ago
This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
30
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Society's Backend
Taking the AI to Consumers The Google Pixel 8 Pro is a much bigger deal than you think
a year ago
Strange Loop Canon
Symposium: On Building God
a year ago