One Useful Thing
How to... use AI to unstick yourself
We often lose momentum because of something small. AI can help.
a year ago
We often lose momentum because of something small. AI can help.
Strange Loop Canon
State of the Canon
Onwards
a year ago
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24]
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
6 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
One Useful Thing
Magic for English Majors
Programming in prose in an AI-haunted world
a year ago
Programming in prose in an AI-haunted world
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received
And how it changed my personal life too
a year ago
And how it changed my personal life too
The Gradient
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
10 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Society's Backend
Anti-Social Media
How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
over a year ago
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
Artificial Ignorance
AI Roundup 045: Google's just getting started
December 15, 2023.
a year ago
Artificial Ignorance
I gave ChatGPT access to my Gmail
I'm sure this will end well.
a year ago
I'm sure this will end well.
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
IEEE Spectrum
Where’s My Robot?
See the interactive version of this story on our site →
2 months ago
See the interactive version of this story on our site →
Artificial Ignorance
10 of the most impactful AI stories of 2023
A quick look back on a very busy year in AI.
a year ago
A quick look back on a very busy year in AI.
Artificial Ignorance
The subscriptionization of AI
Navigating the paid AI landscape.
10 months ago
Navigating the paid AI landscape.
Andrej Karpathy blog
Self-driving as a case study for AGI
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
a year ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
11 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
Marcus on AI
AI influencer hype gone wild
Reality is quite the opposite
2 months ago
Reality is quite the opposite
Weighty Thoughts
The AI Executive Order
AKA: “We’ll do something about it later”
a year ago
AKA: “We’ll do something about it later”
Strange Loop Canon
OpenAI's Strawberry models can reason like an expert
When models can think
4 months ago
Andrej Karpathy blog
A Recipe for Training Neural Networks
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
over a year ago
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
Artificial Ignorance
Tutorial: How to streamline your writing process with Whisper and GPT-4
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
8 months ago
These Python scripts help me write 3x faster and go from loose ideas to first draft in minutes.
Artificial Ignorance
AI Roundup 050: Synthetic Geometry
January 19, 2024.
a year ago
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan.
Fantastic writeup of my views today at The Wall Street Journal:
a month ago
Fantastic writeup of my views today at The Wall Street Journal:
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Society's Backend
Top 10 Machine Learning Resources and Updates 06/14/2024
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
7 months ago
A new AI employee, a four hour video on recreating GPT-2, meritocracy at Scale, and more
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
a year ago
Something to do with logs and probabilities.
Artificial Ignorance
AI Roundup 054: Ten million tokens
February 16, 2024.
11 months ago
Matt Mazur
Screw it, I’m Keeping Emergent Mind
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
Sam Altman
Funding for COVID-19 Projects
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help. I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on:
Producing a lot of ventilators or...
Society's Backend
All Machine Learning Resources and Updates 06/21/2024
Below are the machine learning resources and updates from the past few days you don't want to miss....
7 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
AI Snake Oil
Introducing the REFORMS checklist for ML-based science
ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
ML-based science is in trouble. Clear reporting standards for researchers could help.
Andrej Karpathy blog
Short Story on AI: A Cognitive Discontinuity.
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind...
over a year ago
p {
text-align: justify;
}
The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at a story, and what better way to kick things off than with a story on AI and what that might look like if you...
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering
And isn't that we're all going to lose our jobs
10 months ago
And isn't that we're all going to lose our jobs
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
over a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
over a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
fast.ai
In defense of screen time
Pundits say my husband and I are parenting wrong.
2 months ago
Pundits say my husband and I are parenting wrong.
One Useful Thing
What OpenAI did
A new model opens up new possibilities
8 months ago
A new model opens up new possibilities
Artificial Ignorance
Workshop: Midjourney Masterclass with Daniel Nest
“This is one of the only webinars where I've actually been glued to my screen for the entire time,...
4 months ago
“This is one of the only webinars where I've actually been glued to my screen for the entire time, not distracted by passing whimsies...
Artificial Ignorance
From Stable Diffusion to Stable Everything
Inside Stability AI's roster of AI models.
8 months ago
Inside Stability AI's roster of AI models.
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Strange Loop Canon
Mind the Gap
from empire to umpire
a year ago
Artificial Ignorance
AI Roundup 087: DevDay SF
October 4, 2024.
3 months ago
Weighty Thoughts
Consider the Llama
Are closed source AI models doomed?
6 months ago
Are closed source AI models doomed?
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
7 months ago
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
over a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
One Useful Thing
Acceleration.
7 days of new AI technologies shows us that everything is happening very fast.
a year ago
7 days of new AI technologies shows us that everything is happening very fast.
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
AI Snake Oil
Generative AI companies must publish transparency reports
The debate about the harms of AI is happening in a data vacuum
a year ago
The debate about the harms of AI is happening in a data vacuum
One Useful Thing
Reshaping the tree: rebuilding organizations for AI
Technological change brings organizational change.
a year ago
Technological change brings organizational change.
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
fast.ai
Practical Deep Learning for Coders 2022
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
over a year ago
A complete from-scratch rewrite of fast.ai’s most popular course, that’s been 2 years in the making.
Rozado’s Visual...
Pessimism in News Media Headlines
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
Marcus on AI
The Five Stages of AGI Grief
And a look at how people keep trying to redefine (or even revoke) the goalposts of what Artificial...
2 weeks ago
And a look at how people keep trying to redefine (or even revoke) the goalposts of what Artificial General Intelligence means.
Matt Mazur
Introducing Preceden’s new AI-Powered Timeline Generator
For the past few months I’ve been heads down building an AI-powered timeline generator tool for...
a year ago
For the past few months I’ve been heads down building an AI-powered timeline generator tool for Preceden, my SaaS timeline maker software: The tool – which is free to use and available on Preceden’s homepage – lets you type in a topic or detailed description of a timeline and it...
Society's Backend
New Evals for Better Models, AI Research Papers Made Easier to Understand, Train Your Own Flux LoRA,...
Machine learning highlights and resources 9-23-24
4 months ago
Machine learning highlights and resources 9-23-24
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
The Berkeley...
Are We Ready for Multi-Image Reasoning? Launching VHs: The Visual Haystacks Benchmark!
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving...
6 months ago
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving artificial general intelligence (AGI). Over the decades, AI researchers have developed Visual Question Answering (VQA) systems to interpret scenes within single images and answer...
Society's Backend
An AI Revolution Isn't Coming - We're Already In It
A small showcase of companies using AI in ways that will change your life
a year ago
A small showcase of companies using AI in ways that will change your life
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
over a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
Strange Loop Canon
I wrote a book!
AI enables us to, finally, get "soft" APIs
a year ago
AI enables us to, finally, get "soft" APIs
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
Sam Altman
The Strength of Being Misunderstood
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
over a year ago
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question.
Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
a year ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
Sam Altman
Keep the Internet Open
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon.
The internet is a public good, and I believe access should be a basic right. We've seen such great innovation in software because the internet has...
Weighty Thoughts
Writing, Originality, and Why Does Anyone Care What I Write About?
Musings, Insecurities, and Thoughts on Writing a Book (or Substack)
a month ago
Musings, Insecurities, and Thoughts on Writing a Book (or Substack)
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones
The hand wringing about failures of model alignment is misguided
a year ago
The hand wringing about failures of model alignment is misguided
Weighty Thoughts
From 6 Weeks to 600 Seconds (or Less)
The revolutionary potential of utilizing AI for electronic hardware design
3 weeks ago
The revolutionary potential of utilizing AI for electronic hardware design
Daniel Miessler
Summary: Andrej Kaparthy on Lex Fridman’s Podcast (Late 2022)
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My...
a year ago
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My One-Sentence Summary/Highlight The future of programming is not humans writing code, but neural nets creating weights. Capture Neural networks are mathematical expressions with many...
Daniel Miessler
Why Apple Keeps Winning
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
One Useful Thing
Four Singularities for Research
The rise of AI is creating both crisis and opportunity
8 months ago
The rise of AI is creating both crisis and opportunity
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
3 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
Rozado’s Visual...
The Great Awokening as a Global Phenomenon
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
9 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Artificial Ignorance
10 AI predictions for 2024
Hey Siri, set a reminder for 365 days.
a year ago
Hey Siri, set a reminder for 365 days.
Weighty Thoughts
One Definite Sign of a Bad Startup Idea
If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
If you can’t tell anyone about your startup idea, it's not a good idea
Society's Backend
Digitizing Smell, Automatic Prompt Optimization, Targeted AI Regulation, an Intro to AI Agents, and...
Society's Backend Reading List 11-04-2024
2 months ago
Society's Backend Reading List 11-04-2024
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
6 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Sam Altman
What I Wish Someone Had Told Me
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started.
Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
Made by Ollin
Game Emulation via Neural Network
over a year ago
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse?
Providing a technical perspective for a more educated assessment of a complaint I hear quite...
3 months ago
Providing a technical perspective for a more educated assessment of a complaint I hear quite frequently
Society's Backend
Things Everyone Should Understand About the Stanford AI Index Report
And my notes on why they’re important
9 months ago
And my notes on why they’re important
One Useful Thing
Using AI to make teaching easier & more impactful
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
a year ago
Here are five strategies and prompts that work for GPT-3.5 & GPT-4
One Useful Thing
It is starting to get strange.
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
a year ago
Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
The Berkeley...
Rethinking the Role of PPO in RLHF
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Marcus on AI
The impeccable logic of Sam Altman
From a Bloomberg interview, spotted and summarized by Harlan Stewart, presented without further...
a week ago
From a Bloomberg interview, spotted and summarized by Harlan Stewart, presented without further comment:
fast.ai
Is Avoiding Extinction from AI Really an Urgent Priority?
The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
PromptArmor Blog
Announcing LASEC: LLM Application Security Executive Certification
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
10 months ago
Including a never before seen exploit from PromptArmor's cutting edge threat intelligence team.
The Berkeley...
Modeling Extremely Large Images with $x$T
As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
10 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Artificial Ignorance
AI Roundup 075: Levels of AGI
July 12, 2024.
6 months ago
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale
Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Moving AI ethics beyond explainability and fairness to empowerment and justice
PromptArmor Blog
Slack AI data exfiltration from private channels via indirect prompt injection
Authors: PromptArmor
5 months ago
Weighty Thoughts
The Real Risks of AI
Humans are really the ones to be scared of
8 months ago
Humans are really the ones to be scared of
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI
March 22, 2023.
10 months ago
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode
One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
Society's Backend
Google Leads New AI Releases, OpenAI Gives First Glimpse of AGI with o3, AI Policy Will Be...
Society's Backend Reading List 12-23-2024
4 weeks ago
Society's Backend Reading List 12-23-2024
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
5 months ago
Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
9 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
One Useful Thing
Feats to astonish and amaze
A compendium of things I didn't think AI should be able to do
a year ago
A compendium of things I didn't think AI should be able to do
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
11 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
Strange Loop Canon
The agent principal problem
"Show me the incentive and I will show you the outcome."
a year ago
"Show me the incentive and I will show you the outcome."
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Society's Backend
Scaling Laws for LLMs, the Actual Cost of Frontier Models, 3 Key Principles for AI at Scale, and...
Society's Backend Reading List 01-10-2025
a week ago
Society's Backend Reading List 01-10-2025
Marcus on AI
Update re: Microsoft and training data
Relevant to the post I sent earlier today,...
a month ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
10 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
AI Snake Oil
Are open foundation models actually more risky than closed ones?
A policy brief on open foundation models
a year ago
A policy brief on open foundation models
Artificial Ignorance
AI Roundup 084: Strawberry / o1
September 13, 2024.
4 months ago
One Useful Thing
When you give a Claude a mouse
Some quick impressions of an actual agent
3 months ago
Some quick impressions of an actual agent
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
Society's Backend
I Beat Newsletter Fatigue With AI
And why direct forms of communication will always be super valuable
11 months ago
And why direct forms of communication will always be super valuable
Artificial Ignorance
How to build an AI search engine (Part 2)
VC funding, here we come.
3 months ago
VC funding, here we come.
Society's Backend
Discussions around OpenAI's o1, Superhuman AI, When AI Should Be An App, and More
Discussions from the past week: 09/16/2024
4 months ago
Discussions from the past week: 09/16/2024
Marcus on AI
AGI versus “broad, shallow intelligence”
The BSI we have now, versus the AGI we want
a week ago
The BSI we have now, versus the AGI we want
Strange Loop Canon
AI bill vetoed; what's next?
Make AI regulations evidence based
3 months ago
Make AI regulations evidence based
Artificial Ignorance
The ideologies fighting for the soul (and future) of AI
EAs, e/accs, decels, and doomers.
a year ago
EAs, e/accs, decels, and doomers.
Artificial Ignorance
AI Roundup 047: NYT v. OpenAI
Friday, December 29.
a year ago
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
Artificial Ignorance
AI Roundup 031: Think of the children
September 8, 2023
a year ago
One Useful Thing
The practical guide to using AI to do stuff
A resource for students in my classes (and other interested people).
a year ago
A resource for students in my classes (and other interested people).
Artificial Ignorance
AI Roundup 069: Project Greymatter
May 31, 2024.
7 months ago
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
3 months ago
The one good reason to do a PhD and two others that fall flat
AI Snake Oil
Evaluating LLMs is a minefield
Annotated slides from a recent talk
a year ago
Annotated slides from a recent talk
Society's Backend
LLM Research Recap of 2024, Fine-tuning LLM Judges, Amazon's Nova Models, Google's Genie 2, and More
Society's Backend Reading List 12-10-2024
a month ago
Society's Backend Reading List 12-10-2024
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and...
Society's Backend Reading List 11-11-2024
2 months ago
Society's Backend Reading List 11-11-2024
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too)
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
9 months ago
Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs
Also, we have a prompt library!
10 months ago
Also, we have a prompt library!
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
a year ago
On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell sequencing technologies.
Artificial Ignorance
Saving the world with AI and government grants
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
6 months ago
Listen now | A conversation with Helena Merk, founder and CEO of Streamline Climate.
Daniel Miessler
Your Experience is Your Creativity
Creativity is usually described as an external force that graces you with inspiration. Something...
over a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Marcus on AI
Satya Nadella and the three stages of scientific truth
A textbook case in how good ideas are often initially throttled
a month ago
A textbook case in how good ideas are often initially throttled
Weighty Thoughts
Who’s Winning the AI War?
All of us, except the AI startups and VCs—unless a real war breaks out
a year ago
All of us, except the AI startups and VCs—unless a real war breaks out
Artificial Ignorance
OpenAI's o1 is a misunderstood model
Are the latest "reasoning" breakthroughs all they're hyped up to be?
4 months ago
Are the latest "reasoning" breakthroughs all they're hyped up to be?
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth?
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
4 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
AI Snake Oil
OpenAI’s policies hinder reproducible research on language models
LLMs have become privately-controlled research infrastructure
a year ago
LLMs have become privately-controlled research infrastructure
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Strange Loop Canon
Discovery is the original sin of the modern age
technology, living post scarcity, and how to find what you want
a year ago
technology, living post scarcity, and how to find what you want
Artificial Ignorance
The State of AI Engineering (2024)
Notes from the AI Engineer World's Fair.
6 months ago
Notes from the AI Engineer World's Fair.
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm...
Machine learning resources and updates 8/26/2024
4 months ago
Machine learning resources and updates 8/26/2024
Matt Mazur
When you ship a major bug before signing off for the day
For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
IEEE Spectrum
Video Friday: Extreme Off-Road
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
fast.ai
Masks for COVID: Updating the evidence
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
Rozado’s Visual...
Mentions of Political Extremism in English Wikipedia
A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader...
a month ago
A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader societal/historical dynamics?
Artificial Ignorance
AI Roundup 088: Movie magic
October 11, 2024.
3 months ago
Artificial Ignorance
Looking a gift llama in the mouth
How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical...
6 months ago
How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical about it)
Marcus on AI
Hard-forked! Casey Newton’s distorted portrait of Gary Marcus and AI skepticism
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
a month ago
What Casey Newton’s new essay skewering AI skepticism does—and does not—get right
Artificial Ignorance
Funding a new generation of AI companies
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
12 months ago
Listen now | A conversation with Evan Stites-Clayton, partner at HF0 and CTO of Teespring.
Matt Mazur
“Monthly Billed Annually” is Cursed Copy
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS...
a year ago
There was a great discussion on Twitter recently that began with Daniel Vassallo calling out a SaaS for not refunding an accidental annual payment he made on their service. He intended to purchase the monthly plan, but due to an unclear UI and poor copy, he unintentionally...
One Useful Thing
Latent Expertise: Everyone is in R&D
Ideas come from the edges, not the center
7 months ago
Ideas come from the edges, not the center
Weighty Thoughts
Let’s Talk About AI Compute
What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
What really matters and why AI computing is exactly the same as all other large-scale computing
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
over a year ago
I ported Stable Diffusion to my phone
Society's Backend
Founder Mode, How AI Impacts Education, Diffusion Models As Real-Time Game Engines, and More
Machine learning resources and updates 2024-09-03
4 months ago
Machine learning resources and updates 2024-09-03
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards
Counterintuitively, start from how much money you need
over a year ago
Counterintuitively, start from how much money you need
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
One Useful Thing
Innovation through prompting
Democratizing educational technology... and more
9 months ago
Democratizing educational technology... and more
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design
Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled.
The development of tools and methods to guide this process is one of the...
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
a month ago
Scaling laws were supposed to be, well, laws.
AI Snake Oil
Three Ideas for Regulating Generative AI
Policy input to the federal government from a Stanford-Princeton team
a year ago
Policy input to the federal government from a Stanford-Princeton team
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
11 months ago
Five analytical tasks in under a minute
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
a year ago
Output similarity is a distraction
The Gradient
Text-to-CAD: Risks and Opportunities
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
Society's Backend
Meta's New Segmentation Model, A New Open-Source Image Generation Model, Apple Intelligence Model...
Machine learning resources and updates 8/5/2024
5 months ago
Machine learning resources and updates 8/5/2024
AI Snake Oil
AI existential risk probabilities are too unreliable to inform policy
How speculation gets laundered through pseudo-quantification
6 months ago
How speculation gets laundered through pseudo-quantification
Daniel Miessler
My Mom Died on Saturday
My mom died on Saturday. My biological mother became unable to function when I was around five due...
over a year ago
My mom died on Saturday. My biological mother became unable to function when I was around five due to mental illness, which left my dad and me on our own. Sometime after we were blessed with a strong, beautiful soul named Rhonda. My dad and I were like rescue dogs, and she saved...
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer
And other practical guides to understand machine learning
a year ago
And other practical guides to understand machine learning
One Useful Thing
Getting started with AI: Good enough prompting
Don't make this hard
a month ago
The Berkeley...
Goal Representations for Instruction Following
Goal Representations for Instruction Following
Figure title. Figure caption. This image is...
a year ago
Goal Representations for Instruction Following
Figure title. Figure caption. This image is centered and set to 50%
page width. -->
A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation?
The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
The bottleneck isn't the cost of producing disinfo, which is already very low.
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
IEEE Spectrum
How Amazon Is Changing the Future of Robotics and Logistics
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you...
a month ago
This is a sponsored article brought to you by Amazon.
“Innovation doesn’t just happen because you have a good idea,” said Valerie Samzun, a leader in Amazon’s Fulfillment Technologies and Robotics (FTR) division. “It happens because you have the right team, the right...
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks
Non-proliferation only benefits incumbents
a year ago
Non-proliferation only benefits incumbents
Sam Altman
Researchers and Founders
I spent many years working with founders and now I work with researchers.
Although there are always...
over a year ago
I spent many years working with founders and now I work with researchers.
Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
Artificial Ignorance
AI Roundup 056: Data deals
March 1, 2024.
10 months ago
Weighty Thoughts
Is AI a Winner-Take-All Market?
A critical question for investors in AI
5 months ago
A critical question for investors in AI
Artificial Ignorance
AI Roundup 085: You win some, you Newsom
September 20, 2024.
4 months ago
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Strange Loop Canon
No, LLMs are not "scheming"
a month ago
Society's Backend
Why Machine Learning Technical Debt is Especially Bad
And effective ways to mitigate it
10 months ago
And effective ways to mitigate it
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
9 months ago
Artificial Ignorance
How Shopify is making AI Magic
A case study on turning competitive advantages into useful AI.
a year ago
A case study on turning competitive advantages into useful AI.
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem
December 22, 2023.
a year ago
Stories by Andrej...
Yes you should understand backprop
over a year ago
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
a month ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
IEEE Spectrum
Video Friday: Cobot Proxie
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids Summit: 11–12 December...
AI Snake Oil
FAQ about the book and our writing process
What's in the book and how we wrote it
3 months ago
What's in the book and how we wrote it
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
11 months ago
Four questions to ask your organization.
Daniel Miessler
Humiliation is Deadly
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That...
over a year ago
I’ve been thinking for a few years about the danger presented by humiliated people and groups. That is, people who not only feel like they have no respect and no options to gain any respect, but who also feel that: They deserve those things, and… That someone else is the cause of...
Rozado’s Visual...
An Analysis of AI Political Preferences from a European Perspective
Introduction
2 months ago
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes
Several states just banned deepfakes in political ads and porn.
10 months ago
Several states just banned deepfakes in political ads and porn.
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
9 months ago
From megaFLOPS to mega flops.
One Useful Thing
Superhuman?
What does it mean for AI to be better than a human? And how can we tell?
8 months ago
What does it mean for AI to be better than a human? And how can we tell?
IEEE Spectrum
Video Friday: Unitree Talent Awakening
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
3 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
ICRA 2025: 19–23 May 2025, ATLANTA,...
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
a month ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
Artificial Ignorance
OpenAI’s DevDay: The biggest announcements
New models, new products, and new pricing.
a year ago
New models, new products, and new pricing.
Rozado’s Visual...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
over a year ago
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
over a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
IEEE Spectrum
Video Friday: Robot Dog Handstand
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition
August 9, 2024.
5 months ago
Society's Backend
Mastering the Art of Documentation
Documentation is really just glorified dog sitting
a year ago
Documentation is really just glorified dog sitting
fast.ai
GPT 4 and the Uncharted Territories of Language
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Strange Loop Canon
Google had a very bad week
Gemini's paradox
10 months ago
One Useful Thing
Everyone is above average
Is AI a Leveler, King Maker, or Escalator?
a year ago
Is AI a Leveler, King Maker, or Escalator?
The Gradient
Neural algorithmic reasoning
In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
Artificial Ignorance
How to fine-tune ChatGPT
No GPU cluster required.
a year ago
Matt Mazur
Redesigning Preceden’s Pricing Page
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
Artificial Ignorance
AI Roundup 082: System prompts
August 30, 2024.
4 months ago
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
5 months ago
What people (still) fundamentally misunderstand about AI search.
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Society's Backend
3 Key Principles for AI at Scale [Part 2]
The key to how large AI companies outcompete
2 weeks ago
The key to how large AI companies outcompete
The Gradient
An Introduction to the Problems of AI Consciousness
Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
Society's Backend
Weekly Backend #4: 62 Total Resources
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
9 months ago
Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
Weighty Thoughts
Today’s AI critics don’t understand the history of technology
But is AI different than other technologies?
10 months ago
But is AI different than other technologies?
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
8 months ago
How employees and CEOs alike can plan for the future.
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
10 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
One Useful Thing
How to use AI to do practical stuff: A new guide
People often ask me how to use AI. Here's an overview with lots of links.
a year ago
People often ask me how to use AI. Here's an overview with lots of links.
Made by Ollin
Priors for Autonomous Vehicle Development
over a year ago
Sam Altman
The Virus
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19.
I hope that society views this as a warning for the future. Covid-19 is bad, but only a warm-up. I think it’s...
Sam Altman
Greg
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg...
over a year ago
A lot of people ask me what the ideal cofounder looks
like. I now have an answer: Greg Brockman.
Every successful startup I know has at least one person who
provides the force of will to make the startup happen. I’d thought a lot
about this in the abstract while advising YC...
Marcus on AI
Where will AI be at the end of 2027? A bet
We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI...
3 weeks ago
We, Gary Marcus, author, scientist, and noted AI skeptic, and Miles Brundage, an independent AI policy researcher who recently left OpenAI and is bullish on AI progress, have agreed to the following bet, at 10:1 odds, with criteria drawn from two earlier Substack essays by Gary...
Artificial Ignorance
AI Roundup 080: Grok 2
August 16, 2024.
5 months ago
Matt Mazur
Preceden’s Spam Problem
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS...
a year ago
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS timeline maker tool. I’m honestly surprised it took spammers so long: Preceden is a freemium product (meaning people can sign up and try it for free), the product makes it very easy to...
Matt Mazur
Indie Hacking Week 1 Recap: Starting TimelineGPT, Ending LearnGPT
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good...
over a year ago
Today marks the end of my first week of full-time indie hacking. I feel like I’m getting in a good groove as far as my daily routine, but I don’t think it’s quite sunk in yet how much flexibility I have in terms of my daily schedule. For example, I’m still waking up early to […]
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
11 months ago
A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth so much
Marcus on AI
AI still lacks “common” sense, 70 years later
What’s obvious to people still isn’t always obvious to machines
2 weeks ago
What’s obvious to people still isn’t always obvious to machines
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
Artificial Ignorance
AI Roundup 100: CES
January 10, 2025.
a week ago
Matt Mazur
Reflecting on My First Year as a Full Time Indie Founder
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13...
a year ago
At the beginning of 2023 I went full time on Preceden, my SaaS timeline maker business, after 13 years of working on it on the side. A year has passed, so I wanted to share an update on how things are going and some lessons learned. Preceden My main focus in 2023 was building AI...
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
3 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
Society's Backend
The State of AI in China
Is China winning the race to AGI?
6 months ago
Is China winning the race to AGI?
One Useful Thing
Superhuman: What can AI do in 30 minutes?
AI multiplies your efforts. I found out by how much...
a year ago
AI multiplies your efforts. I found out by how much...
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
7 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
AI Snake Oil
On the Societal Impact of Open Foundation Models
Adding precision to the debate on openness in AI
11 months ago
Adding precision to the debate on openness in AI
One Useful Thing
The Lazy Tyranny of the Wait Calculation
Taking AI timelines seriously
a year ago
Taking AI timelines seriously
Matt Mazur
LearnGPT is now EmergentMind
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
Strange Loop Canon
When we become cogs
on motivation and technology
2 months ago
on motivation and technology
Marcus on AI
8 signs that Donald Trump has a progressive form of dementia
And how our media is failing, wildly, in one of the most important stories in US history
2 months ago
And how our media is failing, wildly, in one of the most important stories in US history
Sam Altman
Project Covalence
Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
over a year ago
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.
Science remains the...
One Useful Thing
Automating creativity
There is now strong evidence that AI can help make us more innovative.
a year ago
There is now strong evidence that AI can help make us more innovative.
Rozado’s Visual...
The Political Biases of GPT-4
Things are not always what they seem
a year ago
Things are not always what they seem
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
Made by Ollin
Emojin
An infinite kaomoji generator
over a year ago
An infinite kaomoji generator
Society's Backend
Ask Stupid Questions
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
AI Snake Oil
What is algorithmic amplification and why should we care?
A symposium and a primer on social media recommendation algorithms
a year ago
A symposium and a primer on social media recommendation algorithms
Strange Loop Canon
Power, money and human nature
Thoughts on OpenAI, a tragedy
a year ago
Thoughts on OpenAI, a tragedy
One Useful Thing
The future, soon: what I learned from Bing's AI
We had a brief glimpse of two different types of AI. Both are significant
a year ago
We had a brief glimpse of two different types of AI. Both are significant
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
6 months ago
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection
Authors: PromptArmor
5 months ago
Marcus on AI
Sora still appears to have trouble with physics
Exactly as I warned in February
a month ago
Exactly as I warned in February
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning
function reveal() {
const replay = document.querySelector('.ddpo-replay');
...
a year ago
function reveal() {
const replay = document.querySelector('.ddpo-replay');
replay.style.display = 'flex';
}
window.onload = () => {
const replay = document.querySelector('.ddpo-replay');
replay.addEventListener('click', () => {
...
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
Society's Backend
JAX is for More Than Just Machine Learning
What JAX is and its potential applications
7 months ago
What JAX is and its potential applications
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for...
Society's Backend Reading List 10-28-2024
2 months ago
Society's Backend Reading List 10-28-2024
IEEE Spectrum
5 Questions for Robotics Legend Ruzena Bajcsy
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in...
a month ago
Ruzena Bajcsy is one of the founders of the modern field of robotics. With an education in electrical engineering in Slovakia, followed by a Ph.D. at Stanford, Bajcsy was the first woman to join the engineering faculty at the University of Pennsylvania. She was the first, she...
IEEE Spectrum
SwitchBot S10 Review: “This Is the Future of Home Robots”
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
3 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
Artificial Ignorance
Tutorial: How to build an AI agent (Part 2)
Part 2: Giving our agent internet access.
a year ago
Part 2: Giving our agent internet access.
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
2 months ago
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
over a year ago
A checklist for avoiding hype
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots
large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
2 months ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
Artificial Ignorance
YCombinator's AI boom is still going strong (W24)
Combing through all 158 YC AI startups (65% of the batch).
9 months ago
Combing through all 158 YC AI startups (65% of the batch).
fast.ai
AI Harms are Societal, Not Just Individual
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
over a year ago
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
6 months ago
IEEE Spectrum
Video Friday: Agile Upgrade
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
5 days ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
RoboCup German Open: 12–16 March...
Marcus on AI
An AI rumor you won’t want to miss
Converging evidence that the core hypothesis driving generative AI may be wrong
2 months ago
Converging evidence that the core hypothesis driving generative AI may be wrong
Marcus on AI
Which CEO will be the last to see it?
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped...
a month ago
What kept me going during the dark years of 2022 and 2023 when Generative AI was wildly overhyped and I was constantly ridiculed was the secure knowledge that the truth would eventually come out.
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Sam Altman
Reflections
The second birthday of ChatGPT was only a little over a month ago, and now we have transitioned into...
2 weeks ago
The second birthday of ChatGPT was only a little over a month ago, and now we have transitioned into the next paradigm of models that can do complex reasoning. New years get people in a reflective mood, and I wanted to share some personal thoughts about how it has gone so far,...
Sam Altman
How To Invest In Startups
There is a lot of advice about how to be a good startup founder. But there isn’t very much about...
over a year ago
There is a lot of advice about how to be a good startup founder. But there isn’t very much about how to be a good startup investor.
Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
AI Snake Oil
How Transparent Are Foundation Model Developers?
Introducing the Foundation Model Transparency Index
a year ago
Introducing the Foundation Model Transparency Index
AI Snake Oil
Is GPT-4 getting worse over time?
A new paper going viral has been widely misinterpreted
a year ago
A new paper going viral has been widely misinterpreted
Daniel Miessler
What Made the 90’s So Awesome?
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Daniel Miessler
GPT and Search
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Weighty Thoughts
Open AI's Valuation and a Favor to Ask
A guest post and an in-person panel
5 months ago
A guest post and an in-person panel
Strange Loop Canon
Life in India is a series of bilateral negotiations
finding the new equilibrium for the next superpower
3 months ago
finding the new equilibrium for the next superpower
Marcus on AI
“LLMs amplify existing security risks and introduce new ones”
also: “the work of securing AI systems will never be complete”
6 days ago
also: “the work of securing AI systems will never be complete”
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
10 months ago
The future of entertainment is going to be a wild ride.
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 