Rozado’s Visual...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
over a year ago
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
fast.ai
From Deep Learning Foundations to Stable Diffusion
Practical Deep Learning for Coders part 2, 2022
over a year ago
Practical Deep Learning for Coders part 2, 2022
Artificial Ignorance
AI Roundup 092: Watermarking the AI wave
November 8, 2024.
a month ago
Strange Loop Canon
The mystery of the garage
10 months ago
Weighty Thoughts
Fear and Loathing in 7nm
How much does Huawei and SMIC's new chip matter? And what should the US do?
a year ago
How much does Huawei and SMIC's new chip matter? And what should the US do?
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for...
Society's Backend Reading List 10-28-2024
a month ago
Society's Backend Reading List 10-28-2024
PromptArmor Blog
Coming soon
This is PromptArmor Blog.
a year ago
This is PromptArmor Blog.
Artificial Ignorance
AI and the workplace
How employees and CEOs alike can plan for the future.
7 months ago
How employees and CEOs alike can plan for the future.
Society's Backend
Machine Learning Infrastructure: The Bridge Between Software Engineering and AI
What makes machine learning infra so important and why I find it so interesting
a year ago
What makes machine learning infra so important and why I find it so interesting
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Matt Mazur
The Kenya Quick Answer Goes Viral, Again
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
One Useful Thing
The future of education in a world of AI
A positive vision for the transformation to come
a year ago
A positive vision for the transformation to come
AI Snake Oil
Is AI-generated disinformation a threat to democracy?
An essay on the future of generative AI on social media
a year ago
An essay on the future of generative AI on social media
Artificial Ignorance
AI's massive cash needs are Big Tech's chance to own the future
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10...
10 months ago
Over the past year, AI startups have raised some impressive amounts of money. OpenAI raised $10 billion, Anthropic did $6 billion, Inflection AI raised $1.3 billion, and dozens of companies closed rounds in the hundreds of millions.
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen?
Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
fast.ai
Can LLMs learn from a single example?
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but...
a year ago
We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.
Society's Backend
Artificial Intelligence: A New Paradigm Emerges
A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
A realistic perspective of the advantages and pitfalls of artificial intelligence
The Berkeley...
Virtual Personas for Language Models via an Anthology of Backstories
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual...
a month ago
Anthology, a method for conditioning LLMs to representative, consistent, and diverse virtual personas by generating and utilizing naturalistic backstories with rich details of individual values and experience.
-->
We introduce Anthology, a method for conditioning LLMs to...
AI Snake Oil
What is algorithmic amplification and why should we care?
A symposium and a primer on social media recommendation algorithms
a year ago
A symposium and a primer on social media recommendation algorithms
One Useful Thing
AI in organizations: Some tactics
Meet the Lab and the Crowd
2 months ago
Meet the Lab and the Crowd
Artificial Ignorance
AI Roundup 059: In̶f̶l̶e̶c̶t̶i̶o̶n̶ Microsoft AI
March 22, 2023.
9 months ago
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning
function reveal() {
const replay = document.querySelector('.ddpo-replay');
...
a year ago
function reveal() {
const replay = document.querySelector('.ddpo-replay');
replay.style.display = 'flex';
}
window.onload = () => {
const replay = document.querySelector('.ddpo-replay');
replay.addEventListener('click', () => {
...
Society's Backend
Why Machine Learning Terminology is So Confusing
And definitions for the most important terms you should know
10 months ago
And definitions for the most important terms you should know
Society's Backend
A Privacy Review: Google
I read Google's privacy policy for you
a year ago
I read Google's privacy policy for you
Strange Loop Canon
LLMs breach a threshold
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
4 months ago
Open Source models get more powerful, and an AI system scores silver in Maths Olympiad
Rozado’s Visual...
Artificial Intelligence and Portraits of 17th Century Physicists
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
10 months ago
The case for customizable AI systems as an alternative to one-size-fits-all AI systems
Artificial Ignorance
Lessons from 139 YC AI startups (S23)
The evolution of the AI landscape, and YC's Copilot era.
a year ago
The evolution of the AI landscape, and YC's Copilot era.
The Berkeley...
Rethinking the Role of PPO in RLHF
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
Rethinking the Role of PPO in RLHF
TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Artificial Ignorance
GPT-4o and the illusion of AGI
Why speed and multimodality is becoming the name of the game.
7 months ago
Why speed and multimodality is becoming the name of the game.
Society's Backend
The Attention Thief: Machine Learning as a Monetization Weapon
How your greatest asset is silently stolen by technology every day
a year ago
How your greatest asset is silently stolen by technology every day
AI Snake Oil
New paper: AI agents that matter
Rethinking AI agent benchmarking and evaluation
5 months ago
Rethinking AI agent benchmarking and evaluation
Rozado’s Visual...
Which is the Wokest AI?
A Wokeness Ranking of LLMs
9 months ago
A Wokeness Ranking of LLMs
Daniel Miessler
The 2 Current Major AI Bottlenecks
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
One Useful Thing
What people ask me most. Also, some answers.
A FAQ of sorts
a year ago
Artificial Ignorance
Why Claude 3 is a big upgrade
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks,...
9 months ago
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks, add multi-modal capabilities, and are a real competitor to GPT-4.
Strange Loop Canon
Mind the Gap
from empire to umpire
a year ago
Artificial Ignorance
Small newsletters, big ideas
A subscriber showcase full of hidden gems on Substack.
6 days ago
A subscriber showcase full of hidden gems on Substack.
AI Snake Oil
Four more things we worked on in 2022
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
a year ago
We had a busy 2022. Here are a few things we worked on but didn’t cover here.
Society's Backend
OpenAI's Strawberry May Enhance AI Reasoning, Optimization of Vision Language Models, Info on...
Weekly updates and resources 7/15/24
5 months ago
Weekly updates and resources 7/15/24
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
One Useful Thing
Four Singularities for Research
The rise of AI is creating both crisis and opportunity
7 months ago
The rise of AI is creating both crisis and opportunity
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough.
Opting out is the latest example of generative AI developers externalizing costs.
a year ago
Opting out is the latest example of generative AI developers externalizing costs.
Sam Altman
2017 YC Annual Letter
Dear YC Community:
In response to a comment on Hacker News, I’m going to try writing an annual...
over a year ago
Dear YC Community:
In response to a comment on Hacker News, I’m going to try writing an annual letter to the YC community with an update on our progress.
Our mission is to enable the most innovation of any company in the world in order to make the future great for everyone. We...
Weighty Thoughts
The Fall of Data Moats
AI actually makes most data moats weaker
a year ago
AI actually makes most data moats weaker
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
Jascha’s blog
Brain dump on the diversity of AI risk
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
a year ago
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
AI has the power to change the world in both wonderful and terrible ways. We should try to...
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
AI Snake Oil
Three Ideas for Regulating Generative AI
Policy input to the federal government from a Stanford-Princeton team
a year ago
Policy input to the federal government from a Stanford-Princeton team
The Berkeley...
GPT-4 + Stable-Diffusion = ?: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with...
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable...
a year ago
TL;DR: Text Prompt -> LLM -> Intermediate Representation (such as an image layout) -> Stable Diffusion -> Image.
Recent advancements in text-to-image generation with diffusion models have yielded remarkable results synthesizing highly realistic and diverse images. However,...
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Society's Backend
Why MLX is Important for the ML Community
And a step-by-step guide to train a machine learning model on your Mac
7 months ago
And a step-by-step guide to train a machine learning model on your Mac
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba…
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
over a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
Society's Backend
The Fastest Way to Get Up to Speed on Machine Learning Fundamentals for Free
Announcing the ML Road Map-Turbo
6 months ago
Announcing the ML Road Map-Turbo
Matt Mazur
Looking to sell Emergent Mind
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
AI Snake Oil
ML is useful for many things, but not for predicting scientific replicability
How the veneer of AI is used to legitimize awful ideas
a year ago
How the veneer of AI is used to legitimize awful ideas
Artificial Ignorance
AI Roundup 060: Another CEO gone
March 29, 2024.
8 months ago
The Berkeley...
TinyAgent: Function Calling at the Edge
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
6 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
AI Snake Oil
Can AI automate computational reproducibility?
A new benchmark to measure the impact of AI on improving science
3 months ago
A new benchmark to measure the impact of AI on improving science
fast.ai
GPT 4 and the Uncharted Territories of Language
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Weighty Thoughts
Let's talk about AI power costs
It's important, but a lot of recent attention has been concern-trolling
4 months ago
It's important, but a lot of recent attention has been concern-trolling
fast.ai
Masks for COVID: Updating the evidence
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
Society's Backend
Why everyone loves Spider-Man
Lessons anyone can learn from our friendly neighborhood web-crawler
a year ago
Lessons anyone can learn from our friendly neighborhood web-crawler
Andrej Karpathy blog
A Survival Guide to a PhD
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
The Gradient
Salmon in the Loop
On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
The Gradient
Financial Market Applications of LLMs
The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Artificial Ignorance
How to fine-tune ChatGPT
No GPU cluster required.
a year ago
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
2 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
One Useful Thing
What just happened, what is happening next
The tasks AI can do well are expanding rapidly
8 months ago
The tasks AI can do well are expanding rapidly
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
9 months ago
Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train models, and benchmark LLMs
Strange Loop Canon
AI embraces its product arc
fuzzy processors are entering mass production
7 months ago
fuzzy processors are entering mass production
Daniel Miessler
NO. 362 | Dependency Scanner, Citrix Attacks, AI Analysis…
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies....
over a year ago
SECURITY NEWS Google released an open-source scanner for vulnerabilities in project dependencies. It's a front-end to the OSV database that links a dependency list to its vulnerabilities. MORE The latest updates for Apple software fixed a new zero-day that could be used to hack...
One Useful Thing
The shape of the shadow of The Thing
We can start to see, dimly, what the near future of AI looks like.
a year ago
We can start to see, dimly, what the near future of AI looks like.
One Useful Thing
Thinking Like an AI
A little intuition can help
2 months ago
A little intuition can help
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning
You probably know more about machine learning math than you think
10 months ago
You probably know more about machine learning math than you think
Artificial Ignorance
Who in their right mind would do an AI hardware startup
From megaFLOPS to mega flops.
8 months ago
From megaFLOPS to mega flops.
fast.ai
A new old kind of R&D lab
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on...
a year ago
Answer.AI is a new kind of AI R&D lab which creates practical end-user products based on foundational research breakthroughs.
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource...
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
5 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
One Useful Thing
AI is not good software. It is pretty good people.
A pragmatic approach to thinking about AI
a year ago
A pragmatic approach to thinking about AI
Society's Backend
Would You Build the Manhattan Project in the UAE?
Thoughts on AI national security threats
6 months ago
Thoughts on AI national security threats
Weighty Thoughts
Why we need AI as a society
We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
We’re aging too fast (AKA my entire AI/robotics investment thesis)
Artificial Ignorance
The SearchGPT Paradigm
What people (still) fundamentally misunderstand about AI search.
4 months ago
What people (still) fundamentally misunderstand about AI search.
One Useful Thing
How to... use AI to unstick yourself
We often lose momentum because of something small. AI can help.
a year ago
We often lose momentum because of something small. AI can help.
AI Snake Oil
AI scaling myths
Scaling will run out. The question is when.
5 months ago
Scaling will run out. The question is when.
Artificial Ignorance
AI Roundup 048: The Robot Constitution
January 5, 2024.
11 months ago
Matt Mazur
Indie Hacking Week 2 Recap – TimelineGPT Progress, LearnGPT Decision Time
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin...
a year ago
For Martin Luther King weekend my family and I headed to Boone, North Carolina and stayed in a cabin for a few days. We went snow tubing at Beech Mountain while we were there, one of the many ski resorts in the area. As is common on vacations, I spent way too much time thinking...
The Berkeley...
2024 BAIR Graduate Directory
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most...
9 months ago
Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of the most talented and innovative minds in artificial intelligence and machine learning. Our Ph.D. graduates have each expanded the frontiers of AI research and are now ready to embark on new...
Artificial Ignorance
How Intercom is transforming customer support with AI
A conversation with Fergal Reid, VP of AI at Intercom.
8 months ago
A conversation with Fergal Reid, VP of AI at Intercom.
fast.ai
From Deep Learning Foundations to Stable Diffusion
We’ve released our new course with over 30 hours of video content.
a year ago
We’ve released our new course with over 30 hours of video content.
Artificial Ignorance
AI Roundup 083: Bioacoustics
September 6, 2024.
3 months ago
Andrej Karpathy blog
(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
over a year ago
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but
whenever I do get a chance to post something I have recently been defaulting
to doing it on Medium because...
Marcus on AI
ChatGPT, at Age Two
The bullshit just keeps on coming.
3 weeks ago
The bullshit just keeps on coming.
Marcus on AI
Generative AI’s Continuing Copyright Problems, an Essay in Memory of Suchir Balaji, 1998 - 2024
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate...
a week ago
In early November, I had a stimulating Zoom call with a former OpenAI employee and Berkeley graduate named Suchir Balaji, who had just left OpenAI.
One Useful Thing
Getting started with AI: Good enough prompting
Don't make this hard
4 weeks ago
AI Snake Oil
We Looked at 78 Election Deepfakes. Political Misinformation is not an AI Problem.
Technology Isn’t the Problem—or the Solution.
a week ago
Technology Isn’t the Problem—or the Solution.
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering
And isn't that we're all going to lose our jobs
9 months ago
And isn't that we're all going to lose our jobs
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media
Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
One Useful Thing
I, Cyborg: Using Co-Intelligence
How I used AI in my book about AI
9 months ago
How I used AI in my book about AI
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem
December 22, 2023.
a year ago
fast.ai
A New Chapter for fast.ai: How To Solve It With Code
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Artificial Ignorance
AI Roundup 077: A good week for open-source
July 26, 2024.
4 months ago
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
over a year ago
A checklist for avoiding hype
One Useful Thing
Almost an Agent: What GPTs can do
Also, my book has a cover (also I have a book coming out)
a year ago
Also, my book has a cover (also I have a book coming out)
One Useful Thing
Not much is changing, a lot is changing
OpenAI, Microsoft, and the OpenOffspring
a year ago
OpenAI, Microsoft, and the OpenOffspring
Artificial Ignorance
Who's winning the AI arms race?
It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
It depends whether AI is a "disruptive" or "sustaining" technology.
Artificial Ignorance
AI Roundup 088: Movie magic
October 11, 2024.
2 months ago
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
over a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
One Useful Thing
Automating creativity
There is now strong evidence that AI can help make us more innovative.
a year ago
There is now strong evidence that AI can help make us more innovative.
Society's Backend
A Fundamental Overview of Machine Learning Experimentation [Part 1]
And how it differs from the software development you're familiar with
2 weeks ago
And how it differs from the software development you're familiar with
Sam Altman
The United Slate
I would like to find and support a slate of candidates for the 2018 California elections, and also...
over a year ago
I would like to find and support a slate of candidates for the 2018 California elections, and also to find someone to run a ballot initiative focused on affordable housing in the state. A team of aligned people has a chance to make a real change.
I believe in creating prosperity...
Marcus on AI
An epidemic of weirdly precise AI butt facts
The parade of made-up numbers never stops
a month ago
The parade of made-up numbers never stops
Artificial Ignorance
AI Zoology: Why are there so many animal models?
Inside the emerging model menagerie.
a year ago
Inside the emerging model menagerie.
Artificial Ignorance
AI Roundup 095: QwQ
November 29, 2024.
3 weeks ago
Society's Backend
A Privacy Review: TikTok
You should stick to Instagram Reels and YouTube Shorts
a year ago
You should stick to Instagram Reels and YouTube Shorts
Society's Backend
The Slow, Painful Death of the Free Content Creator
It's happening as you read this
a year ago
It's happening as you read this
Daniel Miessler
News & Analysis | NO. 350
over a year ago
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
over a year ago
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
IEEE Spectrum
Boston Dynamics’ Latest Vids Show Atlas Going Hands On
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we...
a month ago
Boston Dynamics is the master of dropping amazing robot videos with no warning, and last week, we got a surprise look at the new electric Atlas going “hands on” with a practical factory task.
This video is notable because it’s the first real look we’ve had at the new Atlas doing...
Sam Altman
What I Wish Someone Had Told Me
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started.
Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
One Useful Thing
Reshaping the tree: rebuilding organizations for AI
Technological change brings organizational change.
a year ago
Technological change brings organizational change.
One Useful Thing
I hope you weren't getting too comfortable.
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits...
a year ago
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits of AI were wrong.
Artificial Ignorance
AI Roundup 081: Creative differences
August 23, 2024.
4 months ago
Artificial Ignorance
The fable of Reflection 70B
From groundbreaking to grifting.
3 months ago
From groundbreaking to grifting.
IEEE Spectrum
It's Surprisingly Easy to Jailbreak LLM-Driven Robots
large language models (LLMs) have exploded in popularity, leading a number of companies to explore...
a month ago
large language models (LLMs) have exploded in popularity, leading a number of companies to explore LLM-driven robots. However, a new study now reveals an automated way to hack into such machines with 100 percent success. By circumventing safety guardrails, researchers could...
Made by Ollin
Acapella Extraction with ConvNets
A working prototype
over a year ago
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Artificial Ignorance
The Industrial Content Revolution
A fundamental change in the structure the internet.
a year ago
A fundamental change in the structure the internet.
One Useful Thing
Thinking companion, companion for thinking
Some simple ways to use AI to break you out of biases
a year ago
Some simple ways to use AI to break you out of biases
Daniel Miessler
NO. 369 | Reddit Hack, Deepfake Scams, Embracing Change…
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank...
a year ago
✅ Please subscribe to and give a 17-star review to this show on Apple Podcasts and Spotify. Thank you! SECURITY Reddit has confirmed it was hacked, and it’s recommending users add 2FA. The attack started by phishing Reddit employees and stealing credentials and 2FA codes. After...
Rozado’s Visual...
The Political Biases of Google Bard
It is probably only a matter of time until a nation state purposely builds a biased AI system...
a year ago
It is probably only a matter of time until a nation state purposely builds a biased AI system designed to advance government interests
Artificial Ignorance
AI Roundup 076: Grand theft audio
July 19, 2024.
5 months ago
AI Snake Oil
A safe harbor for AI evaluation and red teaming
An argument for legal and technical safe harbors for AI safety and trustworthiness research
9 months ago
An argument for legal and technical safe harbors for AI safety and trustworthiness research
Artificial Ignorance
AI Roundup 072: The new new Claude
June 21, 2024.
6 months ago
Daniel Miessler
OpenAI’s Purpose is to Build AGI, and What That Means
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. >...
a year ago
Sam Altman, the CEO of OpenAI, has said multiple times that, He says it in this video as well. > We’re very much here to build AGI. Sam Altman I am not sure how many people realize this about the company. They’re not like playing with other AI-related tech and AGI might come out...
Rozado’s Visual...
The Increasing Prominence of Prejudice and Social Justice Rhetoric in UK News Media
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice...
over a year ago
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice and social justice rhetoric in UK news media. Recent years have seen considerable debate about the rise of political polarization in British society. Specifically, over the last...
Sam Altman
A Clarification
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to...
over a year ago
I made a point in this post inelegantly in a way that was
easy to misunderstand, so I’d like to clarify it.
I didn’t mean that we need to tolerate brilliant homophobic
jerks in the lab so that we can have scientific progress.
Although there are famous...
IEEE Spectrum
Video Friday: Trick or Treat, Atlas
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion.
Humanoids 2024: 22–24 November...
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
a year ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
Society's Backend
Run Your Own Race
What Bluey can teach us about machine learning
8 months ago
What Bluey can teach us about machine learning
fast.ai
Qualitative humanities research is crucial to AI
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
over a year ago
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
Weighty Thoughts
China's AI Journey
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
6 months ago
Talking to Jordan Schneider from ChinaTalk about China's technological ascent
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested.
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
One Useful Thing
Strategies for an Accelerating Future
Four questions to ask your organization.
10 months ago
Four questions to ask your organization.
Artificial Ignorance
AI Roundup 089: Adobe MAX
October 18, 2024.
2 months ago
Artificial Ignorance
Case Study: Scaling customer intelligence
Analyzing 10,000 sales calls with Claude
3 weeks ago
Analyzing 10,000 sales calls with Claude
Rozado’s Visual...
New York Times Word Usage Frequency Chart – An Update
A timely update of an informative chart
a year ago
A timely update of an informative chart
Society's Backend
Anti-Social Media
How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
One Useful Thing
Centaurs and Cyborgs on the Jagged Frontier
I think we have an answer on whether AIs will reshape work....
a year ago
I think we have an answer on whether AIs will reshape work....
Society's Backend
Why Rust Isn't Killing C++
And a consideration for choosing a language
8 months ago
And a consideration for choosing a language
Marcus on AI
A new AI scaling law shell game?
Scaling laws were supposed to be, well, laws.
4 weeks ago
Scaling laws were supposed to be, well, laws.
Rozado’s Visual...
The Great Awokening as a Global Phenomenon
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
The striking synchronicity with which Great Awokening terminology increased in news media worldwide
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs
The future of entertainment is going to be a wild ride.
9 months ago
The future of entertainment is going to be a wild ride.
Society's Backend
Updates to Society's Backend
New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and...
9 months ago
New benefits for paid subscribers, support Society's Backend for just $1/mo, a referral program, and more
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake.
This article is part of our special report, “Reinventing...
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
-->
This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Artificial Ignorance
AI Roundup 093: Diminishing returns
November 15, 2024.
a month ago
Daniel Miessler
GPT and Search
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Artificial Ignorance
Workshop: Enough GPT To Be Dangerous with Sairam Sundaresan
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers”...
a month ago
Have you ever wondered what’s actually happening inside ChatGPT and Claude, but found “explainers” too complex or technical?
AI Snake Oil
Generative AI’s end-run around copyright won’t be resolved by the courts
Output similarity is a distraction
11 months ago
Output similarity is a distraction
Society's Backend
What Makes Machine Learning so Hard for Software Engineers
How decades of learning a mindset makes adapting difficult
4 months ago
How decades of learning a mindset makes adapting difficult
Sam Altman
How To Invest In Startups
There is a lot of advice about how to be a good startup founder. But there isn’t very much about...
over a year ago
There is a lot of advice about how to be a good startup founder. But there isn’t very much about how to be a good startup investor.
Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
Artificial Ignorance
Honey, I joined a cabal
Or: Mainstream media still isn't great at covering tech and AI ideologies
6 months ago
Or: Mainstream media still isn't great at covering tech and AI ideologies
One Useful Thing
How to Use AI to Do Stuff: An Opinionated Guide
Covering the state of play as of Summer, 2023
a year ago
Covering the state of play as of Summer, 2023
Weighty Thoughts
Open AI's Valuation and a Favor to Ask
A guest post and an in-person panel
4 months ago
A guest post and an in-person panel
Artificial Ignorance
AI Roundup 053: Bye bye Bard
February 9, 2024.
10 months ago
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
over a year ago
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
Society's Backend
Side Projects to Get a Job in ML, a Survey of Small Language Models, How to Build ML Pipelines, and...
Society's Backend Reading List 11-11-2024
a month ago
Society's Backend Reading List 11-11-2024
One Useful Thing
Secret Cyborgs: The Present Disruption in Three Papers
The future is already here, we just need to figure out a few details.
a year ago
The future is already here, we just need to figure out a few details.
Artificial Ignorance
How to build an AI search engine (Part 1)
Working with Claude, Brave, and streaming responses.
2 months ago
Working with Claude, Brave, and streaming responses.
PromptArmor Blog
Data exfiltration from Writer.com with indirect prompt injection
Authors: PromptArmor and Kai Greshake
a year ago
Authors: PromptArmor and Kai Greshake
The Gradient
Do text embeddings perfectly encode text?
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
9 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
Society's Backend
One Year of Society's Backend
The lessons I've learned along the way
4 months ago
The lessons I've learned along the way
Sam Altman
GPT-4o
There are two things from our announcement today I wanted to highlight.
First, a key part of our...
7 months ago
There are two things from our announcement today I wanted to highlight.
First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
Artificial Ignorance
AI Roundup 040: GPTs
November 10, 2023.
a year ago
The Gradient
Neural algorithmic reasoning
In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1)
Part 1: What is an agent, and how do they work?
a year ago
Part 1: What is an agent, and how do they work?
Andrej Karpathy blog
Biohacking Lite
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew...
over a year ago
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that (“mom said”-) level of abstraction. I also knew that I can probably get away with...
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
over a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Artificial Ignorance
AI Roundup 078: Voice mode
August 2, 2024.
4 months ago
One Useful Thing
What happens when AI reads a book 🤖📖
And some prompts that might be useful when it does.
a year ago
And some prompts that might be useful when it does.
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
over a year ago
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
Strange Loop Canon
What can LLMs never do?
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
8 months ago
On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
Daniel Miessler
The UL Boost Protocol
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe...
over a year ago
This is a member-only post. Thank you for being part of this. This is UL Member Content Subscribe Already a member? Login
Sam Altman
Join the YC Software Team
If you want to get funded by YC as a founder in the future, but you don't have a startup that's...
over a year ago
If you want to get funded by YC as a founder in the future, but you don't have a startup that's ready for that yet, joining the YC software team is a great hack to get there.
The YC software team is a small group of hackers in SF that write the software that makes all the parts...
Society's Backend
AI Reading List 1: Understand Transformers, Reflection-70B Update, and LLMs Still Cannot Reason
Society's Backend Reading List 10-07-2024
2 months ago
Society's Backend Reading List 10-07-2024
Daniel Miessler
News, Analysis, and Discovery | NO. 356
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read...
over a year ago
SECURITY NEWS TikTok has now admitted, after denying last week, that Chinese staff can in fact read European TikTok data. Pressure is increasing across the US government to outright ban the app, but it's quickly becoming national infrastructure so many young people. MORE |...
The Berkeley...
How to Evaluate Jailbreak Methods: A Case Study with the StrongREJECT Benchmark
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could...
3 months ago
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak frontier LLMs simply by translating forbidden prompts into obscure languages. Excited by this result, we attempted to reproduce it and found something unexpected.
The...
Artificial Ignorance
LLMs are getting dumber and we have no idea why
Five theories that could explain how chatbots are getting worse.
3 months ago
Five theories that could explain how chatbots are getting worse.
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
a year ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Artificial Ignorance
AI Roundup 033: DALL·E 3
September 22, 2023.
a year ago
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves.
What spending $2,000 can tell us about evaluating AI agents
7 months ago
What spending $2,000 can tell us about evaluating AI agents
Artificial Ignorance
What President Biden's AI executive order actually means
I read all 111 pages so you don't have to.
a year ago
I read all 111 pages so you don't have to.
Artificial Ignorance
Dealing with AI fatigue
Notes for myself, and maybe you too.
10 months ago
Notes for myself, and maybe you too.
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter
Democratizing data analysis with AI
a year ago
Democratizing data analysis with AI
Artificial Ignorance
AI Roundup 063: Llama 3
April 19, 2024.
8 months ago
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
over a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
One Useful Thing
The Present Future: AI's Impact Long Before Superintelligence
You can start to see the outlines of an AI future, for better and worse
a month ago
You can start to see the outlines of an AI future, for better and worse
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
over a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Strange Loop Canon
When we become cogs
on motivation and technology
a month ago
on motivation and technology
Daniel Miessler
Frontview Mirror: 2023 Edition
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
One Useful Thing
"Do not fear AI, puny humans... that is not meant as a threat."
What we can learn from a completely AI written & illustrated lecture
a year ago
What we can learn from a completely AI written & illustrated lecture
Weighty Thoughts
The EU is making itself an economic backwater
Regulation is not a real export
5 months ago
Regulation is not a real export
One Useful Thing
Change blindness
21 months later
4 months ago
Sam Altman
What I Heard From Trump Supporters
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the...
over a year ago
After the election, I decided to talk to 100 Trump voters from around
the country. I went to the middle of the
country, the middle of the state, and talked to many online.
This was a surprisingly interesting and helpful experience—I highly
recommend it. With three exceptions,...
One Useful Thing
The practical guide to using AI to do stuff
A resource for students in my classes (and other interested people).
a year ago
A resource for students in my classes (and other interested people).
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
over a year ago
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and...
Society's Backend Reading List 12-2-2024
2 weeks ago
Society's Backend Reading List 12-2-2024
Frank’s Ramblings
My Experience Living and Working in China, Part I
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A Chronological Analysis”
Matt Mazur
Going Full Time on My SaaS After 13 Years
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
Artificial Ignorance
AI Roundup 061: The AI innovator's dilemma
April 5, 2024.
8 months ago
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Matt Mazur
My Indie SaaS Revenue has Grown 37% per Year for 13 Years
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker...
11 months ago
Unlike many indie founders, I’ve never shared revenue numbers for Preceden, my SaaS timeline maker tool. Even if they were remarkable – which they are not really – I just don’t think there are many good reasons to publicly share revenue numbers, and there are lots of downsides....
Daniel Miessler
Using Custom Searches in Safari (in 2022)
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
Artificial Ignorance
The AI research tool that saves me hours every week
And why it might revolutionize the search industry.
11 months ago
And why it might revolutionize the search industry.
Matt Mazur
When you ship a major bug before signing off for the day
For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
Daniel Miessler
My Prediction For Twitter
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Artificial Ignorance
AI Roundup 037: The AI IPCC
October 20, 2023.
a year ago
AI Snake Oil
Quantifying ChatGPT’s gender bias
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
a year ago
Benchmarks allow us to dig deeper into what causes biases and what can be done about it
Strange Loop Canon
LLMs have special intelligence, not general, and that's plenty.
“Life can only be understood backwards, but it must be lived forwards.”
9 months ago
“Life can only be understood backwards, but it must be lived forwards.”
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Daniel Miessler
Would You Put AI Art In Your House?
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
over a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
Strange Loop Canon
Whither Utopia?
The mystery of why we don't dream of building perfect societies anymore
6 months ago
The mystery of why we don't dream of building perfect societies anymore
Weighty Thoughts
News Roundup: May 27, 2014 🧴
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
6 months ago
Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
AI Snake Oil
Does ChatGPT have a liberal bias?
A new paper making this claim has many flaws. But the question merits research
a year ago
A new paper making this claim has many flaws. But the question merits research
Frank’s Ramblings
Vision Transformers are Overrated
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
11 months ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
over a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
One Useful Thing
One sentence.
Prompting for maximum impact (and why that is a bad idea)
a year ago
Prompting for maximum impact (and why that is a bad idea)
One Useful Thing
The Machines of Mastery
"Anyone can learn anything they want..." and how technology can help
a year ago
"Anyone can learn anything they want..." and how technology can help
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Marcus on AI
Don’t Ride This Bike! Generative AI’s persistent trouble with compositionality and parts
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us,...
a week ago
When the text-to-image AI generation system DALL-E2 was released in April 2022, the two of us, together with Scott Aaronson, ran some informal experiments to probe its abilities.
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022)
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
AI Snake Oil
Evaluating LLMs is a minefield
Annotated slides from a recent talk
a year ago
Annotated slides from a recent talk
Artificial Ignorance
AI Roundup 027: Challenge accepted
August 11, 2023
a year ago
Sam Altman
Idea Generation
The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup.
But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
One Useful Thing
On speaking to AI
Voice changes a lot of things
4 months ago
Voice changes a lot of things
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
2 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
Weighty Thoughts
The Mystical Q
OpenAI Q*, Primer on Reinforcement Learning, and Implications
a year ago
OpenAI Q*, Primer on Reinforcement Learning, and Implications
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit
August 18, 2023
a year ago
Artificial Ignorance
How to talk to your family about AI this Thanksgiving
A handy guide for your uncle's burning questions.
a year ago
A handy guide for your uncle's burning questions.
Marcus on AI
On hype, and the unbearable banality of ChatGPT’s poetry
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is...
a month ago
A new AI study is making the rounds, claiming that ChatGPT can write poetry that is “indistinguishable” from William Shakespeare.
Society's Backend
Should You Get a PhD?
The one good reason to do a PhD and two others that fall flat
2 months ago
The one good reason to do a PhD and two others that fall flat
One Useful Thing
What Can be Done in 59 Seconds: An Opportunity (and a Crisis)
Five analytical tasks in under a minute
10 months ago
Five analytical tasks in under a minute
Artificial Ignorance
I gave ChatGPT access to my Gmail
I'm sure this will end well.
a year ago
I'm sure this will end well.
One Useful Thing
A guide to prompting AI (for what it is worth)
A little bit of magic, but mostly just practice
a year ago
A little bit of magic, but mostly just practice
Rozado’s Visual...
What is the IQ of ChatGPT?
Making an AI model take an IQ test
over a year ago
Making an AI model take an IQ test
Weighty Thoughts
Software Engineering is Doomed
Or is it?
5 months ago
Daniel Miessler
What Made the 90’s So Awesome?
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made...
a year ago
I just read a brilliant essay about the 90’s by Freddie de Boer, and it got me thinking. What made the 90’s so great? Here’s GPT’s answer: Give a 90’s lover’s view of what made the 90’s awesome. Include everything from parenting, art, entertainment, games, childhood, movies, TV,...
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
over a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Society's Backend
How to Use Benchmarks to Build Successful Machine Learning Systems
And what benchmarks mean for real-world applications
4 months ago
And what benchmarks mean for real-world applications
AI Snake Oil
AI Snake Oil is now available to preorder
What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
What artificial intelligence can do, what it can't, and how to tell the difference
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready
I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Strange Loop Canon
Symposium: On Building God
a year ago
Marcus on AI
Humanity’s “Oh shit!” AI moment?
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we...
a week ago
Not yet, but it could come sooner than you think. Not because we are close to AGI, but because we already have machines that can say one thing and do something else altogether.
Artificial Ignorance
AI Roundup 034: Meta Connect
September 29, 2023
a year ago
Artificial Ignorance
What are logprobs?
Something to do with logs and probabilities.
11 months ago
Something to do with logs and probabilities.
Artificial Ignorance
AI Roundup 065: The gpt2-chatbot mystery
May 3, 2024.
7 months ago
Society's Backend
What it's Like to Work in AI and Advice from 10 AI Professionals
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for...
a month ago
I asked 10 AI professionals 4 questions about their work in AI and the qualifications required for their job
Society's Backend
MASSIVE New Model Releases from Google, OpenAI, and Meta Change the AI Landscape
Society's Backend Reading List 12-16-2024
6 days ago
Society's Backend Reading List 12-16-2024
fast.ai
My family’s unlikely homeschooling journey
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
Artificial Ignorance
AI Roundup 068: The ScarJo thing
May 24, 2024.
7 months ago
Artificial Ignorance
AI Roundup 094: Pixtral et Le Chat
November 22, 2024.
a month ago
Stories by Andrej...
Yes you should understand backprop
over a year ago
IEEE Spectrum
Forums, Competitions, Challenges: Inspiring Creativity in Robotics
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total...
2 months ago
This is a sponsored article brought to you by Khalifa University of Science and Technology.
A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the...
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs
Also, we have a prompt library!
9 months ago
Also, we have a prompt library!
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm...
Machine learning resources and updates 8/26/2024
3 months ago
Machine learning resources and updates 8/26/2024
Artificial Ignorance
AI Roundup 047: NYT v. OpenAI
Friday, December 29.
11 months ago
Society's Backend
Backend Biweekly #3: 97 Updates and Resources
Huge Nvidia Updates, Gemini Hackathon for Money, and more
8 months ago
Huge Nvidia Updates, Gemini Hackathon for Money, and more
Artificial Ignorance
OpenAI’s DevDay: The biggest announcements
New models, new products, and new pricing.
a year ago
New models, new products, and new pricing.
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Rozado’s Visual...
RightWingGPT – An AI Manifesting the Opposite Political Biases of ChatGPT
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
a year ago
The Dangers of Politically Aligned AIs and their Negative Effects on Societal Polarization
Artificial Ignorance
AI Roundup 085: You win some, you Newsom
September 20, 2024.
3 months ago
Weighty Thoughts
Scaling is a Choice
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
3 days ago
Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture
The actual takeaways from the iPhone 15 event
a year ago
The actual takeaways from the iPhone 15 event
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
9 months ago
Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
Artificial Ignorance
AI Roundup 091: Search wars
November 1, 2024.
a month ago
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Matt Mazur
Emergent Mind finally went viral
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
The Gradient
Why Doesn’t My Model Work?
Have you ever trained a model you thought was good, but then it failed miserably when applied to...
10 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
The Gradient
Mamba Explained
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
8 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
fast.ai
AI Safety and the Age of Dislightenment
Model licensing & surveillance will likely be counterproductive by concentrating power in...
a year ago
Model licensing & surveillance will likely be counterproductive by concentrating power in unsustainable ways
Society's Backend
Ask Stupid Questions
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
Matt Mazur
Turning Down $7k for a Side Project I Announced Two Weeks Ago I was Shutting Down
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a...
a year ago
About two weeks ago I announced I was shutting down LearnGPT. After the announcement, I received a lot of interest from people interested in taking it over, so I decided to try to sell it instead of shutting it down. I wound up receiving two offers, one for $6.5k and one for $7k,...