Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
Top Categories > AI
#all #programming #history #startups #technology #science #life #literature #architecture #travel #creative #design #comics #cartography #finance #AI #indiehacker Muted Categories [alt+←][alt+→]
Made by Ollin
Mac Replacement Icons A standardized, simplified, and beautiful icon set
over a year ago
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
a year ago
83
a year ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text. Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
62
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
Strange Loop Canon
Life in India is a series of bilateral negotiations finding the new equilibrium for the next superpower
2 months ago
Strange Loop Canon
What can LLMs never do? On goal drift and lower reliability. Or, why can't LLMs play Conway's Game Of Life?
8 months ago
Society's Backend
What Apple Intelligence Means for You "We think you're gonna LOVE it"
6 months ago
One Useful Thing
Blinded by Analogies What is this AI thing? The wrong model can lead us astray
a year ago
One Useful Thing
How to... use AI to unstick yourself We often lose momentum because of something small. AI can help.
a year ago
Daniel Miessler
NO. 368 | ChinaBalloons, CustomGPT, 90s++… ✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll...
a year ago
52
a year ago
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll prevent the email from occasionally descending into the void. SECURITY The US shot down a Chinese spy balloon. They gathered the debris from the water it fell into, and it's currently...
Artificial Ignorance
AI Roundup 083: Bioacoustics September 6, 2024.
3 months ago
Daniel Miessler
Summary: Andrej Kaparthy on Lex Fridman’s Podcast (Late 2022) 9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My...
a year ago
32
a year ago
9/10 This is a summary of Andrej Kaparthy’s appearance on Lex Fridman’s podcast in late 2022. My One-Sentence Summary/Highlight The future of programming is not humans writing code, but neural nets creating weights. Capture Neural networks are mathematical expressions with many...
Weighty Thoughts
The Fall of Data Moats AI actually makes most data moats weaker
a year ago
Matt Mazur
Looking to sell Emergent Mind I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site...
a year ago
61
a year ago
I currently have two products: Preceden, a SaaS timeline maker, and Emergent Mind, an AI news site and newsletter. Emergent Mind began last December as LearnGPT, a ChatGPT examples site, and I later renamed it to Emergent Mind and transitioned it the news site that it is today:...
One Useful Thing
The future, soon: what I learned from Bing's AI We had a brief glimpse of two different types of AI. Both are significant
a year ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing January 26, 2024.
11 months ago
Artificial Ignorance
Bridging AI and human creativity A conversation with Harrison Telyan, co-founder of NUMI.
10 months ago
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Society's Backend
A Privacy Review: TikTok You should stick to Instagram Reels and YouTube Shorts
a year ago
Artificial Ignorance
AI Roundup 090: Computer Use October 25, 2024.
2 months ago
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition A simple answer, and then a less simple one.
a year ago
Society's Backend
AI Reading List 1: Understand Transformers, Reflection-70B Update, and LLMs Still Cannot Reason Society's Backend Reading List 10-07-2024
2 months ago
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
over a year ago
45
over a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new  GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
49
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
Artificial Ignorance
AI Roundup 087: DevDay SF October 4, 2024.
2 months ago
Matt Mazur
Full Time Indie Hacking: Month 5 Update At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline...
a year ago
99
a year ago
At the beginning of the year I quit consulting to focus full time on Preceden, my SaaS timeline maker tool. I also started working on a new side project, Emergent Mind, an AI-powered AI news site. My last update on how things were going was after 3 months which provides more...
Artificial Ignorance
The Industrial Content Revolution A fundamental change in the structure the internet.
a year ago
Artificial Ignorance
Pitfalls of building with large language models Dealing with more than just hallucinations.
a year ago
Daniel Miessler
AI Art Hack: Combining Abstract Designs with Objects This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
58
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
The Gradient
Mamba Explained Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
9 months ago
55
9 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth? Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
3 months ago
51
3 months ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
a month ago
36
a month ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
Sam Altman
Time to Take a Stand It is time for tech companies to start speaking up about some of the actions taken by President...
over a year ago
17
over a year ago
It is time for tech companies to start speaking up about some of the actions taken by President Trump’s administration. There are many actions from his first week that are objectionable.  In repeatedly invoking unsubstantiated conspiracy theories (like the 3 million...
Sam Altman
Idea Generation The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
15
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup. But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
Andrej Karpathy blog
Short Story on AI: A Cognitive Discontinuity. p { text-align: justify; } The idea of writing a collection of short stories has been on my mind...
over a year ago
56
over a year ago
p { text-align: justify; } The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at a story, and what better way to kick things off than with a story on AI and what that might look like if you...
Marcus on AI
An AI rumor you won’t want to miss Converging evidence that the core hypothesis driving generative AI may be wrong
a month ago
IEEE Spectrum
Video Friday: Quadruped Ladder Climbing Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
6
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. IROS 2024: 14–18 October 2024, ABU...
Sam Altman
Funding for COVID-19 Projects I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I...
over a year ago
15
over a year ago
I’m trying to fund startups/projects helping with COVID-19, because it’s basically the one thing I know how to do that can help.  I think we will soon have enough testing capacity, so now I’d like to start funding more startups working on: Producing a lot of ventilators or...
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
over a year ago
32
over a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Society's Backend
Why Machine Learning Terminology is So Confusing And definitions for the most important terms you should know
10 months ago
Society's Backend
The Problem with American Emergency Alerts In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be...
a year ago
31
a year ago
In a world of self-driving cars and human-like chatbots, shouldn't the best technologies would be used for life-saving applications?
One Useful Thing
The Homework Apocalypse Fall is going to be very different this year. Educators need to be ready.
a year ago
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python .wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; ...
over a year ago
61
over a year ago
.wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; font-weight: 300; overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */ } .post pre, .post code { background-color: #fafafa; font-size: 13px; /*...
Daniel Miessler
Scott Kuffer of Nucleus Security | SPONSORED INTERVIEW SERIES In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO...
over a year ago
46
over a year ago
In this standalone episode we’re doing a sponsored interview with Scott Kuffer, co-founder and COO of Nucleus Security. I was already excited by this vendor just based on the research I did to allow them to be a sponsor, but the conversation with them really made me think they’re...
One Useful Thing
What just happened A transformative month rewrites the capabilities of AI
a week ago
Society's Backend
Why Rust Isn't Killing C++ And a consideration for choosing a language
8 months ago
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Daniel Miessler
GPT and Search There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
over a year ago
36
over a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Marcus on AI
CONFIRMED: LLMs have indeed reached a point of diminishing returns Science, sociology, and the likely financial collapse of the Generative AI bubble
a month ago
The Berkeley...
Asymmetric Certified Robustness via Feature-Convex Neural Networks Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric...
a year ago
65
a year ago
Asymmetric Certified Robustness via Feature-Convex Neural Networks TLDR: We propose the asymmetric certified robustness problem, which requires certified robustness for only one class and reflects real-world adversarial scenarios. This focused setting allows us to introduce...
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
46
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
The Berkeley...
Rethinking the Role of PPO in RLHF Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning...
a year ago
110
a year ago
Rethinking the Role of PPO in RLHF TL;DR: In RLHF, there’s tension between the reward learning phase, which uses human preference in the form of comparisons, and the RL fine-tuning phase, which optimizes a single, non-comparative reward. What if we performed RL in a comparative...
One Useful Thing
Something New: On OpenAI's "Strawberry" and Reasoning Solving hard problems in new ways
3 months ago
Sam Altman
Reinforcement Learning Progress Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general...
over a year ago
18
over a year ago
Today, OpenAI released a new result.  We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros. This is the game that to me feels closest to the real world and complex...
One Useful Thing
The Best Available Human Standard What are the imperatives of the upside?
a year ago
Daniel Miessler
Your Experience is Your Creativity Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
52
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Weighty Thoughts
The Real Risks of AI Humans are really the ones to be scared of
7 months ago
Artificial Ignorance
Tutorial: How to build an AI agent (Part 1) Part 1: What is an agent, and how do they work?
a year ago
One Useful Thing
On giving AI eyes and ears AI can listen and see, with bigger implications than we might realize.
a year ago
Artificial Ignorance
AI Roundup 039: The governance issue November 3, 2023.
a year ago
Matt Mazur
Sharing small, incremental updates with users I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
35
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good. Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
The Berkeley...
Interactive Fleet Learning Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
59
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time. In the last few years we have seen an exciting development in robotics and artificial...
Rozado’s Visual...
Prevalence of Prejudice-Denoting Words in News Media Discourse Summary of manuscript “Prevalence of Prejudice-Denoting Words in News Media Discourse: A...
over a year ago
Society's Backend
Godmother of AI Warns Against Regulation, Apple Intelligence System Prompts, Faster and Cheaper AI,... Machine learning resources and updates 8/12/2024
4 months ago
Artificial Ignorance
AI Roundup 086: Llama 3.2 September 27, 2024.
3 months ago
Artificial Ignorance
AI Roundup 077: A good week for open-source July 26, 2024.
5 months ago
IEEE Spectrum
Forums, Competitions, Challenges: Inspiring Creativity in Robotics This is a sponsored article brought to you by Khalifa University of Science and Technology. A total...
3 months ago
6
3 months ago
This is a sponsored article brought to you by Khalifa University of Science and Technology. A total of eight intense competitions to inspire creativity and innovation along with 13 forums dedicated to diverse segments of robotics and artificial intelligence will be part of the...
The Berkeley...
The Shift from Models to Compound AI Systems AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
10 months ago
88
10 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
Rozado’s Visual...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of... Please be mindful of potential confounds: population density, population behavior, virus virulence...
over a year ago
Weighty Thoughts
What’s coming next for AI in 2024 A long overdue VC apocalypse and the birth of the first real AI companies
12 months ago
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received And how it changed my personal life too
a year ago
Matt Mazur
Full Time Indie Hacking: First 3 Months in Review At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS...
a year ago
65
a year ago
At the end of 2022 I stopped contracting at Help Scout to focus full time on Preceden, a SaaS timeline maker tool that I had been running mostly as a side project since 2010. It’s April now so I figured I’d share an update on how things are going. My periodic Friday updates cover...
One Useful Thing
One sentence. Prompting for maximum impact (and why that is a bad idea)
a year ago
Daniel Miessler
NO. 359 | WhatsLeak, CCTV Ban, Meta Threats SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84...
over a year ago
45
over a year ago
SECURITY NEWS There appears to be a WhatsApp data leak of over 500 million users' data in 84 countries. They're supposedly selling the data for $7K in the UK, and around $2K in the US and Germany. MORE The FCC has banned Chinese CCTV cameras on sensitive government sites and...
Artificial Ignorance
GPT-4o and the illusion of AGI Why speed and multimodality is becoming the name of the game.
7 months ago
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
56
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Artificial Ignorance
AI Roundup 067: GPT-4o and Google I/O May 17, 2024.
7 months ago
IEEE Spectrum
Detachable Robotic Hand Crawls Around on Finger-Legs When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some...
3 months ago
6
3 months ago
When we think of grasping robots, we think of manipulators of some sort on the ends of arms of some sort. Because of course we do—that’s how (most of us) are built, and that’s the mindset with which we have consequently optimized the world around us. But one of the great things...
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready I just wrote a piece similar to this last week, but this one drives the point home even more....
over a year ago
42
over a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Matt Mazur
When LTD Purchasers Meet an Inactive User Policy Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo...
a year ago
31
a year ago
Last year I participated in a Lifetime Deal (LTD) promotion to offer Preceden to the AppSumo community. Maybe I’ll dive into my experience there in another post, but I wanted to share an interesting thing that’s happening now, a year after the deal ended. AppSumo has a policy...
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
over a year ago
50
over a year ago
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Strange Loop Canon
Slouching Towards Utopia by Brad DeLong
a year ago
fast.ai
Qualitative humanities research is crucial to AI Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
15
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
One Useful Thing
The Present Future: AI's Impact Long Before Superintelligence You can start to see the outlines of an AI future, for better and worse
a month ago
Artificial Ignorance
How to talk to your family about AI this Thanksgiving A handy guide for your uncle's burning questions.
a year ago
AI Snake Oil
Is AI progress slowing down? Making sense of recent technology trends and claims
a week ago
Weighty Thoughts
Why we need AI as a society We’re aging too fast (AKA my entire AI/robotics investment thesis)
7 months ago
IEEE Spectrum
Video Friday: Swiss-Mile Robot vs. Humans Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 months ago
6
2 months ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids 2024: 22–24 November...
Strange Loop Canon
Why AI hasn’t shown up in the GDP statistics yet AI is meant to bring us closer to utopia, according to its builders.
4 months ago
Rozado’s Visual...
Define Wokeness! Or how you shall know a word by the company it keeps Visualizing what words often appear in the vicinity of woke/wokeness in news media content...
a year ago
52
a year ago
Visualizing what words often appear in the vicinity of woke/wokeness in news media content illustrates why communication is almost impossible between red and blue America
Made by Ollin
A Video History of Self-Driving Cars
over a year ago
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
53
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Matt Mazur
The Kenya Quick Answer Goes Viral, Again On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot...
a year ago
86
a year ago
On Thursday evening Chris Ingraham, a journalist with 100k followers on Twitter, shared a screenshot of the now-famous “african country that starts with k” Google Quick Answer, which quickly went viral, garnering over 82k likes and 3 million views as of the time of this writing...
Artificial Ignorance
GPTs won't make you rich But they'll make you more productive.
11 months ago
AI Snake Oil
I set up a ChatGPT voice interface for my 3-year old. Here’s how it went. Chatbots are likely to revive familiar debates about kids and apps
a year ago
Daniel Miessler
Generate AI Art Using Your Own Writing One of the most challenging parts of finishing a post is coming up with a good image. The AI art...
over a year ago
41
over a year ago
One of the most challenging parts of finishing a post is coming up with a good image. The AI art tools like DALL-E, Midjourney, and Stable Diffusion are cool, but a lot of the magic comes down to prompt engineering, which is non-trivial. Prompt Engineering is almost equal parts...
One Useful Thing
I, Cyborg: Using Co-Intelligence How I used AI in my book about AI
9 months ago
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
over a year ago
40
over a year ago
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
Marcus on AI
Update re: Microsoft and training data Relevant to the post I sent earlier today,...
a month ago
7
a month ago
Relevant to the post I sent earlier today, https://www.howtogeek.com/is-microsoft-using-your-word-documents-to-train-ai/says that an unnamed spokesperson at Microsoft claims that “Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to...
Sam Altman
Hard Startups The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
over a year ago
11
over a year ago
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one.  A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
Rozado’s Visual...
Mentions of Political Extremism in English Wikipedia A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader...
2 weeks ago
23
2 weeks ago
A data-driven exploration uncovers disparities. Are they shaped by editorial choices or broader societal/historical dynamics?
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
56
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Sam Altman
What I Wish Someone Had Told Me Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
a year ago
74
a year ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started. Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
Society's Backend
AI Reading List 3: Meta's Self-Taught Evaluator, AI for Cancer Diagnosis, and a Technical... Society's Backend Reading List 10-21-2024
2 months ago
Artificial Ignorance
Who's winning the AI arms race? It depends whether AI is a "disruptive" or "sustaining" technology.
a year ago
The Berkeley...
Generating 3D Molecular Conformers via Equivariant Coarse-Graining and Aggregated Attention --> Figure 1: CoarsenConf architecture. (I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the...
a year ago
56
a year ago
--> Figure 1: CoarsenConf architecture. (I) The encoder $q_\phi(z| X, \mathcal{R})$ takes the fine-grained (FG) ground truth conformer $X$, RDKit approximate conformer $\mathcal{R}$ , and coarse-grained (CG) conformer $\mathcal{C}$ as inputs (derived from $X$ and a predefined...
Artificial Ignorance
AI Roundup 078: Voice mode August 2, 2024.
5 months ago
Daniel Miessler
My Prediction For Twitter I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
over a year ago
61
over a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Rozado’s Visual...
The Great Awokening as a Global Phenomenon The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
Society's Backend
The State of AI in China Is China winning the race to AGI?
5 months ago
Daniel Miessler
The 2 Current Major AI Bottlenecks I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
40
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Artificial Ignorance
I gave ChatGPT access to my Gmail I'm sure this will end well.
a year ago
Artificial Ignorance
AI Roundup 066: AlphaFold 3 May 10, 2024.
7 months ago
Artificial Ignorance
Stop begging for JSON How OpenAI's Structured Outputs makes building with AI much more reliable.
2 weeks ago
AI Snake Oil
AI Snake Oil is now available to preorder What artificial intelligence can do, what it can't, and how to tell the difference
8 months ago
Artificial Ignorance
AI Roundup 074: Amazon's Adept acquisition July 5, 2024.
5 months ago
fast.ai
My family’s unlikely homeschooling journey Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
over a year ago
Artificial Ignorance
AI Roundup 049: Down the Rabbit hole January 12, 2023.
11 months ago
IEEE Spectrum
Boston Dynamics and Toyota Research Team Up on Robots Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to...
2 months ago
6
2 months ago
Today, Boston Dynamics and the Toyota Research Institute (TRI) announced a new partnership “to accelerate the development of general-purpose humanoid robots utilizing TRI’s Large Behavior Models and Boston Dynamics’ Atlas robot.” Committing to working towards a general purpose...
Sam Altman
Helion Needs You Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
over a year ago
13
over a year ago
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator. The goals of the company are quite ambitious—clean, continuous energy for 1...
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
3 months ago
58
3 months ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Society's Backend
Welcome to 2024: The Year Where AI is No Longer an Option Why everyone should learn about machine learning
12 months ago
Matt Mazur
Going Full Time on My SaaS After 13 Years In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
a year ago
36
a year ago
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
37
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled. The development of tools and methods to guide this process is one of the...
fast.ai
GPT 4 and the Uncharted Territories of Language Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
a year ago
17
a year ago
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Rozado’s Visual...
Pessimism in News Media Headlines In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
67
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
Rozado’s Visual...
A brief response to a reader regarding prejudice denoting terms in Swedish media Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a...
2 weeks ago
22
2 weeks ago
Regarding when Swedish media started to increase mentions of prejudice denoting terminology and a reader comments about it, several things to note:
fast.ai
I was an AI researcher. Now, I am an immunology student. Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
a year ago
16
a year ago
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering And isn't that we're all going to lose our jobs
9 months ago
Sam Altman
Tech Workers' Values For good and bad, technology has become a central force in all our lives. As members of the...
over a year ago
14
over a year ago
For good and bad, technology has become a central force in all our lives. As members of the community, we're interested in ways in which tech companies can use their collective power to protect privacy, rule of law, freedom of expression, and other fundamental American rights....
Artificial Ignorance
Who in their right mind would do an AI hardware startup From megaFLOPS to mega flops.
8 months ago
Artificial Ignorance
AI Roundup 036: The money pit October 13, 2023.
a year ago
AI Snake Oil
Tech policy is only frustrating 90% of the time That’s what makes it worthwhile
9 months ago
Artificial Ignorance
I fell for a deepfake Elon Musk’s cryptocurrency scam bait A lesson in deepfakes, Ponzi schemes, and YouTube algorithm manipulation.
6 months ago
AI Snake Oil
How Transparent Are Foundation Model Developers? Introducing the Foundation Model Transparency Index
a year ago
AI Snake Oil
Is AI-generated disinformation a threat to democracy? An essay on the future of generative AI on social media
a year ago
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
over a year ago
41
over a year ago
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another. Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...
Society's Backend
Weekly Backend #4: 62 Total Resources Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
8 months ago
Marcus on AI
Two visions of AI’s future It’s not looking good
3 weeks ago
Sam Altman
The Strength of Being Misunderstood A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
over a year ago
12
over a year ago
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question. Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
Matt Mazur
When you ship a major bug before signing off for the day For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
37
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
Strange Loop Canon
The Dream AI Hardware
a year ago
Society's Backend
Anti-Social Media How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
36
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
Strange Loop Canon
Is AI hitting a wall?
2 weeks ago
Andrej Karpathy blog
A Survival Guide to a PhD This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
36
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
Matt Mazur
The Security Questionnaire Dilemma About once a year I get an email from someone working in a security and compliance department at a...
a year ago
62
a year ago
About once a year I get an email from someone working in a security and compliance department at a large organization asking that I fill out a detailed security questionnaire to help them assess the risk of their employees using Preceden. I received one recently from a large,...
One Useful Thing
An AI Haunted World Intelligence, everywhere.
a year ago
Weighty Thoughts
Software Engineering is Doomed Or is it?
6 months ago
One Useful Thing
Doing Stuff with AI: Opinionated Midyear Edition AI systems have gotten more capable and easier to use
6 months ago
AI Snake Oil
Licensing is neither feasible nor effective for addressing AI risks Non-proliferation only benefits incumbents
a year ago
Weighty Thoughts
Is AI a Winner-Take-All Market? A critical question for investors in AI
4 months ago
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
over a year ago
47
over a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Society's Backend
All Machine Learning Resources and Updates 06/14/2024 Below are all machine learning resources and updates from the past week you don't want to miss. I’ve...
6 months ago
48
6 months ago
Below are all machine learning resources and updates from the past week you don't want to miss. I’ve decided to try out separating paid/free updates. I’m constantly trying new ways to make information consumption easier for you while working within the confines of the platforms...
Artificial Ignorance
AI Roundup 031: Think of the children September 8, 2023
a year ago
Daniel Miessler
Why Apple Keeps Winning People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
73
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
43
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
Artificial Ignorance
Groq, Gemini, and 10x improvements As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When...
10 months ago
101
10 months ago
As a programmer and CTO, I've developed a rough rule of thumb when it comes to scaling systems. When you scale your inputs (users, page views, messages, etc) by 10x, something breaks. Usually, it's something pretty fundamental. And the end result is that you need to replace a...
fast.ai
From Deep Learning Foundations to Stable Diffusion Practical Deep Learning for Coders part 2, 2022
over a year ago
IEEE Spectrum
Zen and the Art of Aibo Engineering Sony’s team made that happen. And since Aibo’s debut, the company has sold more than 170,000 of...
3 weeks ago
15
3 weeks ago
Sony’s team made that happen. And since Aibo’s debut, the company has sold more than 170,000 of the cute little quadrupeds—a huge number considering their price of several thousand dollars each. From the start, Aibo could express a range of simulated emotions and learn through...
Artificial Ignorance
Distributing the future A reminder that things take time.
7 months ago
Society's Backend
The Step-by-Step Guide to Becoming a Machine Learning Engineer And other practical guides to understand machine learning
11 months ago
Strange Loop Canon
Ode to software
8 months ago
Artificial Ignorance
Tutorial: How to narrate video with Sora, GPT-Vision, and ElevenLabs The future of entertainment is going to be a wild ride.
10 months ago
Society's Backend
MASSIVE New Model Releases from Google, OpenAI, and Meta Change the AI Landscape Society's Backend Reading List 12-16-2024
2 weeks ago
Frank’s Ramblings
A Gentle Introduction to Vector Databases Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium,...
over a year ago
11
over a year ago
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium, and DZone. If you have any feedback, feel free to connect with me on Twitter or Linkedin. If you enjoyed this post and want to learn a bit more about vector databases and embeddings...
IEEE Spectrum
Robot Photographer Takes the Perfect Picture Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell...
a month ago
7
a month ago
Finding it hard to get the perfect angle for your shot? PhotoBot can take the picture for you. Tell it what you want the photo to look like, and your robot photographer will present you with references to mimic. Pick your favorite, and PhotoBot—a robot arm with a camera—will...
IEEE Spectrum
Video Friday: Mars Chopper Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
2 weeks ago
8
2 weeks ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. ICRA 2025: 19–23 May 2025, ATLANTA,...
One Useful Thing
Strategies for an Accelerating Future Four questions to ask your organization.
10 months ago
One Useful Thing
Captain's log: the irreducible weirdness of prompting AIs Also, we have a prompt library!
10 months ago
Strange Loop Canon
Mind the Gap from empire to umpire
a year ago
Artificial Ignorance
Getting to the top of the GPT Store (and building an AI-native search engine, too) Listen now | A conversation with Christian Salem, founder and CPO of Consensus.
8 months ago
Society's Backend
The Unfortunate Truth Regarding AI Regulation And the impact it'll have for decades to come
7 months ago
IEEE Spectrum
SwitchBot S10 Review​: “This Is the Future of Home Robots” I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been...
2 months ago
6
2 months ago
I’ve been reviewing robot vacuums for more than a decade, and robot mops for just as long. It’s been astonishing how the technology has evolved, from the original iRobot Roomba bouncing off of walls and furniture to robots that use lidar and vision to map your entire house and...
AI Snake Oil
Is the future of AI open or closed? Watch today’s Princeton-Stanford workshop By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy...
a year ago
77
a year ago
By Sayash Kapoor, Rishi Bommasani, Percy Liang, Arvind Narayanan Perhaps the biggest tech policy debate today is about the future of AI, especially foundation models and generative AI. Will AI be open or closed? Will we be able to download and modify these models, or will a few...
Society's Backend
Ask Stupid Questions I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term...
a year ago
36
a year ago
I’m convinced that after having a fourth or fifth child exhaustion kicks in and a person’s long-term memory ceases to function properly. I’ve become victim to this and I’ve started taking very detailed notes during meetings. If my brain won’t store the information, something else...
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
47
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
Artificial Ignorance
10 of the most impactful AI stories of 2023 A quick look back on a very busy year in AI.
a year ago
Artificial Ignorance
How a $2000/hour escort uses AI to automate sex work Listen now | A conversation with Adelyn Moore, an independent escort and adult content creator.
4 months ago
AI Snake Oil
AI leaderboards are no longer useful. It's time to switch to Pareto curves. What spending $2,000 can tell us about evaluating AI agents
8 months ago
Sam Altman
The Virus Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
15
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19. I hope that society views this as a warning for the future.  Covid-19 is bad, but only a warm-up.  I think it’s...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT December 1, 2023.
a year ago
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing...
4 months ago
59
4 months ago
Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
Matt Mazur
Emergent Mind finally went viral Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s...
a year ago
65
a year ago
Last week, the Twitter account Everything Out of Context posted a screenshot showing Google’s incorrect response to the search query “country in africa that starts with k”: The tweet went viral, garnering over 133k likes, 6k retweets, and 1k replies. Someone eventually tagged me...
Society's Backend
Founder Mode, How AI Impacts Education, Diffusion Models As Real-Time Game Engines, and More Machine learning resources and updates 2024-09-03
3 months ago
IEEE Spectrum
Remote Sub Sustains Science Kilometers Underwater The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search...
2 months ago
6
2 months ago
The water column is hazy as an unusual remotely operated vehicle glides over the seafloor in search of a delicate tilt meter deployed three years ago off the west side of Vancouver Island. The sensor measures shaking and shifting in continental plates that will eventually unleash...
AI Snake Oil
AI scaling myths Scaling will run out. The question is when.
6 months ago
Marcus on AI
An epidemic of weirdly precise AI butt facts The parade of made-up numbers never stops
2 months ago
Daniel Miessler
Something is Up With Meritocracy I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
48
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Artificial Ignorance
AI Roundup 088: Movie magic October 11, 2024.
2 months ago
Artificial Ignorance
AI Roundup 070: AI whistleblowers June 7, 2024.
6 months ago
Society's Backend
Pelosi opposes SB 1047, New LLM Training Paradigms, Prompt Caching to Save 90% of API Costs, and... Machine learning resources and updates 8/19/2024
4 months ago
IEEE Spectrum
Video Friday: Reachy 2 IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few...
2 months ago
6
2 months ago
IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. IROS 2024: 14–18 October 2024, ABU DHABI, UAE ICSR 2024: 23–26 October 2024, ODENSE, DENMARK Cybathlon 2024: 25–27 October 2024,...
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition August 9, 2024.
4 months ago
fast.ai
A New Chapter for fast.ai: How To Solve It With Code fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To...
a month ago
28
a month ago
fast.ai is joining Answer.AI, and we’re announcing a new kind of educational experience, ‘How To Solve It With Code’
Jascha’s blog
Neural network training makes beautiful fractals window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
10 months ago
2
10 months ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); .md h2 { font-size: 20px; } .vimeo-player { position: relative; width: 444px; height: 444px; ...
Marcus on AI
𝗼𝟯 “𝗔𝗥𝗖 𝗔𝗚𝗜” 𝗽𝗼𝘀𝘁𝗺𝗼𝗿𝘁𝗲𝗺 𝗺𝗲𝗴𝗮𝘁𝗵𝗿𝗲𝗮𝗱: 𝘄𝗵𝘆 𝘁𝗵𝗶𝗻𝗴𝘀 𝗴𝗼𝘁... Kevin Roose, of Hard Fork and NYT, was so impressed with OpenAI’s rollout that he joked “of course...
a week ago
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning function reveal() { const replay = document.querySelector('.ddpo-replay'); ...
a year ago
59
a year ago
function reveal() { const replay = document.querySelector('.ddpo-replay'); replay.style.display = 'flex'; } window.onload = () => { const replay = document.querySelector('.ddpo-replay'); replay.addEventListener('click', () => { ...
Matt Mazur
Redesigning Preceden’s Pricing Page Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page....
a year ago
101
a year ago
Milan (Preceden’s designer) and I recently wrapped up a project to redesign Preceden’s pricing page. Here’s the previous above-the-fold content: And here’s how the new design turned out: Few things to highlight: Very happy with how it turned out. Kudus to Milan for suggesting we...
Rozado’s Visual...
Is The Great Awokening Really Winding Down? Part II: Evidence from News Media Others (here, here and here) have argued previously that The Great Awokening might be winding down....
a year ago
58
a year ago
Others (here, here and here) have argued previously that The Great Awokening might be winding down. I have shown before some preliminary evidence from Twitter content about how Great Awokening terminology with negative connotations are indeed down but those with positive...
Artificial Ignorance
The ideologies fighting for the soul (and future) of AI EAs, e/accs, decels, and doomers.
a year ago
One Useful Thing
AI in organizations: Some tactics Meet the Lab and the Crowd
2 months ago
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen? Exploring the utility of large language models in autonomous driving: Can they be trusted for...
9 months ago
58
9 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse? Providing a technical perspective for a more educated assessment of a complaint I hear quite...
2 months ago
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels --> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
42
over a year ago
--> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Artificial Ignorance
AI Roundup 045: Google's just getting started December 15, 2023.
a year ago
Artificial Ignorance
Case Study: Scaling customer intelligence Analyzing 10,000 sales calls with Claude
a month ago
Weighty Thoughts
Scaling is a Choice Progress in tech is rarely “inevitable.” Looking at semiconductors and AI.
a week ago
Artificial Ignorance
AI Roundup 082: System prompts August 30, 2024.
4 months ago
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
75
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
The Berkeley...
Modeling Extremely Large Images with $x$T As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
9 months ago
98
9 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Artificial Ignorance
What AI models really think about politics Exploring the political biases of ChatGPT, Claude, Gemini, and Grok.
2 months ago
Made by Ollin
NVIDIA Internship (2017) Notes on my internship at NVIDIA Redmond.
over a year ago
Artificial Ignorance
AI Roundup 093: Diminishing returns November 15, 2024.
a month ago
Society's Backend
Artificial Intelligence: A New Paradigm Emerges A realistic perspective of the advantages and pitfalls of artificial intelligence
a year ago
One Useful Thing
Automating creativity There is now strong evidence that AI can help make us more innovative.
a year ago
Frank’s Ramblings
Vision Transformers are Overrated Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
a year ago
53
a year ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
18
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
Artificial Ignorance
Lessons from 139 YC AI startups (S23) The evolution of the AI landscape, and YC's Copilot era.
a year ago
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} ...
over a year ago
2
over a year ago
window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-1XJMTJ5KCK'); Increased efficiency can sometimes, counterintuitively, lead to worse outcomes. This is true almost everywhere. We will name...
Artificial Ignorance
How to leverage long form content with AI Specific tools and tactics for authors, podcasters, and videographers.
6 months ago
Daniel Miessler
News & Analysis | NO. 350
over a year ago
PromptArmor Blog
Data Exfiltration from Slack AI via indirect prompt injection Authors: PromptArmor
4 months ago
AI Snake Oil
New paper: AI agents that matter Rethinking AI agent benchmarking and evaluation
6 months ago
Strange Loop Canon
The agent principal problem "Show me the incentive and I will show you the outcome."
a year ago
One Useful Thing
The practical guide to using AI to do stuff A resource for students in my classes (and other interested people).
a year ago
Artificial Ignorance
AI Roundup 061: The AI innovator's dilemma April 5, 2024.
9 months ago
Weighty Thoughts
Writing, Originality, and Why Does Anyone Care What I Write About? Musings, Insecurities, and Thoughts on Writing a Book (or Substack)
a week ago
Artificial Ignorance
AI Zoology: Why are there so many animal models? Inside the emerging model menagerie.
a year ago
The Gradient
Financial Market Applications of LLMs The AI revolution drove frenzied investment in both private and public companies and captured the...
8 months ago
67
8 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Sam Altman
A Clarification I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to...
over a year ago
14
over a year ago
I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to clarify it. I didn’t mean that we need to tolerate brilliant homophobic jerks in the lab so that we can have scientific progress.  Although there are famous...
Strange Loop Canon
Evaluations are all we need On analysing talent in LLMs
11 months ago
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning You probably know more about machine learning math than you think
11 months ago
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
16
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode One of the many new features announced at yesterday’s OpenAI dev day is better support for...
a year ago
111
a year ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴ Siri versus the machine god?
6 months ago
One Useful Thing
I hope you weren't getting too comfortable. I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits...
a year ago
64
a year ago
I just got access to the new Bing AI. My initial thoughts are that our assumptions about the limits of AI were wrong.
The Gradient
Text-to-CAD: Risks and Opportunities In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
35
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
Artificial Ignorance
Milestones, motivations, and miscellany Some thoughts on the future of this newsletter.
6 months ago
Society's Backend
Open Models Catching Up, SearchGPT Release, Deepfake Victims Protected by Regulation, and More Weekly updates and resources 7/29/24
5 months ago
IEEE Spectrum
Video Friday: Cobot Proxie Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE...
a month ago
6
a month ago
Video Friday is your weekly selection of awesome robotics videos, collected by your friends at IEEE Spectrum robotics. We also post a weekly calendar of upcoming robotics events for the next few months. Please send us your events for inclusion. Humanoids Summit: 11–12 December...
Artificial Ignorance
AI Roundup 095: QwQ November 29, 2024.
a month ago
Artificial Ignorance
AI's invisible instructions What meme prompts can teach us about better interface design.
2 months ago
Society's Backend
Why Machine Learning Technical Debt is Especially Bad And effective ways to mitigate it
9 months ago
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024 The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
6 months ago
65
6 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
Society's Backend
Mastering the Art of Documentation Documentation is really just glorified dog sitting
a year ago
One Useful Thing
Which AI should I use? Superpowers and the State of Play And then there were three...
9 months ago
Artificial Ignorance
Dealing with AI fatigue Notes for myself, and maybe you too.
10 months ago
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested. On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
58
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
fast.ai
Is Avoiding Extinction from AI Really an Urgent Priority? The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
23
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
Artificial Ignorance
A stroll through Google's Model Garden What generative AI capabilities does Google offer to developers?
a year ago
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
over a year ago
55
over a year ago
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Artificial Ignorance
Blade Runner 2024 Reddit's AI Hunters and the quest for authentic digital experiences.
4 months ago
Society's Backend
The FTC Cracks Down on Fake AI-Generated Reviews, Midjourney Available on the Web, AI Used to Farm... Machine learning resources and updates 8/26/2024
4 months ago
Strange Loop Canon
Seeing Like A Network Dark Forests, Dense Networks
6 months ago
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
a year ago
101
a year ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Artificial Ignorance
How Shopify is making AI Magic A case study on turning competitive advantages into useful AI.
a year ago
Marcus on AI
Cognitive scientist Gary Marcus says AI must be regulated. He has a plan. Fantastic writeup of my views today at The Wall Street Journal:
a month ago
IEEE Spectrum
How a Robot Is Grabbing Fuel From a Fukushima Reactor Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power...
2 months ago
6
2 months ago
Thirteen years since a massive earthquake and tsunami struck the Fukushima Dai-ichi nuclear power plant in northern Japan, causing a loss of power, meltdowns and a major release of radioactive material, operator Tokyo Electric Power Co. (TEPCO) finally seems to be close to...
Society's Backend
Stop Obsessing Over the Product and Start Thinking About the Bigger Picture The actual takeaways from the iPhone 15 event
a year ago
One Useful Thing
Democratizing the future of education We are all EdTech designers, now
a year ago
Sam Altman
Greg A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg...
over a year ago
10
over a year ago
A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg Brockman. Every successful startup I know has at least one person who provides the force of will to make the startup happen.  I’d thought a lot about this in the abstract while advising YC...
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards Counterintuitively, start from how much money you need
over a year ago
Artificial Ignorance
AI Roundup 029: Hug all the faces August 25, 2023
a year ago
Artificial Ignorance
AI Roundup 041: Lyria November 17, 2023.
a year ago
The Gradient
Neural algorithmic reasoning In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
39
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
Society's Backend
Clarifying DEI What makes DEI important and where it fails
11 months ago
Andrej Karpathy blog
A Recipe for Training Neural Networks Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
over a year ago
29
over a year ago
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
Society's Backend
Why MLX is Important for the ML Community And a step-by-step guide to train a machine learning model on your Mac
7 months ago
AI Snake Oil
The LLaMA is out of the bag. Should we expect a tidal wave of disinformation? The bottleneck isn't the cost of producing disinfo, which is already very low.
a year ago
Andrej Karpathy blog
Short Story on AI: Forward Pass p { text-align: justify; } .post pre, .post code { border: none; background-color:...
over a year ago
34
over a year ago
p { text-align: justify; } .post pre, .post code { border: none; background-color: #eee; } The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Matt Mazur
It’s Time to Build It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
8 months ago
99
8 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
One Useful Thing
What OpenAI did A new model opens up new possibilities
7 months ago
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW) (Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we...
a year ago
13
a year ago
(Note: A version of this post has been cross-published to the Zilliz blog) In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
51
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
Sam Altman
DALL•E 2 Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
over a year ago
11
over a year ago
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.  Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
AI Snake Oil
OpenAI’s policies hinder reproducible research on language models LLMs have become privately-controlled research infrastructure
a year ago
Rozado’s Visual...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
over a year ago
40
over a year ago
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
AI Snake Oil
Does the UK’s liver transplant matching algorithm systematically exclude younger patients? Seemingly minor technical decisions can have life-or-death effects
a month ago
Weighty Thoughts
Most AI startups are doomed Just because it matters doesn’t mean it’s defensible or profitable
a year ago
IEEE Spectrum
Why Simone Giertz, the Queen of Useless Robots, Got Serious On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked...
2 months ago
6
2 months ago
On YouTube she demonstrated a hilarious series of self-built mechanized devices that worked perfectly for ridiculous applications, such as a headboard-mounted alarm clock with a rubber hand to slap the user awake. This article is part of our special report, “Reinventing...
IEEE Spectrum
Drones with Legs Can Walk, Hop, and Jump into the Air “Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or...
3 weeks ago
8
3 weeks ago
“Whenever I encountered crows on the EPFL campus, I would observe how they walked, hopped over or jumped on obstacles, and jumped for take-offs,” says Won Dong Shin, a doctoral student at EPFL’s Laboratory of Intelligent Systems. “What I consistently observed was that they always...
Matt Mazur
Preceden’s Spam Problem Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS...
a year ago
99
a year ago
Around a year ago, I started noticing some spammy timelines being created on Preceden, my SaaS timeline maker tool. I’m honestly surprised it took spammers so long: Preceden is a freemium product (meaning people can sign up and try it for free), the product makes it very easy to...
Artificial Ignorance
How Intercom is transforming customer support with AI A conversation with Fergal Reid, VP of AI at Intercom.
8 months ago
One Useful Thing
In Praise of Boring AI Automation has always been about killing tedious work. AI can do the same.
a year ago
Artificial Ignorance
The State of AI Engineering Notes from the first AI Engineer Summit.
a year ago
Daniel Miessler
Summary: Andrej Karpathy on Lex Fridman’s Podcast (Late 2022) This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
Society's Backend
AI Video Editing, MLX vs PyTorch, AI in Space, and More [Comprehensive ML Resource List for 6/28/24] Here is a comprehensive list of all machine learning resources and updates from the past week. Thank...
6 months ago
47
6 months ago
Here is a comprehensive list of all machine learning resources and updates from the past week. Thank you for supporting Society's Backend! Don't forget to also follow me on X. Claude 3.5 Sonnet Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?
Society's Backend
Allen AI and DeepSeek are Taking Off, Professional Advice for Working in AI, Agentic Web Design, and... Society's Backend Reading List 12-2-2024
4 weeks ago
One Useful Thing
Confronting Impossible Futures We shouldn't be certain about what is next, but we should plan for it
5 months ago
Artificial Ignorance
AI Roundup 062: Data is the new oil April 12, 2024.
8 months ago
Sam Altman
Keep the Internet Open The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated...
over a year ago
14
over a year ago
The FCC has announced plans to roll back policies on net neutrality, and its new head has indicated he has no plan to stop soon. The internet is a public good, and I believe access should be a basic right.  We've seen such great innovation in software because the internet has...
One Useful Thing
Now is the time for grimoires It isn't data that will unlock AI, it is human expertise
a year ago
AI Snake Oil
Three Ideas for Regulating Generative AI Policy input to the federal government from a Stanford-Princeton team
a year ago
Matt Mazur
Screw it, I’m Keeping Emergent Mind A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
76
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
Artificial Ignorance
From Stable Diffusion to Stable Everything Inside Stability AI's roster of AI models.
7 months ago
Sam Altman
The Merge A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
15
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075. People used to call this the...
The Gradient
The Artificiality of Alignment This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk”...
a year ago
39
a year ago
This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
One Useful Thing
How to Get an AI to Lie to You in Three Simple Steps I keep getting fooled by AI, and it seems like others are, too.
a year ago