Full Width [alt+shift+f] Shortcuts [alt+shift+k] About [alt+shift+a]
Sign Up [alt+shift+s]
Top Categories > AI
#all #programming #history #startups #architecture #travel #science #life #creative #literature #comics #design #cartography #AI #finance #technology #indiehacker settings [alt+←][alt+→]
The original startup marketplace

Borderline.biz

Borderline is a great way to sell smaller startups with valuations under $20k. Since 2017, we've helped dozens of founders sell their projects liquidating over $2m in assets.

Weighty Thoughts
News Roundup: May 27, 2014 🧴 Why does Google suck so much, Microsoft Co-Pilot Everywhere, and Sam Altman
5 months ago
Frank’s Ramblings
My Experience Living and Working in China, Part I In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
over a year ago
6
over a year ago
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
Artificial Ignorance
AI Roundup 050: Synthetic Geometry January 19, 2024.
9 months ago
Weighty Thoughts
Let’s Talk About AI Compute What really matters and why AI computing is exactly the same as all other large-scale computing
a year ago
Matt Mazur
Screw it, I’m Keeping Emergent Mind A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I...
a year ago
64
a year ago
A few months ago I announced I was going to try to sell Emergent Mind, my AI news aggregator, so I could focus on Preceden, my SaaS timeline maker. I wound up having a lot of discussions with potential buyers, but in the end the offers I received were either too low to be worth...
One Useful Thing
Which AI should I use? Superpowers and the State of Play And then there were three...
7 months ago
Strange Loop Canon
Why AI hasn’t shown up in the GDP statistics yet AI is meant to bring us closer to utopia, according to its builders.
2 months ago
The Berkeley...
TinyAgent: Function Calling at the Edge The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic...
5 months ago
50
5 months ago
The ability of LLMs to execute commands through plain language (e.g. English) has enabled agentic systems that can complete a user query by orchestrating the right set of tools (e.g. ToolFormer, Gorilla). This, along with the recent multi-modal efforts such as the GPT-4o or...
Sam Altman
GPT-4o There are two things from our announcement today I wanted to highlight. First, a key part of our...
5 months ago
78
5 months ago
There are two things from our announcement today I wanted to highlight. First, a key part of our mission is to put very capable AI tools in the hands of people for free (or at a great price). I am very proud that we’ve made the best model in the world available for free in...
The Berkeley...
The Shift from Models to Compound AI Systems AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to...
8 months ago
68
8 months ago
AI caught everyone’s attention in 2023 with Large Language Models (LLMs) that can be instructed to perform general tasks, such as translation or coding, just by prompting. This naturally led to an intense focus on models as the primary ingredient in AI application development,...
Artificial Ignorance
AI Roundup 083: Bioacoustics September 6, 2024.
a month ago
The Berkeley...
On the Stepwise Nature of <br> Self-Supervised Learning Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we...
a year ago
60
a year ago
Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we find that the loss descends in a stepwise fashion (top left) and the learned embeddings iteratively increase in dimensionality (bottom left). Direct visualization of embeddings...
Artificial Ignorance
AI Roundup 043: Happy birthday, ChatGPT December 1, 2023.
11 months ago
One Useful Thing
Strategies for an Accelerating Future Four questions to ask your organization.
8 months ago
Matt Mazur
Introducing Preceden’s new AI-Powered Timeline Generator For the past few months I’ve been heads down building an AI-powered timeline generator tool for...
a year ago
46
a year ago
For the past few months I’ve been heads down building an AI-powered timeline generator tool for Preceden, my SaaS timeline maker software: The tool – which is free to use and available on Preceden’s homepage – lets you type in a topic or detailed description of a timeline and it...
Society's Backend
Would You Build the Manhattan Project in the UAE? Thoughts on AI national security threats
4 months ago
Daniel Miessler
GPT and Search There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down...
a year ago
27
a year ago
There’s a lot of talk about how GPT is going to take over search. Meaning, compete with or take down Google. I get the excitement there, but there are some pretty serious barriers to having this happen immediately. First, GPT is non-deterministic, meaning you can ask it the same...
Rozado’s Visual...
ChatGPT no longer displays a clear left-leaning political bias Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter...
a year ago
39
a year ago
Update (20/01/2023): Results of administering 15 political orientation tests to ChatGPT Twitter Thread Summary Between December 5-6, I applied 4 political orientation tests to ChatGPT. Results were consistent across the tests. All 4 tests diagnosed ChatGPT answers to their...
Strange Loop Canon
We all live on a knife's edge, and it's fine Or: How we weaponised serendipity
7 months ago
One Useful Thing
Gradually, then Suddenly: Upon the Threshold Small improvements can lead to big changes
3 months ago
The Gradient
Financial Market Applications of LLMs The AI revolution drove frenzied investment in both private and public companies and captured the...
6 months ago
43
6 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
Strange Loop Canon
Mind the Gap from empire to umpire
a year ago
AI Snake Oil
A misleading open letter about sci-fi AI dangers ignores the real risks Misinformation, labor impact, and safety are all risks. But not in the way the letter implies.
a year ago
Society's Backend
A Technical Perspective: Has Google Search Gotten Worse? Providing a technical perspective for a more educated assessment of a complaint I hear quite...
a week ago
Artificial Ignorance
Who in their right mind would do an AI hardware startup From megaFLOPS to mega flops.
6 months ago
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
a year ago
53
a year ago
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
Artificial Ignorance
YCombinator's AI boom is still going strong (W24) Combing through all 158 YC AI startups (65% of the batch).
7 months ago
One Useful Thing
Automating creativity There is now strong evidence that AI can help make us more innovative.
a year ago
Rozado’s Visual...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system Should AI systems treat different demographic groups unequally?
a year ago
Sam Altman
Idea Generation The most common question prospective startup founders ask is how to get ideas for startups. The...
over a year ago
9
over a year ago
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup. But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
Artificial Ignorance
Looking a gift llama in the mouth How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical...
3 months ago
35
3 months ago
How Llama 3.1 uniquely leverages Meta's business model (and why we should be a little bit cynical about it)
Daniel Miessler
NO. 361 | GPT++, Apple Security, CISA Cuba… SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and...
a year ago
37
a year ago
SECURITY NEWS South Korean authorities are warning that North Koreans are disguising themselves and getting jobs in South Korea. The saddest part is that it appears to be just another income generation scheme, meaning they use the salaries to fund the North Korean nuclear...
Daniel Miessler
News & Analysis | NO. 353
over a year ago
Society's Backend
The Unfortunate Truth Regarding AI Regulation And the impact it'll have for decades to come
5 months ago
Andrej Karpathy blog
Deep Reinforcement Learning: Pong from Pixels --> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have...
over a year ago
34
over a year ago
--> This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically learn to play ATARI games (from raw game pixels!), they are beating world champions at Go, simulated quadrupeds are learning to run and leap,...
Artificial Ignorance
Who's winning the AI arms race? It depends whether AI is a "disruptive" or "sustaining" technology.
10 months ago
Rozado’s Visual...
Northern Awokening: Social-justice and prejudice-signifying language in Canadian news media I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about...
a year ago
61
a year ago
I have recently published a report with Aaron Wudrick from the Macdonald-Laurier Institute about changes in the language that the news media in Canada use. I have documented previously how in American news media mentions of terms that signify distinct forms of prejudice have...
Strange Loop Canon
Ode to software
6 months ago
Rozado’s Visual...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
over a year ago
40
over a year ago
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
One Useful Thing
I, Cyborg: Using Co-Intelligence How I used AI in my book about AI
7 months ago
Society's Backend
Alignment: Understanding the Multi-Billion Dollar Opportunity within Machine Learning A glimpse into the biggest challenge in the world of AI, why it matters to you, and why it's worth...
8 months ago
One Useful Thing
An AI Haunted World Intelligence, everywhere.
10 months ago
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good. Teachers adapted to the calculator. They can certainly adapt to language models.
over a year ago
Artificial Ignorance
AI Roundup 057: Claude 3 March 8, 2024.
7 months ago
One Useful Thing
A quick and sobering guide to cloning yourself It took me a few minutes to create a fake me giving a fake lecture.
a year ago
Artificial Ignorance
The hidden side of Apple Intelligence More than just another keynote recap.
4 months ago
Sam Altman
Quora I'm a strong believer in the importance of the internet in helping people to share knowledge and...
over a year ago
10
over a year ago
I'm a strong believer in the importance of the internet in helping people to share knowledge and learn from each other.  So I’m delighted to share, on behalf of YC Continuity, that we’re investing alongside Collaborative Fund in Quora. Quora is doing extremely well. They now...
Society's Backend
All Machine Learning Resources and Updates 06/21/2024 Below are the machine learning resources and updates from the past few days you don't want to miss....
4 months ago
27
4 months ago
Below are the machine learning resources and updates from the past few days you don't want to miss. If you want all the ML updates from X, follow me there. Mamba + Sliding Window Attention = SAMBA with Efficient Unlimited... China runs to be one of top global players in AI model...
One Useful Thing
Now is the time for grimoires It isn't data that will unlock AI, it is human expertise
a year ago
The Berkeley...
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination Sample language model responses to different varieties of English and native speaker...
a month ago
35
a month ago
Sample language model responses to different varieties of English and native speaker reactions. ChatGPT does amazingly well at communicating with people in English. But whose English? Only 15% of ChatGPT users are from the US, where Standard American English is the default. But...
Matt Mazur
Sharing small, incremental updates with users I use a service called Headway to keep Preceden users informed about updates to the product. Headway...
a year ago
28
a year ago
I use a service called Headway to keep Preceden users informed about updates to the product. Headway provides a widget I have installed on Preceden to let users know when there have been updates. Users will see a bell with a count of unread items (which Headway keeps track of in...
Matt Mazur
LearnGPT is for sale. Contact me if you’re interested. On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business....
a year ago
44
a year ago
On Friday I announced that I intended to shut down LearnGPT to focus on Preceden, my main business. I didn’t plan to sell LearnGPT because I didn’t think a month-old, pre-revenue project like this would be able to sell for enough to warrant going through a sale. It’s been three...
Artificial Ignorance
The Industrial Content Revolution A fundamental change in the structure the internet.
11 months ago
Artificial Ignorance
AI Roundup 051: The Taylor Swift thing January 26, 2024.
9 months ago
One Useful Thing
Magic for English Majors Programming in prose in an AI-haunted world
a year ago
Matt Mazur
Is the ChatGPT API Refusing to Summarize Academic Papers? Not so fast. Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API...
10 months ago
54
10 months ago
Yesterday on X, I shared a post about some responses I was getting from the ChatGPT 3.5 API indicating that it was refusing to summarize arXiv papers: There has been a lot of discussion recently about the perceived decrease in the quality of ChatGPT’s responses and seeing...
One Useful Thing
A guide to prompting AI (for what it is worth) A little bit of magic, but mostly just practice
a year ago
AI Snake Oil
OpenAI’s policies hinder reproducible research on language models LLMs have become privately-controlled research infrastructure
a year ago
Frank’s Ramblings
Vision Transformers are Overrated Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious...
10 months ago
39
10 months ago
Vision transformers (ViTs) have seen an incredible rise in the past four years. They have an obvious upside: in a visual recognition setting, the receptive field of a pure ViT is effectively the entire image 1. In particular, vanilla ViTs maintain the quadratic time complexity...
Strange Loop Canon
Progress when benefits are worth tallying the human cost of technological leaps
a year ago
One Useful Thing
Google's Gemini Advanced: Tasting Notes and Implications And then there were two.
8 months ago
Strange Loop Canon
Slouching Towards Utopia by Brad DeLong
a year ago
Society's Backend
Google AI Essentials, A New LLM Benchmark, Washington's AI Task Force, and More [Top 10 ML Resource... Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and...
4 months ago
38
4 months ago
Top 10 Machine Learning Resources and Updates Below are the top 10 machine learning resources and updates from the past week you don't want to miss. I share more frequent ML updates on X so don’t forget to follow me there. Support Society's Backend for just $1/mo
Sam Altman
Productivity I think I am at least somewhat more productive than average, and people sometimes ask me...
over a year ago
5
over a year ago
I think I am at least somewhat more productive than average, and people sometimes ask me for productivity tips.  So I decided to just write them all down in one place. Compound growth gets discussed as a financial concept, but it works in careers as well, and it is magic.  A...
Artificial Ignorance
LLMs are getting dumber and we have no idea why Five theories that could explain how chatbots are getting worse.
a month ago
Daniel Miessler
The 2 Current Major AI Bottlenecks I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve...
a year ago
33
a year ago
I’ve been going hardcore on using GPT to create essays, reports, and other kinds of analysis. I’ve had tons of success with it, and it’s given me a clear view of current limitations with the current tech. I’m not complaining. This stuff is brand-new. Here are the current...
Society's Backend
Should You Get a PhD? The one good reason to do a PhD and two others that fall flat
a month ago
fast.ai
The Jupyter+git problem is now solved Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
over a year ago
9
over a year ago
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Society's Backend
The Method Google Used to Reduce LLM Size by 66% A brief overview of knowledge distillation and its capabilities
3 months ago
One Useful Thing
Thinking Like an AI A little intuition can help
a week ago
Daniel Miessler
AI is About to Feel Like AGI, and You Need to Get Ready I just wrote a piece similar to this last week, but this one drives the point home even more....
a year ago
35
a year ago
I just wrote a piece similar to this last week, but this one drives the point home even more. Basically, the current trajectory of AI, with all the art generation, the language models, etc., are about to become a whole lot more instruction and response based. What does that mean?...
Society's Backend
Backend Biweekly #1: Important AI Developments and ML Learning Resources Updates on Apple, Mistral, and Microsoft and resources to build the GPT tokenizer, use MLX to train...
8 months ago
Artificial Ignorance
AI Roundup 065: The gpt2-chatbot mystery May 3, 2024.
6 months ago
Strange Loop Canon
I wrote a book! AI enables us to, finally, get "soft" APIs
a year ago
Artificial Ignorance
AI Roundup 085: You win some, you Newsom September 20, 2024.
a month ago
Society's Backend
What Makes Machine Learning so Hard for Software Engineers How decades of learning a mindset makes adapting difficult
2 months ago
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
a year ago
37
a year ago
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new  GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
One Useful Thing
On holding back the strange AI tide There is no way to stop the disruption. We need to channel it instead
a year ago
Made by Ollin
Mac Replacement Icons A standardized, simplified, and beautiful icon set
over a year ago
Matt Mazur
Running Mistral 8x7Bs Mixture of Experts on a Macbook Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my...
10 months ago
27
10 months ago
Below are the steps I used to get Mistral 8x7Bs Mixture of Experts (MOE) model running locally on my Macbook (with its Apple M2 chip and 24 GB of memory). Here’s a great overview of the model for anyone interested in learning more. Short version: The Mistral “Mixtral” 8x7B 32k...
Strange Loop Canon
The age of access the great polarisation theory, and the death of professions
11 months ago
Daniel Miessler
My Prediction For Twitter I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the...
a year ago
44
a year ago
I’m a bit Elon and Twittered out, but I want to capture a basic prediction about all the shenanigans. As for my take on things, I will just say that Elon miscalculated a number of things in his handling of the transition. I think he thought his actions would be better received....
Weighty Thoughts
Software Engineering is Doomed Or is it?
4 months ago
Artificial Ignorance
Milestones, motivations, and miscellany Some thoughts on the future of this newsletter.
4 months ago
AI Snake Oil
GPT-4 and professional benchmarks: the wrong answer to the wrong question OpenAI may have tested on the training data. Besides, human benchmarks are meaningless for bots.
a year ago
Artificial Ignorance
AI Zoology: Why are there so many animal models? Inside the emerging model menagerie.
a year ago
Society's Backend
Top 10 Machine Learning Resources and Updates 06/21/2024 The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases...
4 months ago
41
4 months ago
The fastest way to get up to speed on ML fundamentals, Meta releases new models, NVIDIA releases open models, Google generates audio for video, and more
fast.ai
There’s no such thing as not a math person Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
over a year ago
Rozado’s Visual...
The Political Biases of GPT-4 Things are not always what they seem
a year ago
One Useful Thing
The Machines of Mastery "Anyone can learn anything they want..." and how technology can help
a year ago
Society's Backend
AI and Software Reading List 4: State of the Job Market, Apple's Private Cloud Compute Released for... Society's Backend Reading List 10-28-2024
2 days ago
Society's Backend
Why Rust Isn't Killing C++ And a consideration for choosing a language
6 months ago
Artificial Ignorance
AI Roundup 063: Llama 3 April 19, 2024.
6 months ago
AI Snake Oil
Is AI-generated disinformation a threat to democracy? An essay on the future of generative AI on social media
a year ago
The Gradient
Neural algorithmic reasoning In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
30
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
Sam Altman
Time to Take a Stand It is time for tech companies to start speaking up about some of the actions taken by President...
over a year ago
10
over a year ago
It is time for tech companies to start speaking up about some of the actions taken by President Trump’s administration. There are many actions from his first week that are objectionable.  In repeatedly invoking unsubstantiated conspiracy theories (like the 3 million...
Artificial Ignorance
AI Roundup 081: Creative differences August 23, 2024.
2 months ago
Daniel Miessler
How to Survive and Thrive in a World Where AI Can Do Almost Everything Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance....
a year ago
50
a year ago
Click for printable size. Here’s a quick list of things we can do to get ready for AI’s ascendance. You can click it to get the full size to print out. This is UL Member Content Subscribe Already a member? Login
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
a year ago
38
a year ago
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Society's Backend
A Privacy Review: TikTok You should stick to Instagram Reels and YouTube Shorts
a year ago
AI Snake Oil
ML is useful for many things, but not for predicting scientific replicability How the veneer of AI is used to legitimize awful ideas
a year ago
Sam Altman
US Digital Currency I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
over a year ago
6
over a year ago
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far).  There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror. ...
Society's Backend
The Metrics Machine Learning Engineers Care About That Modelers Don't And a brief overview of TPUs in Google data centers
8 months ago
One Useful Thing
Signs and Portents Some hints about what the next year of AI looks like
9 months ago
Artificial Ignorance
10 AI predictions for 2024 Hey Siri, set a reminder for 365 days.
10 months ago
fast.ai
AI and Power: The Ethical Challenges of Automation, Centralization, and Scale Moving AI ethics beyond explainability and fairness to empowerment and justice
a year ago
Rozado’s Visual...
Is climate change 100 times more threatening than gain-of-function research? Mentions of climate change in news media vastly outnumber other existential threats
a year ago
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen? Exploring the utility of large language models in autonomous driving: Can they be trusted for...
7 months ago
40
7 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
Daniel Miessler
Stadia is Google’s Product Strategy Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
over a year ago
27
over a year ago
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Weighty Thoughts
When the AI Bubble Bursts It’s when, not if, for these kinds of new technologies
4 months ago
One Useful Thing
Catastrophe / Eucatastrophe We have more agency over the future of AI than we think.
a year ago
fast.ai
From Deep Learning Foundations to Stable Diffusion We’ve released our new course with over 30 hours of video content.
a year ago
AI Snake Oil
Artists can now opt out of generative AI. It’s not enough. Opting out is the latest example of generative AI developers externalizing costs.
a year ago
One Useful Thing
Confronting Impossible Futures We shouldn't be certain about what is next, but we should plan for it
3 months ago
Society's Backend
Meet Devansh: Lessons Learned While Building a Community of 193,000 Subscribers Content creation and networking lessons from a wildly successful freelance tech writer
a year ago
Weighty Thoughts
Consider the Llama Are closed source AI models doomed?
3 months ago
Frank’s Ramblings
a16z Blogs Are Just Glorified Marketing … glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on...
a year ago
16
a year ago
… glorified marketing for portfolio companies, that is I came across one of a16z’s blog posts on Hacker News today, titled Emerging Architectures for LLM Applications. For folks who didn’t catch it, here’s the tl;dr: The emerging LLM stack is composed of several elements centered...
One Useful Thing
What AI can do with a toolbox... Getting started with Code Interpreter Democratizing data analysis with AI
a year ago
Artificial Ignorance
AI Roundup 044: Google Gemini December 8, 2023.
10 months ago
Artificial Ignorance
Bridging AI and human creativity A conversation with Harrison Telyan, co-founder of NUMI.
8 months ago
Artificial Ignorance
States are racing ahead of Congress to regulate deepfakes Several states just banned deepfakes in political ads and porn.
7 months ago
Daniel Miessler
Using Custom Searches in Safari (in 2022) I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss...
over a year ago
26
over a year ago
I’ve just started using Safari again after being on Chrome for a while, and one of the things I miss most from Chrome is custom searches. There you can search Amazon directly from the address bar by doing: You can change the search prompts to be single letters like ‘a’ for...
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion 4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
over a year ago
9
over a year ago
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Rozado’s Visual...
Define Wokeness! Or how you shall know a word by the company it keeps Visualizing what words often appear in the vicinity of woke/wokeness in news media content...
a year ago
41
a year ago
Visualizing what words often appear in the vicinity of woke/wokeness in news media content illustrates why communication is almost impossible between red and blue America
Society's Backend
Backend Biweekly #3: 97 Updates and Resources Huge Nvidia Updates, Gemini Hackathon for Money, and more
7 months ago
Society's Backend
An Overview of Text Summarization Methods from Simple to Complex We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color...
11 months ago
35
11 months ago
We went through a bit of a rebrand. Let me know what you think about Society’s Backend’s new color scheme and logo! :) - Logan I've been researching text summarization methods for a project I'm working on. Since the advent of Large Language Models (LLMs), LLMs have become a go-to...
One Useful Thing
Everyone is above average Is AI a Leveler, King Maker, or Escalator?
a year ago
Rozado’s Visual...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
over a year ago
25
over a year ago
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Weighty Thoughts
One Definite Sign of a Bad Startup Idea If you can’t tell anyone about your startup idea, it's not a good idea
over a year ago
Artificial Ignorance
AI Roundup 040: GPTs November 10, 2023.
11 months ago
Society's Backend
Devin Has Exposed a Major Issue with Software Engineering And isn't that we're all going to lose our jobs
7 months ago
AI Snake Oil
Four more things we worked on in 2022 We had a busy 2022. Here are a few things we worked on but didn’t cover here.
a year ago
Daniel Miessler
UL NO. 354 | THE NEWS & ANALYSIS SERIES SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from...
over a year ago
41
over a year ago
SECURITY NEWS The US has implemented a number of aggressive export controls to stop China from attaining advanced semiconductors. And now it looks like the bans will be expanded to quantum computing and AI as well. NYTIMES | MY ANALYSIS BELOW It appears Bytedance had a plan to...
Matt Mazur
LearnGPT is now EmergentMind Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a...
a year ago
39
a year ago
Naming things is hard. Shortly after ChatGPT launched at the end of November, I decided to build a site to share ChatGPT examples and eventually be the home to educational content to help people learn more about GPT. To my surprise, there were a lot of relevant available .com...
The Gradient
Interpretability Creationism On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
19
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
One Useful Thing
The shape of the shadow of The Thing We can start to see, dimly, what the near future of AI looks like.
a year ago
Society's Backend
JAX is for More Than Just Machine Learning What JAX is and its potential applications
5 months ago
Society's Backend
Positioning Myself: The Greatest Piece of Career Advice I've Ever Received And how it changed my personal life too
10 months ago
Rozado’s Visual...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news... I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
over a year ago
32
over a year ago
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
AI Snake Oil
Will AI transform law? The hype is not supported by current evidence
9 months ago
Daniel Miessler
AI Art Will Push the Top 1% to Human Artists One effect I think we’ll see from all this AI-generated art is magnified status for those who insist...
over a year ago
34
over a year ago
One effect I think we’ll see from all this AI-generated art is magnified status for those who insist on the opposite, i.e., manual, human art. The more manual the better. The more human the better. Ideally there’d only be one of whatever you have, and it’d only be yours. Why is...
The Berkeley...
Ghostbuster: Detecting Text Ghostwritten by Large Language Models The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated...
11 months ago
67
11 months ago
The structure of Ghostbuster, our new state-of-the-art method for detecting AI-generated text. Large language models like ChatGPT write impressively well—so well, in fact, that they’ve become a problem. Students have begun using these models to ghostwrite assignments, leading...
Daniel Miessler
NO. 368 | ChinaBalloons, CustomGPT, 90s++… ✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll...
a year ago
41
a year ago
✅ Please add this address to your "safe senders" or equivalent within your mail client. It'll prevent the email from occasionally descending into the void. SECURITY The US shot down a Chinese spy balloon. They gathered the debris from the water it fell into, and it's currently...
Rozado’s Visual...
The Political Bias of ChatGPT – Extended Analysis On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in...
a year ago
41
a year ago
On December 6th I published a preliminary analysis showing a left-leaning political bias embedded in the first release of ChatGPT from November 30. After the December 15th update of ChatGPT, I replicated my analysis and it appeared as if the political bias had been partially...
Daniel Miessler
NO. 367 | Hive Ransom, Anti-Google, Software 2.0… 🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
49
a year ago
🎙️If you’re not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI infiltrated the HIVE ransomware group, stopping over $130 million in ransomware attacks. HIVE is known for going...
One Useful Thing
How to... use AI to unstick yourself We often lose momentum because of something small. AI can help.
a year ago
Society's Backend
Bridging the Gap from Simple Algebra to Machine Learning You probably know more about machine learning math than you think
9 months ago
Sam Altman
The Virus Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
over a year ago
8
over a year ago
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19. I hope that society views this as a warning for the future.  Covid-19 is bad, but only a warm-up.  I think it’s...
Sam Altman
Researchers and Founders I spent many years working with founders and now I work with researchers. Although there are always...
over a year ago
7
over a year ago
I spent many years working with founders and now I work with researchers. Although there are always individual exceptions, on average it’s surprising to me how different the best people in these groups are (including in some qualities that I had assumed were present in great...
Artificial Ignorance
AI Roundup 030: OpenAI's $1B revenue September 1, 2023
a year ago
Society's Backend
If You Understand Bananas, You Can Understand Machine Learning A simplified high-level overview of primary machine learning algorithms for anyone to understand
9 months ago
Rozado’s Visual...
Frecuencia de términos en el periódico generalista más leído de España Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post...
over a year ago
29
over a year ago
Frecuencia de términos en el periódico generalista más leído de España: El País Twitter post Verification of integrity of frequency counts: https://zenodo.org/record/5674590
Rozado’s Visual...
The Increasing Negativity and Emotionality of News Media Headlines Published article Introduction I have recently published a paper where we describe a chronological...
over a year ago
42
over a year ago
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
Artificial Ignorance
AI Roundup 034: Meta Connect September 29, 2023
a year ago
Made by Ollin
Maple Diffusion I ported Stable Diffusion to my phone
over a year ago
fast.ai
Masks for COVID: Updating the evidence Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
over a year ago
5
over a year ago
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
AI Snake Oil
Can AI automate computational reproducibility? A new benchmark to measure the impact of AI on improving science
a month ago
Artificial Ignorance
AI Roundup 058: Devin and SIMA March 15, 2023.
7 months ago
Artificial Ignorance
AI Roundup 026: AudioCraft August 4, 2023
a year ago
One Useful Thing
Superhuman: What can AI do in 30 minutes? AI multiplies your efforts. I found out by how much...
a year ago
The Berkeley...
Goal Representations for Instruction Following Goal Representations for Instruction Following Figure title. Figure caption. This image is...
a year ago
73
a year ago
Goal Representations for Instruction Following Figure title. Figure caption. This image is centered and set to 50% page width. --> A longstanding goal of the field of robot learning has been to create generalist agents that can perform tasks for humans. Natural language has...
Matt Mazur
Experimenting with GPT-4 Turbo’s JSON mode One of the many new features announced at yesterday’s OpenAI dev day is better support for...
11 months ago
89
11 months ago
One of the many new features announced at yesterday’s OpenAI dev day is better support for generating valid JSON output. From the JSON mode docs: A common way to use Chat Completions is to instruct the model to always return JSON in some format that makes sense for your use case,...
AI Snake Oil
Tech policy is only frustrating 90% of the time That’s what makes it worthwhile
7 months ago
Society's Backend
Run Your Own Race What Bluey can teach us about machine learning
7 months ago
AI Snake Oil
Introducing the REFORMS checklist for ML-based science ML-based science is in trouble. Clear reporting standards for researchers could help.
a year ago
Daniel Miessler
News & Analysis | NO. 349
over a year ago
Daniel Miessler
Would You Put AI Art In Your House? I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I...
a year ago
61
a year ago
I’ve been thinking for a couple of weeks about making and hanging some AI art in my house. But I immediately faced some internal resistance. Like, I wasn’t (and still am not) sure whether this is the right way to “do” art. And that got me thinking what that really means. What...
One Useful Thing
An Opinionated Guide to Which AI to Use: ChatGPT Anniversary Edition A simple answer, and then a less simple one.
10 months ago
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
a year ago
39
a year ago
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
One Useful Thing
The future of education in a world of AI A positive vision for the transformation to come
a year ago
Artificial Ignorance
How Intercom is transforming customer support with AI A conversation with Fergal Reid, VP of AI at Intercom.
6 months ago
Matt Mazur
It’s Time to Build It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few...
6 months ago
69
6 months ago
It’s been a few months so I wanted to say hey to the 7 of you who follow this blog and share a few updates about what I’ve been up to. Quick recap At the start of 2023 I quit consulting to go full time on Preceden, my SaaS timeline maker, after growing it on … Continue reading...
The Berkeley...
Interactive Fleet Learning Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that...
a year ago
44
a year ago
Figure 1: “Interactive Fleet Learning” (IFL) refers to robot fleets in industry and academia that fall back on human teleoperators when necessary and continually learn from them over time. In the last few years we have seen an exciting development in robotics and artificial...
Society's Backend
MatMul-free Machine Learning Can Improve Efficiency, Excellent Foundational Learning Resources, SSMs... The top 10 most important updates of last week: 7/8/24
3 months ago
Society's Backend
Coming soon! Weekly publications to teach you about the technology that governs our society and how it impacts...
a year ago
20
a year ago
Weekly publications to teach you about the technology that governs our society and how it impacts you. Coming in August!
Daniel Miessler
Reverse Transcription There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
a year ago
45
a year ago
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
Strange Loop Canon
Life in India is a series of bilateral negotiations finding the new equilibrium for the next superpower
2 weeks ago
Society's Backend
Weekly Backend #4: 62 Total Resources Apple’s LLM OpenELM, GPT-4-Turbo, Phi-3, Grok-1.5 Vision, and more
6 months ago
Society's Backend
You Are What You Eat: Digital Edition Why who you follow is more important than who follows you
10 months ago
AI Snake Oil
The bait and switch behind AI risk prediction tools Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
a year ago
9
a year ago
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Sam Altman
E Pur Si Muove Earlier this year, I noticed something in China that really surprised me.  I realized I felt more...
over a year ago
11
over a year ago
Earlier this year, I noticed something in China that really surprised me.  I realized I felt more comfortable discussing controversial ideas in Beijing than in San Francisco.  I didn’t feel completely comfortable—this was China, after all—just more comfortable than at home. That...
Artificial Ignorance
AI Roundup 032: The Insight Forum September 15, 2023.
a year ago
Frank’s Ramblings
A Gentle Introduction to Vector Databases Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium,...
over a year ago
6
over a year ago
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium, and DZone. If you have any feedback, feel free to connect with me on Twitter or Linkedin. If you enjoyed this post and want to learn a bit more about vector databases and embeddings...
Daniel Miessler
Custom Models Are AI’s Killer App The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or...
a year ago
41
a year ago
The killer app for AI right now is the universal “custom AI model”. Consume your whole business. Or your whole life experience. Every text. Every Slack. Every journal entry. Every blog post. Everything you’ve said or written publicly. All your logs. All your documentation. Turn...
Daniel Miessler
NO. 357 | NEWS, ANALYSIS, & DISCOVERY SERIES SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after...
a year ago
26
a year ago
SECURITY NEWS Attackers have dumped nearly 8 million Australian health records on the dark web after breaching a health insurance company with almost 10 million customers. MORE NSA has released guidance asking companies to switch to memory-safe languages like Rust, C#, Go, and...
Artificial Ignorance
The intern and the coach A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it...
a year ago
28
a year ago
A recent post from Wharton professor Ethan Mollick shared an impressive new study. In a nutshell, it found that BCG consultants who used GPT-4 were up to 43% more effective at tasks vs. employees who didn’t.
Daniel Miessler
NO. 360 | NEWS, ANALYSIS & DISCOVERY SERIES SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has...
a year ago
43
a year ago
SECURITY NEWS Security researchers found that Chinese electronics company Eufy (part of Anker) has major vulnerabilities in its security cameras. The issues include uploading data to the cloud when they said they weren't, and the existence of a URL endpoint that allows an...
Weighty Thoughts
Compute is Overrated as AI’s Bottleneck You can’t just blindly extrapolate compute requirements
a year ago
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing...
2 months ago
36
2 months ago
Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
Artificial Ignorance
How to talk to your family about AI this Thanksgiving A handy guide for your uncle's burning questions.
11 months ago
The Gradient
Salmon in the Loop On fish counting – a complex sociotechnical problem in a field that is going through the process of...
10 months ago
37
10 months ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
One Useful Thing
Working with AI: Two paths to prompting Don't overcomplicate things
a year ago
Daniel Miessler
NO. 366 | T-Breach, Siri++, Conception Ages… 🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your...
a year ago
41
a year ago
🎙️If you're not subscribed to the podcast version of the newsletter, please add it using with your favorite client! APPLE | SPOTIFY | OTHER SECURITY NEWS Another T-Mobile Breach T-Mobile has had another security breach, this one affecting at least 37 million accounts. They...
Daniel Miessler
Frontview Mirror: 2023 Edition This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe...
a year ago
42
a year ago
This is member content. Thank you for being a subscriber. This is UL Member Content Subscribe Already a member? Login
Artificial Ignorance
AI Roundup 028: Sunak's Safety Summit August 18, 2023
a year ago
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
over a year ago
31
over a year ago
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled. The development of tools and methods to guide this process is one of the...
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
a year ago
36
a year ago
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
AI Snake Oil
Starting reading the AI Snake Oil book online today The book will be published on September 24
a month ago
Rozado’s Visual...
Sentiment Associations of Politically Loaded Terms in News Media Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
over a year ago
39
over a year ago
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
One Useful Thing
Power and Weirdness: How to Use Bing AI Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
a year ago
One Useful Thing
AI in organizations: Some tactics Meet the Lab and the Crowd
3 weeks ago
fast.ai
Is Avoiding Extinction from AI Really an Urgent Priority? The history of technology suggests that the greatest risks come not from the tech, but from the...
a year ago
16
a year ago
The history of technology suggests that the greatest risks come not from the tech, but from the people who control it
AI Snake Oil
AI safety is not a model property Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be...
7 months ago
68
7 months ago
Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things
Daniel Miessler
Sponsored Interview: Erkang Zheng of JupiterOne In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So...
a year ago
27
a year ago
In this standalone episode we’re doing a sponsored interview with Erkang Zheng of JupiterOne. So Jupiter One is a special company to me. I just built a vuln management program at Robinhood based around them, and I believe so much in their vision that I’m looking to actually...
Made by Ollin
Emojin An infinite kaomoji generator
over a year ago
Society's Backend
AI Reading List 1: Understand Transformers, Reflection-70B Update, and LLMs Still Cannot Reason Society's Backend Reading List 10-07-2024
3 weeks ago
Daniel Miessler
NO. 355 | NEWS & ANALYSIS SERIES SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider...
over a year ago
34
over a year ago
SECURITY NEWS ⛔️ There is likely to be a critical TLS vulnerability released this week. Consider getting your teams ready by looking for your instances before it drops. ZDNET | GLOBALSIGN | REDDIT DISCUSSION  The US accused 13 Chinese nationals of committing espionage-related...
Artificial Ignorance
GPT-4o and the illusion of AGI Why speed and multimodality is becoming the name of the game.
5 months ago
Daniel Miessler
News & Analysis | NO. 351
over a year ago
Strange Loop Canon
Disruption starts at the margins, but doesn't stop there Contra Hoel on AI and its supply paradox
10 months ago
The Berkeley...
Modeling Extremely Large Images with $x$T As computer vision researchers, we believe that every pixel can tell a story. However, there seems...
7 months ago
73
7 months ago
As computer vision researchers, we believe that every pixel can tell a story. However, there seems to be a writer’s block settling into the field when it comes to dealing with large images. Large images are no longer rare—the cameras we carry in our pockets and those orbiting our...
Andrej Karpathy blog
A Survival Guide to a PhD This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on...
over a year ago
30
over a year ago
This guide is patterned after my “Doing well in your courses”, a post I wrote a long time ago on some of the tips/tricks I’ve developed during my undergrad. I’ve received nice comments about that guide, so in the same spirit, now that my PhD has come to an end I wanted to compile...
AI Snake Oil
One year update: book submitted; TIME 100; Sep 21 online workshop It's been an eventful year
a year ago
Society's Backend
Godmother of AI Warns Against Regulation, Apple Intelligence System Prompts, Faster and Cheaper AI,... Machine learning resources and updates 8/12/2024
2 months ago
Matt Mazur
Exploring ChatGPT’s Knowledge Cutoff A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what...
11 months ago
77
11 months ago
A recurring topic of discussion on the OpenAI forums, on Reddit, and on Twitter is about what ChatGPT’s knowledge cutoff date actually is. It seems like it should be straightforward enough to figure out (just ask it), but it can be confusing due to ChatGPT’s inconsistent answers...
Daniel Miessler
Your Experience is Your Creativity Creativity is usually described as an external force that graces you with inspiration. Something...
a year ago
41
a year ago
Creativity is usually described as an external force that graces you with inspiration. Something that you have to open yourself to—that you have to allow in. But creativity is more like an inner forge of your past, perspectives, and passions. It’s not something you let in; it’s...
Society's Backend
Why Machine Learning Technical Debt is Especially Bad And effective ways to mitigate it
7 months ago
The Gradient
An Introduction to the Problems of AI Consciousness Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
27
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
Artificial Ignorance
How to leverage long form content with AI Specific tools and tactics for authors, podcasters, and videographers.
4 months ago
Society's Backend
OpenAI's Strawberry May Enhance AI Reasoning, Optimization of Vision Language Models, Info on... Weekly updates and resources 7/15/24
3 months ago
Daniel Miessler
News & Analysis | NO. 352
over a year ago
Artificial Ignorance
Pitfalls of building with large language models Dealing with more than just hallucinations.
a year ago
Matt Mazur
Friday Updates: Prepping TimelineGPT for Launch, Viva la EmergentMind Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI...
a year ago
44
a year ago
Preceden This week consisted of Milan (Preceden’s designer) and I getting TimelineGPT (the AI content generator we’re working on) from 80% ready to ship to 98%. Lots of small, boring tasks like: Hopefully can launch the v1 early next week, rolling it out to 25% of users and then...
AI Snake Oil
What the executive order means for openness in AI Good news on paper, but the devil is in the details
a year ago
Sam Altman
A Clarification I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to...
over a year ago
8
over a year ago
I made a point in this post inelegantly in a way that was easy to misunderstand, so I’d like to clarify it. I didn’t mean that we need to tolerate brilliant homophobic jerks in the lab so that we can have scientific progress.  Although there are famous...
Sam Altman
The Merge A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
over a year ago
10
over a year ago
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075. People used to call this the...
Artificial Ignorance
Workshop: Midjourney Masterclass with Daniel Nest “This is one of the only webinars where I've actually been glued to my screen for the entire time,...
a month ago
27
a month ago
“This is one of the only webinars where I've actually been glued to my screen for the entire time, not distracted by passing whimsies...
Rozado’s Visual...
Pessimism in News Media Headlines In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of...
a year ago
55
a year ago
In previous work, I documented the growing emotional negativity (anger, fear, sadness, etc) of American news media headlines between the years 2000 and 2019. Here, I extend that work by examining the attitudinal tone (pessimism, optimism or neutrality
Rozado’s Visual...
Is the Great Awokening Really Winding Down? Part I: Some Multifaceted Evidence from Twitter Content There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham...
a year ago
46
a year ago
There has been some discussion lately by Eric Kaufmann, Tyler Cowen, Balaji Srinivasan, Paul Graham and Musa Al Gharbi as to whether The Great Awokening is winding down. I’m going to write a series of blog entries about this topic to contribute to the discussion. In order to do...
Stories by Andrej...
AlphaGo, in context
over a year ago
Weighty Thoughts
What’s coming next for AI in 2024 A long overdue VC apocalypse and the birth of the first real AI companies
10 months ago
Rozado’s Visual...
Mentions of Prejudice in Academic Papers: A Declining Trend Amidst Ongoing DEI Growth? Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms...
a month ago
28
a month ago
Prejudice-denoting terms in academic research have recently decreased while some DEI-related terms continue to rise—what does this shift reveal?
Andrej Karpathy blog
Self-driving as a case study for AGI Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI,...
9 months ago
67
9 months ago
Sparked by progress in Large Language Models (LLMs), there’s a lot of chatter recently about AGI, its timelines, and what it might look like. Some of it is hopeful and optimistic, but a lot of it is fearful and doomy, to put it mildly. Unfortunately, a lot of it is also very...
Artificial Ignorance
Why Claude 3 is a big upgrade On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks,...
7 months ago
39
7 months ago
On Monday, Anthropic released Claude 3, a family of models that hit new highs on various benchmarks, add multi-modal capabilities, and are a real competitor to GPT-4.
One Useful Thing
The Homework Apocalypse Fall is going to be very different this year. Educators need to be ready.
a year ago
One Useful Thing
Post-apocalyptic education What comes after the Homework Apocalypse
2 months ago
Artificial Ignorance
AI Roundup 079: Don't call it an acquisition August 9, 2024.
2 months ago
Strange Loop Canon
AI embraces its product arc fuzzy processors are entering mass production
5 months ago
Strange Loop Canon
Discovery is the original sin of the modern age technology, living post scarcity, and how to find what you want
10 months ago
Rozado’s Visual...
El desproporcionado número de referencias al machismo en los medios de comunicación españoles Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos...
a year ago
29
a year ago
Los medios de comunicación españoles constituyen una anomalía en comparación con sus homólogos internacionales por su alto número de referencias al machismo que triplican a las de cualquier otro país
Artificial Ignorance
AI Roundup 053: Bye bye Bard February 9, 2024.
8 months ago
One Useful Thing
The Lazy Tyranny of the Wait Calculation Taking AI timelines seriously
9 months ago
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
a month ago
30
a month ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
Strange Loop Canon
Symposium: On Building God
a year ago
One Useful Thing
Four Singularities for Research The rise of AI is creating both crisis and opportunity
5 months ago
Sam Altman
Greg A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg...
over a year ago
4
over a year ago
A lot of people ask me what the ideal cofounder looks like.  I now have an answer: Greg Brockman. Every successful startup I know has at least one person who provides the force of will to make the startup happen.  I’d thought a lot about this in the abstract while advising YC...
Daniel Miessler
Why Apple Keeps Winning People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple...
over a year ago
59
over a year ago
People are blown away that Apple keeps winning while its competitors are floundering. It’s a simple formula. Make consistently super-high-quality products that work together as part of an ecosystem. Google and Microsoft have 20X Apple’s losses in the last year. A staggering $3...
Matt Mazur
When you ship a major bug before signing off for the day For better or worse, I still handle all of Preceden’s support requests. At one I did have help...
a year ago
29
a year ago
For better or worse, I still handle all of Preceden’s support requests. At one I did have help (thanks Liesl!), but these days support takes at most an hour per week, and all requests fall into two buckets: As a result, there hasn’t been a pressing need to outsource support. But...
The Berkeley...
Training Diffusion Models with <br> Reinforcement Learning function reveal() { const replay = document.querySelector('.ddpo-replay'); ...
a year ago
44
a year ago
function reveal() { const replay = document.querySelector('.ddpo-replay'); replay.style.display = 'flex'; } window.onload = () => { const replay = document.querySelector('.ddpo-replay'); replay.addEventListener('click', () => { ...
Sam Altman
How To Invest In Startups There is a lot of advice about how to be a good startup founder.  But there isn’t very much about...
over a year ago
8
over a year ago
There is a lot of advice about how to be a good startup founder.  But there isn’t very much about how to be a good startup investor. Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
AI Snake Oil
Model alignment protects against accidental harms, not intentional ones The hand wringing about failures of model alignment is misguided
11 months ago
Rozado’s Visual...
The Political Preferences of LLMs Substantial political homogeneity in Large Language Models (LLMs) responses to questions with...
9 months ago
61
9 months ago
Substantial political homogeneity in Large Language Models (LLMs) responses to questions with political connotations
Sam Altman
What I Wish Someone Had Told Me Optimism, obsession, self-belief, raw horsepower and personal connections are how things get...
10 months ago
55
10 months ago
Optimism, obsession, self-belief, raw horsepower and personal connections are how things get started. Cohesive teams, the right combination of calmness and urgency, and unreasonable commitment are how things get finished. Long-term orientation is in short supply; try not to worry...
Society's Backend
Why Machine Learning Terminology is So Confusing And definitions for the most important terms you should know
8 months ago
fast.ai
Deep Learning Foundations Signup, Open Source Scholarships, & More Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available...
over a year ago
11
over a year ago
Signups are now open for Practical Deep Learning for Coders Part 2, 2022. Scholarships are available for fast.ai community contributors, open source developers, and diversity scholars.
Artificial Ignorance
Distributing the future A reminder that things take time.
5 months ago
The Berkeley...
Are We Ready for Multi-Image Reasoning? Launching VHs: The Visual Haystacks Benchmark! Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving...
3 months ago
49
3 months ago
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving artificial general intelligence (AGI). Over the decades, AI researchers have developed Visual Question Answering (VQA) systems to interpret scenes within single images and answer...
One Useful Thing
Blinded by Analogies What is this AI thing? The wrong model can lead us astray
a year ago
Society's Backend
AI Reading List 2: Mathematical Limitations of LLMs, A SQL Roadmap for Data Science, and... Society's Backend Reading List 10-14-2024
2 weeks ago
Society's Backend
Clarifying DEI What makes DEI important and where it fails
9 months ago
One Useful Thing
Detecting the Secret Cyborgs The AI Trap for Organizations
a year ago
Daniel Miessler
Generate AI Art Using Your Own Writing One of the most challenging parts of finishing a post is coming up with a good image. The AI art...
over a year ago
30
over a year ago
One of the most challenging parts of finishing a post is coming up with a good image. The AI art tools like DALL-E, Midjourney, and Stable Diffusion are cool, but a lot of the magic comes down to prompt engineering, which is non-trivial. Prompt Engineering is almost equal parts...
Daniel Miessler
News & Analysis | NO. 350
over a year ago
Stories by Andrej...
ICML accepted papers institution stats
over a year ago
Artificial Ignorance
AI Roundup 077: A good week for open-source July 26, 2024.
3 months ago
Andrej Karpathy blog
Short Story on AI: Forward Pass p { text-align: justify; } .post pre, .post code { border: none; background-color:...
over a year ago
24
over a year ago
p { text-align: justify; } .post pre, .post code { border: none; background-color: #eee; } The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Artificial Ignorance
AI Roundup 078: Voice mode August 2, 2024.
3 months ago
Society's Backend
I Enjoy Technical Interviews and You Can Too A simple change in mindset that completely changed the way I interview
a year ago
fast.ai
Qualitative humanities research is crucial to AI Following the thread of any seemingly quantitative issue in AI ethics (such as determining if...
over a year ago
8
over a year ago
Following the thread of any seemingly quantitative issue in AI ethics (such as determining if software to rate loan applicants is racially biased or evaluating YouTube’s recommendation system) quickly leads to a host of qualitative questions. Unfortunately, there is often a large...
Artificial Ignorance
From Stable Diffusion to Stable Everything Inside Stability AI's roster of AI models.
5 months ago
AI Snake Oil
Evaluating LLMs is a minefield Annotated slides from a recent talk
a year ago
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
13
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.
One Useful Thing
In Praise of Boring AI Automation has always been about killing tedious work. AI can do the same.
a year ago
Society's Backend
Anti-Social Media How our technology habituates the paradoxical relationship between social media and social isolation
a year ago
29
a year ago
How our technology habituates the paradoxical relationship between social media and social isolation
Rozado’s Visual...
Which is the Wokest AI? A Wokeness Ranking of LLMs
8 months ago
Artificial Ignorance
AI Roundup 046: AI has a CSAM problem December 22, 2023.
10 months ago
Matt Mazur
Friday Updates: Smart Icons, Automatic Suggestions, Dealing with Spammers, Better Icon Colors Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we...
a year ago
47
a year ago
Preceden Lots of updates to Preceden this week: Improving the UX for the AI Suggestions When we rolled out the AI Suggestions feature last week, the typical experience for the user would go something like this: Lots of UX issues there though: To remedy this, I updated Preceden to...
AI Snake Oil
AI companies are pivoting from creating gods to building products. Good. Turning models into products runs into five challenges
2 months ago
Society's Backend
What Apple Intelligence Means for You "We think you're gonna LOVE it"
4 months ago
The Gradient
Mamba Explained Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
7 months ago
38
7 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
Weighty Thoughts
Deep Tech Startups Are Not Software Startups Or why AI and “Software/SaaS” are apples and oranges
8 months ago
One Useful Thing
What Apple's AI Tells Us: Experimental Models⁴ Siri versus the machine god?
4 months ago
One Useful Thing
It is starting to get strange. Let's talk about ChatGPT with Code Interpreter & Microsoft Copilot
a year ago
Daniel Miessler
Unsupervised Learning NO. 364 | Reality Headset, BingPT, AI+Cyber If you're not subscribed to the podcast version of the newsletter, please add it with your favorite...
a year ago
44
a year ago
If you're not subscribed to the podcast version of the newsletter, please add it with your favorite client. APPLE | SPOTIFY | OTHER SECURITY NEWS The FBI is warning people to block online ads due to imposters poisoning search results. They advise users to 1) check ad URLs, 2) go...
Artificial Ignorance
AI Roundup 066: AlphaFold 3 May 10, 2024.
5 months ago
Artificial Ignorance
AI Roundup 068: The ScarJo thing May 24, 2024.
5 months ago
Weighty Thoughts
CUDA is Still a Giant Moat for NVIDIA Despite everyone’s focus on hardware, the software of AI is what protects NVIDIA
7 months ago
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
over a year ago
35
over a year ago
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Society's Backend
How to Know if Your Data is Being Used Maliciously The information you should know about a company before gifting them your data
a year ago
Rozado’s Visual...
The Great Awokening as a Global Phenomenon The striking synchronicity with which Great Awokening terminology increased in news media worldwide
a year ago
AI Snake Oil
Three Ideas for Regulating Generative AI Policy input to the federal government from a Stanford-Princeton team
a year ago
Daniel Miessler
Something is Up With Meritocracy I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity...
over a year ago
40
over a year ago
I’ve been thinking a lot about meritocracy lately, and I’ve come to believe that opportunity magnifies inequality. Here’s one way I’ve seen it explained: If there are two main reasons for outcome differences: innate talent and environment, and if you equalize environment you will...
Weighty Thoughts
The EU is making itself an economic backwater Regulation is not a real export
3 months ago
Artificial Ignorance
Tutorial: How to chat with your documents A step-by-step guide to doing Q&A with your data, using LlamaIndex and OpenAI.
a year ago
Artificial Ignorance
The subscriptionization of AI Navigating the paid AI landscape.
7 months ago
One Useful Thing
Superhuman? What does it mean for AI to be better than a human? And how can we tell?
5 months ago
Daniel Miessler
AI Art Just Opened The Threat to Human Work We Were Expecting from AGI Let me start with the punchline: Something like 80% of most “knowledge work” is about to get...
a year ago
32
a year ago
Let me start with the punchline: Something like 80% of most “knowledge work” is about to get replaced by artificial intelligence. I’m not professionally educated or trained in AI, but I’ve read probably 30 books and spent thousands of hours thinking about it. I am not talking...
Society's Backend
Weekly Backend #6: 59 Resources and Updates, AI is Taking Off in Medicine Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically,...
5 months ago
75
5 months ago
Google DeepMind releases AlphaFold 3, KANs, LLM Benchmarks are being looked at more critically, Apple is bringing their AI chips to data centers, StackOverflow partners with OpenAI, and more
Artificial Ignorance
AI Roundup 055: Race conditions February 23, 2023.
8 months ago
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
over a year ago
35
over a year ago
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another. Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...