Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]

The Gradient

The Gradient
Financial Market Applications of LLMs The AI revolution drove frenzied investment in both private and public companies and captured the...
9 months ago
79
9 months ago
The AI revolution drove frenzied investment in both private and public companies and captured the public’s imagination in 2023. Transformational consumer products like ChatGPT are powered by Large Language Models (LLMs) that excel at modeling sequences of tokens that represent...
The Gradient
We Need Positive Visions for AI Grounded in Wellbeing Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing...
6 months ago
77
6 months ago
Introduction Imagine yourself a decade ago, jumping directly into the present shock of conversing naturally with an encyclopedic AI that crafts images, writes code, and debates philosophy. Won’t this technology almost certainly transform society — and hasn’t AI’s impact on us so...
The Gradient
A Brief Overview of Gender Bias in AI A brief overview and discussion on gender bias in AI
9 months ago
The Gradient
What's Missing From LLM Chatbots: A Sense of Purpose LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly...
4 months ago
74
4 months ago
LLM-based chatbots’ capabilities have been advancing every month. These improvements are mostly measured by benchmarks like MMLU, HumanEval, and MATH (e.g. sonnet 3.5, gpt-4o). However, as these measures get more and more saturated, is user experience increasing in proportion to...
The Gradient
Deep learning for single-cell sequencing: a microscope to see the diversity of cells On the the pivotal role that Deep Learning has played as a key enabler for advancing single-cell...
a year ago
The Gradient
Car-GPT: Could LLMs finally make self-driving cars happen? Exploring the utility of large language models in autonomous driving: Can they be trusted for...
11 months ago
66
11 months ago
Exploring the utility of large language models in autonomous driving: Can they be trusted for self-driving cars, and what are the key challenges?
The Gradient
Mamba Explained Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a...
10 months ago
63
10 months ago
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
The Gradient
Do text embeddings perfectly encode text? 'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus...
11 months ago
62
11 months ago
'Vec2text' can serve as a solution for accurately reverting embeddings back into text, thus highlighting the urgent need for revisiting security protocols around embedded data.
The Gradient
Why Doesn’t My Model Work? Have you ever trained a model you thought was good, but then it failed miserably when applied to...
11 months ago
58
11 months ago
Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.
The Gradient
Salmon in the Loop On fish counting – a complex sociotechnical problem in a field that is going through the process of...
a year ago
56
a year ago
On fish counting – a complex sociotechnical problem in a field that is going through the process of digital transformation.
The Gradient
Shape, Symmetries, and Structure: The Changing Role of Mathematics in Machine Learning Research What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in...
2 months ago
49
2 months ago
What is the Role of Mathematics in Modern Machine Learning? The past decade has witnessed a shift in how progress is made in machine learning. Research involving carefully designed and mathematically principled architectures result in only marginal improvements while...
The Gradient
Neural algorithmic reasoning In this article, we will talk about classical computation: the kind of computation typically found...
a year ago
45
a year ago
In this article, we will talk about classical computation: the kind of computation typically found in an undergraduate Computer Science course on Algorithms and Data Structures [1]. Think shortest path-finding, sorting, clever ways to break problems down into simpler problems,...
The Gradient
The Artificiality of Alignment This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk”...
a year ago
45
a year ago
This essay first appeared in Reboot. Credulous, breathless coverage of “AI existential risk” (abbreviated “x-risk”) has reached the mainstream. Who could have foreseen that the smallcaps onomatopoeia “ꜰᴏᴏᴍ” — both evocative of and directly derived from children’s cartoons —
The Gradient
An Introduction to the Problems of AI Consciousness Once considered a forbidden topic in the AI community, discussions around the concept of AI...
a year ago
43
a year ago
Once considered a forbidden topic in the AI community, discussions around the concept of AI consciousness are now taking center stage, marking a significant shift since the current AI resurgence began over a decade ago.
The Gradient
Text-to-CAD: Risks and Opportunities In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we...
a year ago
39
a year ago
In the realm of AI-powered text-to-CAD, there's promise, but also a surge in subpar designs. Can we steer this technology towards better outcomes?
The Gradient
Interpretability Creationism On “interpretability creationism” – interpretability methods that only look at the final state of...
a year ago
29
a year ago
On “interpretability creationism” – interpretability methods that only look at the final state of the model and ignore its evolution over the course of training
The Gradient
Why transformative artificial intelligence is really, really hard to achieve A collection of the best technical, social, and economic arguments Humans have a good track record...
a year ago
25
a year ago
A collection of the best technical, social, and economic arguments Humans have a good track record of innovation. The mechanization of agriculture, steam engines, electricity, modern medicine, computers, and the internet—these technologies radically changed the world. Still, the...
The Gradient
What Do LLMs Know About Linguistics? It Depends on How You Ask On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and...
a year ago
23
a year ago
On the phenomenon of LLM sensitivity to prompting choices through two core linguistic tasks and categorize how specific prompting choices can affect the model's behavior.