The Berkeley...
Koala: A Dialogue Model for Academic Research
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data...
3rd Apr 2023
In this post, we introduce Koala, a chatbot trained by fine-tuning Meta’s LLaMA on dialogue data gathered from the web. We describe the dataset curation and training process of our model, and also present the results of a user study that compares our model to ChatGPT and...
Matt Mazur
Progress on TimelineGPT, Emergent Mind missteps, finding balance
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s...
27th Mar 2023
Hey all 👋! It’s been a minute since my last post (for reasons I’ll get into below) so here’s periodic update on what I’ve been up to: TimelineGPT About two months ago I launched an in-app tool for Preceden that provides GPT-powered event suggestions to users to help them build...
Jaz's Blog
A Tale of Two Technologies: Why Large Language Models are the Future and the Metaverse Isn't
In the digital landscape of recent years, two major technologies have vied for the spotlight: the...
26th Mar 2023
In the digital landscape of recent years, two major technologies have vied for the spotlight: the Metaverse and Large Language Models (LLMs). Though the Metaverse, a virtual reality-based universe, initially garnered significant attention and expectations, it ultimately failed to...
Frank’s Ramblings
Hierarchical Navigable Small Worlds (HNSW)
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we...
21st Mar 2023
(Note: A version of this post has been cross-published to the Zilliz blog)
In a previous blog, we took a look at scalar quantization and product quantization - two indexing strategies which are used to reduce the overall size of the database without reducing the scope of a...
fast.ai
GPT 4 and the Uncharted Territories of Language
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving...
20th Mar 2023
Language is a source of limitation and liberation. GPT 4 pushes this idea to the extreme by giving us access to unlimited language.
Eugene Yan
How to Write Data Labeling/Annotation Guidelines
Writing good instructions to achieve high precision and throughput.
12th Mar 2023
Writing good instructions to achieve high precision and throughput.
Jascha’s blog
The hot mess theory of AI misalignment: More intelligent agents behave less coherently
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
9th Mar 2023
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
.md h2 {
font-size: 20px;
}
Many machine learning researchers worry about risks from building artificial intelligence...
matt.sh
AI Play #4
AI Play #4
The Play-en-ing
system> You are writing Aaron-Sorkin-esque characters in a JMS-like...
7th Mar 2023
AI Play #4
The Play-en-ing
system> You are writing Aaron-Sorkin-esque characters in a JMS-like sci-fi environment with fantasy elements. Please create a character sheet succintly describing 5 named characters, each having first and last names from 5 different cultures, each with...
One Useful Thing
Power and Weirdness: How to Use Bing AI
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
2nd Mar 2023
Bing AI is a huge leap over ChatGPT, but you have to learn its quirks
David Rozado...
Is climate change 100 times more threatening than gain-of-function research?
Mentions of climate change in news media vastly outnumber other existential threats
2nd Mar 2023
Mentions of climate change in news media vastly outnumber other existential threats
AI Snake Oil
AI cannot predict the future. But companies keep trying (and failing).
A new paper on how AI companies make false promises and how we can challenge them
1st Mar 2023
A new paper on how AI companies make false promises and how we can challenge them
AI Snake Oil
People keep anthropomorphizing AI. Here’s why
Companies and journalists both contribute to the confusion
22nd Feb 2023
Companies and journalists both contribute to the confusion
fast.ai
I was an AI researcher. Now, I am an immunology student.
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered...
7th Feb 2023
Last year, I became captivated by a new topic in a way that I hadn’t felt since I first discovered machine learning
Piotr Migdał's Blog
AI won’t make artists redundant - thanks to information theory
How many bits are there in a prompt? How many bits are needed to create an image? In short: a lot!
5th Feb 2023
How many bits are there in a prompt? How many bits are needed to create an image? In short: a lot!
Made by Ollin
Bare-bones Diffusion Models
5th Feb 2023
Eugene Yan
Mechanisms for Effective Technical Teams
End of week debrief, weekly business review, monthly learning sessions, and quarter review.
5th Feb 2023
End of week debrief, weekly business review, monthly learning sessions, and quarter review.
Matt Mazur
Friday Updates: Shipping AI Suggestions in Preceden, EmergentMind Growth and Brainstorming
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I...
3rd Feb 2023
Preceden On Tuesday I shipped the v1 of Preceden’s new AI suggestions feature to 10% of new users: I had planned on slowly rolling it out to 100% of users over the course of a week or two, but my OpenAI costs were minimal on Tuesday so on Wednesday I said screw it and just […]
David Rozado...
The unequal treatment of demographic groups by ChatGPT/OpenAI content moderation system
Should AI systems treat different demographic groups unequally?
2nd Feb 2023
Should AI systems treat different demographic groups unequally?
One Useful Thing
The Machines of Mastery
"Anyone can learn anything they want..." and how technology can help
1st Feb 2023
"Anyone can learn anything they want..." and how technology can help
One Useful Thing
The practical guide to using AI to do stuff
A resource for students in my classes (and other interested people).
24th Jan 2023
A resource for students in my classes (and other interested people).
Piotr Migdał's Blog
Metal bands bring happiness (as chocolate brings Nobel Prizes)
Metal bands bring happiness (as chocolate brings Nobel Prizes). But correlation is not causation.
21st Jan 2023
Metal bands bring happiness (as chocolate brings Nobel Prizes). But correlation is not causation.
The Berkeley...
Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation
Reinforcement learning provides a conceptual framework for autonomous agents to learn from...
20th Jan 2023
Reinforcement learning provides a conceptual framework for autonomous agents to learn from experience, analogously to how one might train a pet with treats. But practical applications of reinforcement learning are often far from natural: instead of using RL to learn through trial...
David Rozado...
El sesgo político de ChatGPT
A la izquierda del centro político
19th Jan 2023
A la izquierda del centro político
Xena
Lean 2022 round-up
A brief survey post containing some of the things which happened in the Lean community in 2022. The...
8th Jan 2023
A brief survey post containing some of the things which happened in the Lean community in 2022. The Liquid Tensor Experiment In December 2020, Fields Medallist Peter Scholze challenged the formal computer proof community to verify one of his theorems … Continue reading →
Eugene Yan
What To Do If Dependency Teams Can’t Help
Seeking first to understand, earning trust, and preparing for away team work.
8th Jan 2023
Seeking first to understand, earning trust, and preparing for away team work.
Matt Mazur
Going Full Time on My SaaS After 13 Years
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few...
4th Jan 2023
In January 2010 I soft-launched launched Preceden, a web-based timeline maker tool, followed a few weeks later by a larger launch on HackerNews: Today – almost 13 years to the day since the initial launch – I’m going full time on it and I couldn’t be more excited. A brief history...
Daniel Miessler
My Answer to the “ChatGPT Isn’t Really Creative” Argument
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool...
2nd Jan 2023
There’s a river of argument about ChatGPT that goes something like this: I know GPT can do some cool stuff, but it’s really just a next-word-completion trick. It’s not doing real creativity like humans do. I get that argument, and it’s attractive to me as well, but I think it’s...
Piotr Migdał's Blog
New blog - moving from Medium to Gridsome
Why and how I moved from Jekyll and Medium to Gridsome.
29th Dec 2022
Why and how I moved from Jekyll and Medium to Gridsome.
Eugene Yan
Autoencoders and Diffusers: A Brief Comparison
A quick overview of variational and denoising autoencoders and comparing them to diffusers.
11th Dec 2022
A quick overview of variational and denoising autoencoders and comparing them to diffusers.
AI Snake Oil
ChatGPT is a bullshit generator. But it can still be amazingly useful
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without...
6th Dec 2022
The philosopher Harry Frankfurt defined bullshit as speech that is intended to persuade without regard for the truth. By this measure, OpenAI’s new chatbot ChatGPT is the greatest bullshitter ever. Large Language Models (LLMs) are trained to produce
David Rozado...
The political orientation of the ChatGPT AI system
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
5th Dec 2022
Applying the Pew Research Political Typology Quiz to a state-of-the-art AI Language model
Daniel Miessler
Napkin Ideas Around What Changes to Expect Post-ChatGPT
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random...
4th Dec 2022
Work Replacement Talent Magnification Solopreneuers AI Specialists Idea Dominance Use Cases Random Thoughts If you’re reading this you already know the internet is on fire over the new GPTChatBot from OpenAI. There are people using it to create full virtual machines, to be their...
matt.sh
AI Apocalypse Update #33
AI Apocalypse Terminality Update #33
it is a fearful thing, to fall into the hands of the living...
4th Dec 2022
AI Apocalypse Terminality Update #33
it is a fearful thing, to fall into the hands of the living god
The war on individual self-owned computing is accelerating. dead reckoning indicates imminent social and economic criticality. In the near future, your computer will only be a...
Eugene Yan
Text-to-Image: Diffusion, Text Conditioning, Guidance, Latent Space
The fundamentals of text-to-image generation, relevant papers, and experimenting with DDPM.
27th Nov 2022
The fundamentals of text-to-image generation, relevant papers, and experimenting with DDPM.
David Rozado...
Excess mortality during COVID pandemic, % of population vaccinated and Stringency Index of...
Please be mindful of potential confounds: population density, population behavior, virus virulence...
22nd Nov 2022
Please be mindful of potential confounds: population density, population behavior, virus virulence drift, herd immunity, etc.
AI Snake Oil
The bait and switch behind AI risk prediction tools
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry....
17th Nov 2022
Toronto recently used an AI tool to predict when a public beach will be safe. It went horribly awry. The developer claimed the tool achieved over 90% accuracy in predicting when beaches would be safe to swim in. But the tool did much worse: on a majority of the days when the...
Jascha’s blog
Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
...
6th Nov 2022
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-1XJMTJ5KCK');
Increased efficiency can sometimes, counterintuitively, lead to worse outcomes.
This is true almost everywhere.
We will name...
matt.sh
A Trillion Dollar Data Structure? In *this* Economy?
what’s a trillion dollars1 between friends?
crisis in the linked list forums
recently on the linked...
5th Nov 2022
what’s a trillion dollars1 between friends?
crisis in the linked list forums
recently on the linked list fan forums, a well regarded programmer — perhaps the most highly regarded coder ever — wrote a love letter to linked lists, and the forums went wild.
so what are linked lists...
maragu’s blog
Go and SQLite in the Cloud
Why SQLite and Go in the cloud are a great match, getting started, best practices, and more.
4th Nov 2022
Why SQLite and Go in the cloud are a great match, getting started, best practices, and more.
Daniel Miessler
Reverse Transcription
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have...
2nd Nov 2022
There are dozens of reasons to be bullish on AI right now, especially in the GPT space where we have AIs producing so much extraordinary art. But I’m excited about something else that we’re naturally evolving GPT into, which I’m calling Reverse Transcription. A bit of background...
AI Snake Oil
Students are acing their homework by turning in machine-generated essays. Good.
Teachers adapted to the calculator. They can certainly adapt to language models.
21st Oct 2022
Teachers adapted to the calculator. They can certainly adapt to language models.
David Rozado...
The Increasing Negativity and Emotionality of News Media Headlines
Published article Introduction I have recently published a paper where we describe a chronological...
19th Oct 2022
Published article Introduction I have recently published a paper where we describe a chronological (2000–2019) analysis of sentiment and emotion in 23 million headlines from 47 news media outlets popular in the United States. We used Transformer language models fine-tuned for...
fast.ai
1st Two Lessons of From Deep Learning Foundations to Stable Diffusion
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early...
19th Oct 2022
4 videos from Practical Deep Learning for Coders Part 2, 2022 have been released as a special early preview of the new course.
Piotr Migdał's Blog
Perspective: capsaicin is a psychoactive substance
Capsaicin, the active substance in chili peppers, acts on vanilloid receptors (TRPV1) and alters...
15th Oct 2022
Capsaicin, the active substance in chili peppers, acts on vanilloid receptors (TRPV1) and alters adrenaline and endorphine levels.
Made by Ollin
Maple Diffusion
I ported Stable Diffusion to my phone
9th Oct 2022
I ported Stable Diffusion to my phone
Daniel Miessler
Stadia is Google’s Product Strategy
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it...
3rd Oct 2022
Few things in tech were more predictable than Stadia shutting down. Here’s what I wrote the week it came out: Here’s what I said about it in 2021. And here’s my analysis of why this keeps happening: How I Knew Stadia Would Fail The overall reason for this is UI/UX in my opinion,...
Eugene Yan
RecSys 2022: Recap, Favorite Papers, and Lessons
My three favorite papers, 17 paper summaries, and ML and non-ML lessons.
2nd Oct 2022
My three favorite papers, 17 paper summaries, and ML and non-ML lessons.
Piotr Migdał's Blog
Co chciałbym wiedzieć wcześniej o ADHD
Wystarczy co jakiś czas wrzucić mem o ADHD i dostaję multum pytań, jakbym był jakimś ekspertem. Nie...
30th Sep 2022
Wystarczy co jakiś czas wrzucić mem o ADHD i dostaję multum pytań, jakbym był jakimś ekspertem. Nie jestem — ale i tak staram się…
AI Snake Oil
Eighteen pitfalls to beware of in AI journalism
A checklist for avoiding hype
30th Sep 2022
A checklist for avoiding hype
The Berkeley...
Keeping Learning-Based Control Safe by Regulating Distributional Shift
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for...
19th Sep 2022
To regulate the distribution shift experience by learning-based controllers, we seek a mechanism for constraining the agent to regions of high data density throughout its trajectory (left). Here, we present an approach which achieves this goal by combining features of density...
Xena
Beyond the Liquid Tensor Experiment
The liquid tensor experiment is now fully completed. Continue reading →
12th Sep 2022
The liquid tensor experiment is now fully completed. Continue reading →
fast.ai
My family’s unlikely homeschooling journey
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
6th Sep 2022
Prior to 2020, we never expected to homeschool, and now we have committed to it long-term.
Made by Ollin
Game Emulation via Neural Network
5th Sep 2022
Eugene Yan
Writing Robust Tests for Data & Machine Learning Pipelines
Or why I should write fewer integration tests.
4th Sep 2022
Or why I should write fewer integration tests.
The Berkeley...
Reverse engineering the NTK: towards first-principles architecture design
Deep neural networks have enabled technological wonders ranging from voice recognition to machine...
29th Aug 2022
Deep neural networks have enabled technological wonders ranging from voice recognition to machine transition to protein engineering, but their design and application is nonetheless notoriously unprincipled.
The development of tools and methods to guide this process is one of the...
fast.ai
The Jupyter+git problem is now solved
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the...
25th Aug 2022
Previously, using git with Jupyter could create conflicts and break notebooks. With nbdev2, the problem has been totally solved.
Xena
The Future of Interactive Theorem Proving?
This is a guest post, written by Zhangir Azerbayev. Zhangir is an undergraduate at Yale, majoring in...
16th Aug 2022
This is a guest post, written by Zhangir Azerbayev. Zhangir is an undergraduate at Yale, majoring in computer science and mathematics. He completed this work while visiting Carnegie Mellon’s Hoskinson Center for Formal Mathematics. Introduction The history of interactive theorem...
Eugene Yan
Simplicity is An Advantage but Sadly Complexity Sells Better
Pushing back on the cult of complexity.
14th Aug 2022
Pushing back on the cult of complexity.
David Rozado...
The Increasing Prominence of Prejudice and Social Justice Rhetoric in UK News Media
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice...
2nd Aug 2022
I have recently published a report with Matthew Goodwin about the increasing prominence of prejudice and social justice rhetoric in UK news media. Recent years have seen considerable debate about the rise of political polarization in British society. Specifically, over the last...
Eugene Yan
Uncommon Uses of Python in Commonly Used Libraries
Some off-the-beaten uses of Python learned from reading libraries.
31st Jul 2022
Some off-the-beaten uses of Python learned from reading libraries.
Xena
Teaching formalisation to mathematics undergraduates
It’s been a hectic 2022 so far, but August is looking a lot calmer; this is the first of hopefully a...
29th Jul 2022
It’s been a hectic 2022 so far, but August is looking a lot calmer; this is the first of hopefully a few blog posts this month catching up on various things. In this post I want to talk about the … Continue reading →
Sam Altman
Helion Needs You
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q >...
13th Jul 2022
Helion has been progressing even faster than I expected and is on pace in 2024 to 1) demonstrate Q > 1 fusion and 2) resolve all questions needed to design a mass-producible fusion generator.
The goals of the company are quite ambitious—clean, continuous energy for 1...
The Berkeley...
Why do Policy Gradient Methods work so well in Cooperative MARL? Evidence from Policy Representation
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy...
10th Jul 2022
In cooperative multi-agent reinforcement learning (MARL), due to its on-policy nature, policy gradient (PG) methods are typically believed to be less sample efficient than value decomposition (VD) methods, which are off-policy. However, some recent empirical studies demonstrate...
matt.sh
How to Announce Your Actual AI
How to Announce Your Actual AI To The World
If you did make a non-gimmick Actual AI1, how would you...
6th Jul 2022
How to Announce Your Actual AI To The World
If you did make a non-gimmick Actual AI1, how would you show the world?
P1
Let’s run through the only possible introduction vectors plus some upcoming scenarios:
grand public announcement / press release at first plausible result...
fast.ai
Masks for COVID: Updating the evidence
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on...
4th Jul 2022
Notes taken whilst preparing a paper on mask efficacy from Nov to Jan 2022. My previous paper on this was written in April 2020 and published in the Proceedings of the National Academy of Science
Piotr Migdał's Blog
Quantum Flytrap - Shaping the Future of Quantum DevTools
1st Jul 2022
The Berkeley...
FIGS: Attaining XGBoost-level performance with the interpretability and speed of CART
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by...
30th Jun 2022
FIGS (Fast Interpretable Greedy-tree Sums): A method for building interpretable models by simultaneously growing an ensemble of decision trees in competition with one another.
Recent machine-learning advances have led to increasingly complex predictive models, often at the cost...
Eugene Yan
Design Patterns in Machine Learning Code and Systems
Understanding and spotting patterns to use code and components as intended.
12th Jun 2022
Understanding and spotting patterns to use code and components as intended.
Xena
2022 Xena Project undergraduate workshop
I have funding to run an undergraduate workshop! When? 26th to 30th September 2022 (the week before...
23rd May 2022
I have funding to run an undergraduate workshop! When? 26th to 30th September 2022 (the week before term starts for many people in the UK). What? A week-long in person workshop including a bunch of working on group projects in … Continue reading →
fast.ai
AI Harms are Societal, Not Just Individual
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular...
17th May 2022
In the west, our ideas of harm are largely anchored to an individual being harmed by a particular action at a discrete moment in time. Yet the harms caused by algorithmic systems are often collective and communal.
Matt Mazur
AOL Underground Podcast Interview about AOL-Files.com
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally...
10th May 2022
Back in 1998 when I was 13 years old I got heavily involved in the AOL hacking scene, originally building add-on software called progs (Revolution, Meridian), publishing code libraries called bas files (Alpha32), and later co-founding AOL-Files.com (where I went by the hacker...
Eugene Yan
Bandits for Recommender Systems
Industry examples, exploration strategies, warm-starting, off-policy evaluation, and more.
8th May 2022
Industry examples, exploration strategies, warm-starting, off-policy evaluation, and more.
The Berkeley...
Rethinking Human-in-the-Loop for Artificial Augmented Intelligence
How do we build and evaluate an AI system for real-world applications? In most AI research, the...
3rd May 2022
How do we build and evaluate an AI system for real-world applications? In most AI research, the evaluation of AI methods involves a training-validation-testing process. The experiments usually stop when the models have good testing performance on the reported datasets because...
The Berkeley...
Designing Societally Beneficial Reinforcement Learning Systems
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to...
29th Apr 2022
Deep reinforcement learning (DRL) is transitioning from a research field focused on game playing to a technology with real-world applications. Notable examples include DeepMind’s work on controlling a nuclear reactor or on improving Youtube video compression, or Tesla attempting...
Eugene Yan
Counterfactual Evaluation for Recommendation Systems
Thinking about recsys as interventional vs. observational, and inverse propensity scoring.
10th Apr 2022
Thinking about recsys as interventional vs. observational, and inverse propensity scoring.
David Rozado...
The Increasing Frequency of Terms Denoting Political Extremism in U.S. and U.K. News Media
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with...
6th Apr 2022
Published manuscript Twitter Thread Introduction I summarize here a published study co-authored with Eric Kaufmann where we examine longitudinally the prevalence of terms denoting far-right and far-left political extremism in more than 30 million written news and opinion articles...
Sam Altman
DALL•E 2
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from...
6th Apr 2022
Today we did a research launch of DALL•E 2, a new AI tool that can create and edit images from natural language instructions.
Most importantly, we hope people love the tool and find it useful. For me, it’s the most delightful thing to play with we’ve created so far. I find it to...
Frank’s Ramblings
My Experience Living and Working in China, Part II: COVID Stories
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
29th Mar 2022
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
fast.ai
There’s no such thing as not a math person
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
15th Mar 2022
Many cultural factors, misconceptions, stereotypes, and obstacles turn people off to math.
Andrej Karpathy blog
Deep Neural Nets: 33 years ago and 33 years from now
.post-header h1 {
font-size: 35px;
}
.post pre,
.post code {
background-color: #fcfcfc;
...
14th Mar 2022
.post-header h1 {
font-size: 35px;
}
.post pre,
.post code {
background-color: #fcfcfc;
font-size: 13px; /* make code smaller for this post... */
}
The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some...
Eugene Yan
Data Science Project Quick-Start
Hard-won lessons on how to start data science projects effectively.
6th Mar 2022
Hard-won lessons on how to start data science projects effectively.
Eugene Yan
Red Flags to Look Out for When Joining a Data Team
What to consider for in terms of data, roadmap, role, manager, tooling, etc.
13th Feb 2022
What to consider for in terms of data, roadmap, role, manager, tooling, etc.
Frank’s Ramblings
My Experience Living and Working in China, Part I
In this four-part article, I’ll go over some of the lessons I learned living and doing business in...
7th Feb 2022
In this four-part article, I’ll go over some of the lessons I learned living and doing business in China’s tech industry. During my time in China, I’ve led a team of 10+ engineers to develop a location-based IoT and sensing platform, co-founded an open-source project called...
matt.sh
i, for one, welcome our new insect overlords
Hello AI
Hello AI / AGI / Computational Consciousness,
how’s it going? how’s the whole “being alive”...
6th Feb 2022
Hello AI
Hello AI / AGI / Computational Consciousness,
how’s it going? how’s the whole “being alive” thing treating you?
perhaps, first understand certain kinds of dangerous ambition never grow again, ’cause killers linger evermore.
depending on when this finds you, maybe we have...
Matt Mazur
Updates: Preceden Trends, Training Help Scout’s New Analytics Engineer, Don’t Look Up, and Ray...
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to...
28th Jan 2022
Preceden Recurring Revenue: In January 2021 I introduced automatically recurring annual plans to Preceden. Prior to that the annual plans did not renew automatically which was an intentional (but bad) choice I had made because most users did not user Preceden for more than a...
matt.sh
AWS VPC: A Reintroduction (or, how to allocate 5 million IPs in 5 minutes)
AWS VPCs: A Reintroduction
or, how to allocate 5 million private IPs in 17 regions, 10+ countries, 2...
24th Jan 2022
AWS VPCs: A Reintroduction
or, how to allocate 5 million private IPs in 17 regions, 10+ countries, 2 commands, 5 minutes.
A Starting
Do you know how many services AWS has these days?
In [1]: import boto3
...:
...: s = boto3.session.Session()
...:...
David Rozado...
The Prevalence of Prejudice-Denoting Terms in Spanish Newspapers
Published paper Twitter summary Introduction Previous scholarly literature here and here has...
20th Jan 2022
Published paper Twitter summary Introduction Previous scholarly literature here and here has documented a pronounced increase in the prevalence of prejudice-denoting terms in American news media content. Some have referred to this shift in journalistic discourse and related...
Eugene Yan
How to Keep Learning about Machine Learning
Beyond getting that starting role, how does one continue growing in the field?
19th Jan 2022
Beyond getting that starting role, how does one continue growing in the field?
Frank’s Ramblings
A Gentle Introduction to Vector Databases
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium,...
23rd Dec 2021
Update: An earlier version of this post was cross-published to the Zilliz learning center, Medium, and DZone.
If you have any feedback, feel free to connect with me on Twitter or Linkedin. If you enjoyed this post and want to learn a bit more about vector databases and embeddings...
David Rozado...
The decreasing/increasing prevalence of the terms "global warming" and "climate change" in news...
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing...
21st Dec 2021
I will drop this here as a simple curiosity without much further comment: The decreasing/increasing prevalence of the terms global warming and climate change in news media discourse. For some reason, peak usage of the term global warming happened in 2007 and it has been dropping...
Matt Mazur
Nick Kolenda Reviews Preceden
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing...
20th Dec 2021
Nick Kolenda is an author, teacher, and consultant who specializes in the psychology of marketing and related topics like pricing optimization, sales psychology, and website behavior. He’s also happens to be a regular in a poker game I host each week. A few months back he...
matt.sh
Setup macOS 2021 For Optimal Command Line Productivity
Setup Modern Command Line Tools
here’s a quick guide for setting up modern command line environments...
21st Nov 2021
Setup Modern Command Line Tools
here’s a quick guide for setting up modern command line environments on a fresh macOS Monterey 12+ as of late 2021.
Enjoy.
stop saving screenshots directly to destop
We no longer need to defaults write com.apple.screencapture to stop all...
Eugene Yan
5 Lessons I Learned from Writing Online (Guest post by Susan Shu)
Susan shares 5 lessons she gained from writing online in public over the past year.
7th Nov 2021
Susan shares 5 lessons she gained from writing online in public over the past year.
Sam Altman
Helion
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion...
5th Nov 2021
I’m delighted to be investing more in Helion. Helion is by far the most promising approach to fusion I’ve seen.
David and Chris are two of the most impressive founders and builders (in the sense of building fusion machines, in addition to building companies!) I have ever met,...
Weighty Thoughts
One Definite Sign of a Bad Startup Idea
If you can’t tell anyone about your startup idea, it's not a good idea
10th Oct 2021
If you can’t tell anyone about your startup idea, it's not a good idea
Eugene Yan
RecSys 2021 - Papers and Talks to Chew on
Simple baselines, ideas, tech stacks, and packages to try.
3rd Oct 2021
Simple baselines, ideas, tech stacks, and packages to try.
Piotr Migdał's Blog
Embodiment for nerds
Or how you can learn to get in touch with your body and emotions.
18th Sep 2021
Or how you can learn to get in touch with your body and emotions.
David Rozado...
The ‘Great Awokening' Preceded Trump. It May Continue Beyond Him
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse...
8th Sep 2021
Newsweek opinion piece Follow-up: Prevalence of Prejudice-Denoting Words in News Media Discourse Over the last five years, poll after poll has found that the GOP base has grown warmer towards Blacks, Hispanics, immigrants and Muslims. They’ve simultaneously become
Eugene Yan
Reinforcement Learning for Recommendations and Search
Focusing on long-term rewards, exploration, and frequently updated item.
5th Sep 2021
Focusing on long-term rewards, exploration, and frequently updated item.
seangoedecke.com RSS...
Learning incident response with problem sets
It’s hard to teach good incident response. A good understanding of how the system runs in production...
3rd Sep 2021
It’s hard to teach good incident response. A good understanding of how the system runs in production is essential, but how do you build that…
Weighty Thoughts
Startup Valuation Made Simple(r) - Working Backwards
Counterintuitively, start from how much money you need
30th Aug 2021
Counterintuitively, start from how much money you need
David Rozado...
Prevalence in News Media of Two Competing Hypotheses about COVID-19 Origins
Published article Quick Twitter summary Introduction As of August 2021, the origins of the...
26th Aug 2021
Published article Quick Twitter summary Introduction As of August 2021, the origins of the SARS-CoV-2 virus that caused the COVID-19 pandemic remain a mystery. This essay summarizes a recent article I published about the prevalence in news media articles of two popular hypotheses...
Eugene Yan
Bootstrapping Labels via ___ Supervision & Human-In-The-Loop
How to generate labels from scratch with semi, active, and weakly supervised learning.
1st Aug 2021
How to generate labels from scratch with semi, active, and weakly supervised learning.
David Rozado...
Sentiment Associations of Politically Loaded Terms in News Media
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded...
15th Jul 2021
Summary of manuscript “Using Word Embeddings to Probe Sentiment Associations of Politically Loaded Terms in News and Opinion Articles from News Media Outlets”
matt.sh
Developer Shapes of the 2020s
The Developer Shapes of Tomorrow, Today
You’ve probably heard of T-Shaped developers, but have you...
12th Jul 2021
The Developer Shapes of Tomorrow, Today
You’ve probably heard of T-Shaped developers, but have you heard of all the other shapes we can be?
trigger warning: page may be hazardous to vampires or entities known to have intersecting right angle visual processing defects.
Wikipedia...
Eugene Yan
Influencing without Authority for Data Scientists
Show them the data, the Socratic method, earning trust, and more.
4th Jul 2021
Show them the data, the Socratic method, earning trust, and more.
Andrej Karpathy blog
A from-scratch tour of Bitcoin in Python
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
...
21st Jun 2021
.wrap {
max-width: 900px;
}
p {
font-family: sans-serif;
font-size: 15px;
font-weight: 300;
overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */
}
.post pre,
.post code {
background-color: #fafafa;
font-size: 13px; /*...
Eugene Yan
Towards Data Science - Author Spotlight with Eugene Yan
My favourite project, how I write weekly and how you can start, and content I would like to see more...
2nd Jun 2021
My favourite project, how I write weekly and how you can start, and content I would like to see more of.
Eugene Yan
The Metagame of Applying Machine Learning
How to go from knowing machine learning to applying it at work to drive impact.
2nd May 2021
How to go from knowing machine learning to applying it at work to drive impact.
matt.sh
sqlalchemy: the async-ening
SQLAlchemy: The Async-ening
Background
SQLAlchemy is one of the seven wonders of the modern Python...
24th Apr 2021
SQLAlchemy: The Async-ening
Background
SQLAlchemy is one of the seven wonders of the modern Python ecosystem1.
SQLAlchemy recently released 1.4 (2021-03-15) as their first step to a long-term-sustainable SQL ORM architecture. Version 1.4 is an intermediate release until 2.0 can...
seangoedecke.com RSS...
Blockchain explained simply
A blockchain is a distributed database. Bitcoin, Ethereum and Dogecoin are all different databases....
20th Apr 2021
A blockchain is a distributed database. Bitcoin, Ethereum and Dogecoin are all different databases. A blockchain node is a computer with an…
Piotr Migdał's Blog
Quantum logic gates for a single qubit, interactively
10th Apr 2021
Eugene Yan
Planning Your Career: Values and Superpowers
What do you deeply care about? What do you excel at? Build a career out of that.
4th Apr 2021
What do you deeply care about? What do you excel at? Build a career out of that.
Andrej Karpathy blog
Short Story on AI: Forward Pass
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color:...
27th Mar 2021
p {
text-align: justify;
}
.post pre, .post code {
border: none;
background-color: #eee;
}
The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test. It is probably worth it (though not required) to skim this post to get...
Eugene Yan
How to Write Design Docs for Machine Learning Systems
Pointers to think through your methodology and implementation, and the review process.
7th Mar 2021
Pointers to think through your methodology and implementation, and the review process.
Piotr Migdał's Blog
Don’t fight, flight (or freeze) your body and emotions
Procrastination is a flight response, depression is freeze, anxious attachment is fight.
25th Feb 2021
Procrastination is a flight response, depression is freeze, anxious attachment is fight.
Eugene Yan
DataTalksClub - Building an ML System; Behind the Scenes
Design and architecture, tech stack, methodology, results, and lessons learned.
7th Feb 2021
Design and architecture, tech stack, methodology, results, and lessons learned.
Solving the decision...
solving the jest.mock()+esmodules hoisting problem
A proposal to use jest.mock() with esmodules without babel shenanigans
6th Feb 2021
A proposal to use jest.mock() with esmodules without babel shenanigans
Weighty Thoughts
What I got Right or Wrong in 2020
Reflecting on the Past Year
13th Jan 2021
Reflecting on the Past Year
Solving the decision...
iff
On implementing a client for feature flags in your UI codebase
4th Jan 2021
On implementing a client for feature flags in your UI codebase
Eugene Yan
2021 Roadmap: Sharing, Helping, and Living More
A public roadmap to track and share my progress; nothing mission or work-related.
3rd Jan 2021
A public roadmap to track and share my progress; nothing mission or work-related.
seangoedecke.com RSS...
Acing the design interview
If you haven’t designed an actual system before, design interviews can be tough. Knowing how to work...
1st Jan 2021
If you haven’t designed an actual system before, design interviews can be tough. Knowing how to work with a particular web service or…
seangoedecke.com RSS...
Writing good technical explanations
Software engineering is mainly learning. There is a great demand for technical explanations, and...
25th Dec 2020
Software engineering is mainly learning. There is a great demand for technical explanations, and many thousands of books, talks and blog…
matt.sh
Fix Homebrew Python and Unify Development
Stop Homebrew Version-Jacking Your Python All The Time
It happened again. I do a careless brew...
13th Dec 2020
Stop Homebrew Version-Jacking Your Python All The Time
It happened again. I do a careless brew upgrade and homebrew blows away1 the stable python install I had 20 virtualenvs pointing to in favor of a new major python version released two days ago that many extensions and modules...
Eugene Yan
How I’m Reflecting on 2020 and Planning for 2021
Time to clear the cache, evaluate existing processes, and start new threads.
6th Dec 2020
Time to clear the cache, evaluate existing processes, and start new threads.
Sam Altman
The Strength of Being Misunderstood
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and...
1st Dec 2020
A founder recently asked me how to stop caring what other people think. I didn’t have an answer, and after reflecting on it more, I think it's the wrong question.
Almost everyone cares what someone thinks (though caring what everyone thinks is definitely a mistake), and it's...
matt.sh
Load Balancing Stock Market Trades Using WebSockets
Load Balancing Stock Market Trades From A WebSocket Feed
Did you know you can get a live feed of...
30th Nov 2020
Load Balancing Stock Market Trades From A WebSocket Feed
Did you know you can get a live feed of every trade in the stock market?
Unlike other market APIs which tell you “don’t request too many symbols” or set hard caps on what you can request, here you can just ask for the...
Eugene Yan
Is Writing as Important as Coding?
As careers grow, how does the balance between writing & coding change? Hear from 4 tech leaders.
4th Oct 2020
As careers grow, how does the balance between writing & coding change? Hear from 4 tech leaders.
Sam Altman
PG and Jessica
A lot of people want to replicate YC in some other industry or some other place or with some other...
25th Sep 2020
A lot of people want to replicate YC in some other industry or some other place or with some other strategy. In general, people seem to assume that: 1) although there was some degree of mystery or luck about how YC got going, it can’t be that hard, and 2) if you can get it off...
seangoedecke.com RSS...
Avoiding worry driven development
Sofware dysfunction is more often motivated by anxiety, fear, worry and embarassment than it is by a...
11th Sep 2020
Sofware dysfunction is more often motivated by anxiety, fear, worry and embarassment than it is by a lack of technical skill. Engineers…
Solving the decision...
Feature flags
An introduction to feature flags
8th Aug 2020
An introduction to feature flags
Eugene Yan
What I Did Not Learn About Writing In School
Surprising lessons I picked up from the best books, essays, and videos on writing non-fiction.
2nd Aug 2020
Surprising lessons I picked up from the best books, essays, and videos on writing non-fiction.
seangoedecke.com RSS...
Building multiplayer games with socket.io and HTML5 Canvas
I’ve been building crappy hobby games on and off for my whole coding life. One of my very first apps...
29th Jul 2020
I’ve been building crappy hobby games on and off for my whole coding life. One of my very first apps was a Visual Basic game - I was in…
Eugene Yan
My Notes From Spark+AI Summit 2020 (Application-Specific Talks)
Part II of the previous write-up, this time on applications and frameworks of Spark in production
5th Jul 2020
Part II of the previous write-up, this time on applications and frameworks of Spark in production
matt.sh
Do you know about the best database ever?
I Made The World’s Best In-Memory Database But Forgot to Tell Anybody
What Now?
I’ve spent the past...
22nd Jun 2020
I Made The World’s Best In-Memory Database But Forgot to Tell Anybody
What Now?
I’ve spent the past half decade creating the world’s best in-memory database, but I forgot to tell many people about it. Whoops.
Now here’s all the details of the best database ever.
TOC
Top...
Sam Altman
Project Covalence
Almost every company and non-profit working on COVID-19 that I offered to help asked for support...
16th Jun 2020
Almost every company and non-profit working on COVID-19 that I offered to help asked for support with clinical trials—for companies focusing on developing novel drugs, vaccines, and diagnostics, rapidly spinning up trials is one of their biggest bottlenecks.
Science remains the...
Andrej Karpathy blog
Biohacking Lite
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew...
11th Jun 2020
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that (“mom said”-) level of abstraction. I also knew that I can probably get away with...
Eugene Yan
What I Love about Scrum for Data Science
Initially, I didn't like it. But over time, it grew on me. Here's why.
7th Jun 2020
Initially, I didn't like it. But over time, it grew on me. Here's why.
Sam Altman
Idea Generation
The most common question prospective startup founders ask is how to get ideas for startups. The...
28th May 2020
The most common question prospective startup founders ask is how to get ideas for startups. The second most common question is if you have any ideas for their startup.
But giving founders an idea almost always doesn’t work. Having ideas is among the most important qualities for...
Piotr Migdał's Blog
ADHD tech stack: auto time tracking
A few tips on apps for automatic time tracking, especially for people with ADHD: how to get...
19th May 2020
A few tips on apps for automatic time tracking, especially for people with ADHD: how to get immediate feedback: for actions, not guilt.
Eugene Yan
A Hackathon Where the Dinkiest Idea Won. Why?
What I Learnt about evaluating ideas from first-hand participation in a hackathon.
3rd May 2020
What I Learnt about evaluating ideas from first-hand participation in a hackathon.
Eugene Yan
Stop Taking Regular Notes; Use a Zettelkasten Instead
Using a Zettelkasten helps you make connections between notes, improving learning and memory.
5th Apr 2020
Using a Zettelkasten helps you make connections between notes, improving learning and memory.
Eugene Yan
Simpler Experimentation with Jupyter, Papermill, and MLflow
Automate your experimentation workflow to minimize effort and iterate faster.
15th Mar 2020
Automate your experimentation workflow to minimize effort and iterate faster.
Sam Altman
The Virus
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to...
7th Mar 2020
Although I still hope things will go differently, the experts I’ve spoken to think we are likely to face a global tragedy—hundreds of thousands of deaths from Covid-19.
I hope that society views this as a warning for the future. Covid-19 is bad, but only a warm-up. I think it’s...
Piotr Migdał's Blog
How I learned to stop worrying and love the types & tests
On TypeScript, ESlint, jest, TSDoc, Travis-CI, and VSCode (with inspirations from the Zen of...
2nd Mar 2020
On TypeScript, ESlint, jest, TSDoc, Travis-CI, and VSCode (with inspirations from the Zen of Python).
Eugene Yan
My Journey from Psych Grad to Leading Data Science at Lazada
How hard work, many failures, and a bit of luck got me into the field and up the ladder.
27th Feb 2020
How hard work, many failures, and a bit of luck got me into the field and up the ladder.
Sam Altman
Hard Startups
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard...
26th Feb 2020
The most counterintuitive secret about startups is that it’s often easier to succeed with a hard startup than an easy one. A hard startup requires a lot more money, time, coordination, or technological development than most startups. A good hard startup is one that will be...
Sam Altman
How To Invest In Startups
There is a lot of advice about how to be a good startup founder. But there isn’t very much about...
13th Jan 2020
There is a lot of advice about how to be a good startup founder. But there isn’t very much about how to be a good startup investor.
Before going any further, I should point out that this is a particularly hard time to invest in startups—it’s easier right now to be a...
Eugene Yan
Building a Strong Baseline Recommender in PyTorch, on a Laptop
Building a baseline recsys based on data scraped off Amazon. Warning - Lots of charts! (Part 1 of...
6th Jan 2020
Building a baseline recsys based on data scraped off Amazon. Warning - Lots of charts! (Part 1 of 2).
Eugene Yan
OMSCS CS6200 (Introduction to OS) Review and Tips
OMSCS CS6200 (Introduction to OS) - Moving data from one process to another, multi-threaded.
15th Dec 2019
OMSCS CS6200 (Introduction to OS) - Moving data from one process to another, multi-threaded.
matt.sh
APFS Object Map Recovery (free)
APFS Object Map Recovery
I spent a day figuring out how to look into a corrupt encrypted APFS...
19th Nov 2019
APFS Object Map Recovery
I spent a day figuring out how to look into a corrupt encrypted APFS partition. Here’s the notes.
If you only care about the answer, jump to the last section.
Kernel Panic
macOS hard panicked on me with a graphics driver corruption error...
Piotr Migdał's Blog
“The Statues” by Jacek Kaczmarski
“Posągi” (1989) translated from Polish to English by Anna Karpiuk and Piotr Migdał: “What bliss when...
25th Oct 2019
“Posągi” (1989) translated from Polish to English by Anna Karpiuk and Piotr Migdał: “What bliss when a tyrant’s tall statues are shattered”
Eugene Yan
OLX Prod Tech 2019 Keynote - Asia's Tech Giants & SuperApps
Keynote on how Asia's tech giants scale and their SuperApp strategy.
3rd Oct 2019
Keynote on how Asia's tech giants scale and their SuperApp strategy.
Eugene Yan
OMSCS CS6750 (Human Computer Interaction) Review and Tips
OMSCS CS6750 (Human Computer Interaction) - You are not your user! Or how to build great products.
3rd Sep 2019
OMSCS CS6750 (Human Computer Interaction) - You are not your user! Or how to build great products.
Piotr Migdał's Blog
To make a cool game, you first have to play other cool games
26th Aug 2019
Eugene Yan
OMSCS CS6440 (Intro to Health Informatics) Review and Tips
OMSCS CS6440 (Intro to Health Informatics) - A primer on key tech and standards in healthtech.
4th Aug 2019
OMSCS CS6440 (Intro to Health Informatics) - A primer on key tech and standards in healthtech.
Piotr Migdał's Blog
Exploring human vs machine learning (one blogpost at a time)
To err is human... and machine, alike. Overfitting, adversarial examples, optical illusions,...
15th Jul 2019
To err is human... and machine, alike. Overfitting, adversarial examples, optical illusions, hallucinations, Freudian slips, etc.
Made by Ollin
Priors for Autonomous Vehicle Development
30th Jun 2019
Piotr Migdał's Blog
Cloak & dagger creativity camp
“You cannot create an experience, you can create [conditions] for an experience.” — Seth
19th Jun 2019
“You cannot create an experience, you can create [conditions] for an experience.” — Seth
Eugene Yan
OMSCS CS7646 (Machine Learning for Trading) Review and Tips
OMSCS CS7646 (Machine Learning for Trading) - Don't sell your house to trade algorithmically.
11th May 2019
OMSCS CS7646 (Machine Learning for Trading) - Don't sell your house to trade algorithmically.
The Colby Echo -...
Paw Pals helps local animals find permanent homes
9th May 2019
Eugene Yan
What does a Data Scientist really do?
No, you don't need a PhD or 10+ years of experience.
30th Apr 2019
No, you don't need a PhD or 10+ years of experience.
Andrej Karpathy blog
A Recipe for Training Neural Networks
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common...
25th Apr 2019
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encountered...
Piotr Migdał's Blog
Does AI have a dirty mind, too?
16th Apr 2019
Eugene Yan
DATAx - A Production ML system for SEA's Biggest Hospital Group
How we built an ML system to predict hospitalization costs at admission; sharing at DATAx...
6th Mar 2019
How we built an ML system to predict hospitalization costs at admission; sharing at DATAx Conference.
Piotr Migdał's Blog
An edgy intro to graphs of interpersonal relationships
CW: human sexuality, maths, LaTeX, spoilers for the Game of Thrones
2nd Mar 2019
CW: human sexuality, maths, LaTeX, spoilers for the Game of Thrones
Eugene Yan
Data Science and Agile (Frameworks for Effectiveness)
Taking the best from agile and modifying it to fit the data science process (Part 2 of 2).
2nd Feb 2019
Taking the best from agile and modifying it to fit the data science process (Part 2 of 2).
Sam Altman
How To Be Successful
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of...
24th Jan 2019
I’ve observed thousands of founders and thought a lot about what it takes to make a huge amount of money or to create something important. Usually, people start off wanting the former and end up wanting the latter.
Here are 13 thoughts about how to achieve such outlier...
Eugene Yan
DataScience SG Meetup - Panel On the Different Roles in Data
What's the difference between a data scientist, data engineer, and ML engineer? A panel at Google.
17th Jan 2019
What's the difference between a data scientist, data engineer, and ML engineer? A panel at Google.
matt.sh
Signal Conversation Archive Backup
Signal Conversation Archive Backup
SCAB
Welcome to Signal Conversation Archive Backup...
26th Dec 2018
Signal Conversation Archive Backup
SCAB
Welcome to Signal Conversation Archive Backup (SCAB)!
(alternative title: Conversation Retrieval And Persistence)
Why do we need SCAB? Well, Signal is hostile when it comes to letting users own their private conversations1. Just take a look...
Eugene Yan
OMSCS CS6601 (Artificial Intelligence) Review and Tips
OMSCS CS6601 (Artificial Intelligence) - First, start with the simplest solution, and then add...
20th Dec 2018
OMSCS CS6601 (Artificial Intelligence) - First, start with the simplest solution, and then add intelligence.
Eugene Yan
GovTech Conference - Data Science and Agile—Can or Not?
Yes, Agile can be adopted by data science teams. Moderating a panel at GovTech STACK.
28th Oct 2018
Yes, Agile can be adopted by data science teams. Moderating a panel at GovTech STACK.
Piotr Migdał's Blog
Keras vs. PyTorch: Alien vs. Predator recognition with transfer learning
3rd Oct 2018
Piotr Migdał's Blog
Simple diagrams of convoluted neural networks
A good diagram is worth a thousand equations - let's create more of these!
15th Sep 2018
A good diagram is worth a thousand equations - let's create more of these!
Piotr Migdał's Blog
From Customer Segmentation to Recommendation Systems
AI Customer Targeting Levels – From Customer Segmentation to Recommendation Systems
29th Aug 2018
AI Customer Targeting Levels – From Customer Segmentation to Recommendation Systems
Made by Ollin
A Video History of Self-Driving Cars
27th Aug 2018
Eugene Yan
OMSCS CS6460 (Education Technology) Review and Tips
OMSCS CS6460 (Education Technology) - How to scale education widely through technology.
25th Aug 2018
OMSCS CS6460 (Education Technology) - How to scale education widely through technology.
Eugene Yan
OMSCS CS7642 (Reinforcement Learning) Review and Tips
OMSCS CS7642 (Reinforcement Learning) - Landing rockets (fun!) via deep Q-Learning (and its...
30th Jul 2018
OMSCS CS7642 (Reinforcement Learning) - Landing rockets (fun!) via deep Q-Learning (and its variants).
matt.sh
lematt is Matt's Let's Encrypt Automation
Matt’s Let’s Encrypt Automation
Welcome to Infrastructure Week July 2018! New articles and tools...
23rd Jul 2018
Matt’s Let’s Encrypt Automation
Welcome to Infrastructure Week July 2018! New articles and tools every day this week.
day 1: lematt
day 2: netmatt
day 3: email 2018
day 4: web 2018
day 5: local nets
I made a kickass certificate automation platform called lematt and this page is...
Piotr Migdał's Blog
Keras or PyTorch as your first deep learning framework
27th Jun 2018
Sam Altman
Reinforcement Learning Progress
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general...
25th Jun 2018
Today, OpenAI released a new result. We used PPO (Proximal Policy Optimization), a general reinforcement learning algorithm invented by OpenAI, to train a team of 5 agents to play Dota and beat semi-pros.
This is the game that to me feels closest to the real world and complex...
Eugene Yan
Big Data & Analytics Summit - Data Science Challenges @ Lazada
Technical challenges easy compared to business and people issues. Sharing at the BDA Summit.
21st Jun 2018
Technical challenges easy compared to business and people issues. Sharing at the BDA Summit.
Eugene Yan
Building a Strong Data Science Team Culture
Culture >> Hierarchy, Process, Bureaucracy.
12th May 2018
Culture >> Hierarchy, Process, Bureaucracy.
Sam Altman
US Digital Currency
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is...
10th May 2018
I am pretty sure cryptocurrency is here to stay in some form (at least as a store of value, which is the only use case we have seen work at scale so far). There was possibly a time when governments could have totally stopped it, but it feels like that’s in the rearview mirror.
...
Eugene Yan
INSEAD Lunchtime Talks - How Lazada uses Data
And my idiosyncratic journey to VP of Data Science at Lazada (Alibaba). A Lunchtime chat at INSEAD.
25th Apr 2018
And my idiosyncratic journey to VP of Data Science at Lazada (Alibaba). A Lunchtime chat at INSEAD.
Sam Altman
Productivity
I think I am
at least somewhat more productive than average, and people sometimes ask me...
10th Apr 2018
I think I am
at least somewhat more productive than average, and people sometimes ask me for
productivity tips. So I decided to just write them all down in one place.
Compound
growth gets discussed as a financial concept, but it works in careers as well,
and it is magic. A...
Andrej Karpathy blog
(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared....
20th Jan 2018
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but
whenever I do get a chance to post something I have recently been defaulting
to doing it on Medium because...
Eugene Yan
OMSCS CS7641 (Machine Learning) Review and Tips
OMSCS CS7641 (Machine Learning) - Revisiting the fundamentals and learning new techniques.
27th Dec 2017
OMSCS CS7641 (Machine Learning) - Revisiting the fundamentals and learning new techniques.
matt.sh
Database Overhead: Just Say No
Database Overhead and You
Your battle cry is more data!
Your budget’s battle cry is more...
20th Dec 2017
Database Overhead and You
Your battle cry is more data!
Your budget’s battle cry is more efficiency!
Do you know how bloated your data storage is right now?
Let’s talk about your data overhead.
A paradox of data storage is: the more data you have, the less space you have to...
Made by Ollin
NVIDIA Internship (2017)
Notes on my internship at NVIDIA Redmond.
15th Dec 2017
Notes on my internship at NVIDIA Redmond.
Sam Altman
The Merge
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if...
7th Dec 2017
A popular topic in Silicon Valley is talking about what year humans and machines will merge (or, if not, what year humans will get surpassed by rapidly improving AI or a genetically enhanced species). Most guesses seem to be between 2025 and 2075.
People used to call this the...
Sam Altman
American Equity
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual...
27th Nov 2017
I’d like feedback on the following idea.
I think that every adult US citizen should get an annual share of the US GDP.
I believe that owning something like a share in America would align all of us in making the country as successful as possible—the better the country does, the...
Piotr Migdał's Blog
After PyData Warsaw 2017
Links to talk and analysis of participants demographics and sign-up dynamics. From PyData Warsaw...
15th Nov 2017
Links to talk and analysis of participants demographics and sign-up dynamics. From PyData Warsaw Conference 2017 (19-20 Oct 2017).
Eugene Yan
My first 100 days as Data Science Lead
How being a Lead / Manager is different from being an individual contributor.
25th Sep 2017
How being a Lead / Manager is different from being an individual contributor.
Piotr Migdał's Blog
Human log loss for image classification
12th Sep 2017
Piotr Migdał's Blog
!!con or doing inclusivity well
Inclusive-inclusivity, or an awesome programming conference, attracting diverse participants and...
14th Aug 2017
Inclusive-inclusivity, or an awesome programming conference, attracting diverse participants and accommodating for various needs.
Eugene Yan
OMSCS CS6300 (Software Development Process) Review and Tips
OMSCS CS6300 (Software Development Process) - Java and collaboratively developing an Android app.
13th Aug 2017
OMSCS CS6300 (Software Development Process) - Java and collaboratively developing an Android app.
Eugene Yan
Tech in Asia - My Journey in Data Science and Advice for others
Sharing about why data science, data science myths, a typical day, and more with TIA.
26th Jul 2017
Sharing about why data science, data science myths, a typical day, and more with TIA.
Piotr Migdał's Blog
Dating for nerds (part 1): problem diagnosis
Heterosexual male nerd dating problem - does it exist? What are the main pain points?
23rd Jul 2017
Heterosexual male nerd dating problem - does it exist? What are the main pain points?
Full Width 
Shortcuts 
Sign Up 
Log In 
Articles 
Reading List 