More from Probably Overthinking It
This is the last in a series of excerpts from Elements of Data Science, now available from Lulu.com and online booksellers. This article is based on the Recidivism Case Study, which is about algorithmic fairness. The goal of the case study is to explain the statistical arguments presented in two articles from 2016: Both are about COMPAS, a statistical tool used in the justice system to assign defendants a “risk score” that is intended to reflect the risk that they... Read More Read More
This is the fifth in a series of excerpts from Elements of Data Science, now available from Lulu.com and online booksellers. It’s based on Chapter 16, which is part of the political alignment case study. You can read the complete example here, or run the Jupyter notebook on Colab. Because this is a teaching example, it builds incrementally. If you just want to see the results, scroll to the end! Chapter 16 is a template for exploring relationships between political... Read More Read More
This is the fourth in a series of excerpts from Elements of Data Science, now available from Lulu.com and online booksellers. It’s from Chapter 15, which is part of the political alignment case study. You can read the complete chapter here, or run the Jupyter notebook on Colab. In the previous chapter, we used data from the General Social Survey (GSS) to plot changes in political alignment over time. In this notebook, we’ll explore the relationship between political alignment and... Read More Read More
The premise of Think Stats, and the other books in the Think series, is that programming is a tool for teaching and learning — and many ideas that are commonly presented in math notation can be more clearly presented in code. In the draft third edition of Think Stats there is almost no math — not because I made a special effort to avoid it, but because I found that I didn’t need it. For example, here’s how I present... Read More Read More
I’ve written before about changes in marriage patterns in the U.S., and it’s one of the examples in Chapter 13 of the new third edition of Think Stats. My analysis uses data from the National Survey of Family Growth (NSFG). Today they released the most recent data, from surveys conducted in 2022 and 2023. So here are the results, updated with the newest data: The patterns are consistent with what we’ve see in previous iterations — each successive cohort marries... Read More Read More
More in science
In math and computer science, researchers have long understood that some questions are fundamentally unanswerable. Now physicists are exploring how even ordinary physical systems put hard limits on what we can predict, even in principle. The post ‘Next-Level’ Chaos Traces the True Limit of Predictability first appeared on Quanta Magazine
The Magic Development of Taiwan, South Korea, Japan, and China, and What That Tells Us about US Tariffs, China’s Future, EU Protectionism, Japan’s Zombie Debt, Argentina’s Arrested Development, and more
Non-blog life has been very busy, and events have been changing rapidly, but I thought it would be a good idea to give a brief bulleted list of updates regarding the NSF and associated issues: A court decision regarding who has the authority to fire probationary federal workers has led to the NSF hiring back 84 of the employees that it had previously dismissed, at least for now. The Office of Personnel Management is still altering their wording on this. There is likely some kind of continuing resolution in the offing in Congress, as the current funding stopgap expires on March 14. If a CR passes that extends to the rest of the fiscal year (Sept 30), that would stave off any big cuts until next FY's budget. At the same time, a number of NSF-funded research experience for undergraduate programs are being cancelled for this year. This is very unfortunate, as REU programs are many undergrads' first exposure to real research, while also being a critical mechanism for students at non-research-heavy institutions to get research experience. The concerns about next year's funding are real. As I've written before, cuts and programmatic changes have been proposed by past presidents (including this one in his first term), but historically Congressional appropriators have tended not to follow those. It seems very likely that the White House's budget proposal will be very bleak for science. The big question is the degree to which Congress will ignore that. In addition to the budget, agencies (including NSF) have been ordered to prepare plans for reductions in force - staffing cuts - with deadlines to prepare those plans by 13 March and another set of plans by 14 April. Because of all this, a number of universities are cutting back on doctoral program admissions (either in specific departments or more broadly). My sense is that universities with very large components of NIH funding thanks to medical schools are being particularly cautious. Schools are being careful because many places guarantee some amount of support for at least several years, and it's difficult for them to be full-speed-ahead given uncertainties in federal sponsor budgets, possible endowment taxes, possible revisions to indirect cost policies, etc. Enormous uncertainty remains in the wake of all of this activity, and this period of comparative quiet before the staffing plans and CR are due is an eerie calm. (Reminds me of the line from here, about how it can be unsettling when a day goes by and you don't hear anything about the horse loose in the hospital.) In other news, there is a national Stand Up for Science set of rallies tomorrow. Hopefully the net impact of this will be positive. The public and our legislators need to understand that support for basic science is not a partisan issue and has been the underpinning of enormous economic and technological progress.
In 2006 (yes, it was that long ago – yikes) the International Astronomical Union (IAU) officially adopted the definition of dwarf planet – they are large enough for their gravity to pull themselves into a sphere, they orbit the sun and not another larger body, but they don’t gravitationally dominate their orbit. That last criterion […] The post Where Are All the Dwarf Planets? first appeared on NeuroLogica Blog.
And all the different ways you can “train” a model