Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
18
Just open sourced hdfs2cass which is a Hadoop job (written in Java) to do efficient Cassandra bulkloading. The nice thing is that it queries Cassandra for its topology and uses that to partition the data so that each reducer can upload data directly to a Cassandra node.
over a year ago

Improve your reading experience

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from Home on Erik Bernhardsson

It's hard to write code for computers, but it's even harder to write code for humans

Writing code for a computer is hard enough. You take something big and fuzzy, some large vague business outcome you want to achive. Then you break it down recursively and think about all the cases until you have clear logical statements a computer can follow.

10 months ago 27 votes
Predicting solar eclipses with Python

As I am en route to see my first total solar eclipse, I was curious how hard it would be to compute eclipses in Python. It turns out, ignoring some minor coordinate system head-banging, I was able to get something half-decent working in a couple of hours.

a year ago 29 votes
Simple sabotage for software

CIA produced a fantastic book during the peak of World War 2 called Simple Sabotage. It laid out various ways for infiltrators to ruin productivity of a company. Some of the advice is timeless, for instance the section about “General interference with Organizations and Production”:

a year ago 25 votes
What I have been working on: Modal

Long story short: I'm working on a super cool tool called Modal. Please check it out — it lets you run things in the cloud without having to think about infrastructure. Scaling out, scheduling, containerization, using GPUs, setting up webhooks, and all kinds of other stuff.

over a year ago 26 votes
We are still early with the cloud: why software development is overdue for a change

This is is in many respects a successor to a blog post I wrote last year about what I want from software infrastructure, but the ideas morphed in my head into something sort of wider.

over a year ago 27 votes

More in technology

Your Computer Interviewed Chris Curry (1981)

Chris talks about his work with Clive Sinclair and Acorn Computers with a little BBC Micro.

5 hours ago 1 votes
Camera Genealogica (Part 1)

I’m very much into genealogy. I came to realize that my interest was more specifically as a kind of photograph genealogist.

3 days ago 7 votes
Altima NSX

Light in weight. Light in price. Heavy in features.

3 days ago 10 votes
Could these VR haptic gloves replace human touch?

We’re seeing a substantial turn towards online social interaction replacing in-person social interaction — especially among the younger generations. That was exacerbated and accelerated by the COVID-19 pandemic. But mountains of research show that physical touch is critical to a person’s mental wellbeing and online interactions haven’t been able to provide that. One solution may […] The post Could these VR haptic gloves replace human touch? appeared first on Arduino Blog.

4 days ago 5 votes
So I saw this headline

reading it was, "Is he Deommodore 64?" (No, unfortunately, Deommodore Lenoir's jersey number is 2, and I'm not even a 49ers fan.)

4 days ago 10 votes