Rick Reed of WhatsApp speaks at MeetBSD about running a messaging service on FreeBSD and Erlang at huge scale. He covers the stack, tuning and the challenges of millions of connections per host.
Why Hacker News points people here: Pointed to as a rare look at how a tiny engineering team ran WhatsApp's massive scale on FreeBSD and Erlang.
“Their technology stack (FreeBSD/Erlang) is pretty interesting, more info here: 2014 talks by Rick Reed”HN comment, 2016
Shows real challenges of running services at tens of millions of users
Full comment
I can personally guarantee to you from direct current experience that there is nothing particularly solved about running services for even 50 million users. Go watch this: this video
RecommendsddeckMay 2016
“Their technology stack (FreeBSD/Erlang) is pretty interesting, more info here: 2014 talks by Rick Reed”
2014 talk on WhatsApp's FreeBSD/Erlang stack and scale
Full comment
It's required because your phone is where your messages are stored. Whatsapp don't retain messages/media after they've been delivered to your phone, which is a compelling privacy feature for many. It's also what allows them to serve such an enormous user base with limited hardware. Their technology stack (FreeBSD/Erlang) is pretty interesting, more info here: 2014 talks by Rick Reed: linkthis video Slides: link There's likely no technical reason why you couldn't use a pc instead of a phone for users that want to use the pc as the primary client (with the phone optionally accessing the DB on the pc in the same way that the desktop client does for the phone). Perhaps they've decided that this is a small and declining market. Edit: Slides for second talk link 440k connections/sec, 1.1 million msgs/sec, 1 billion images/day, and that was in 2014...
Cites itWestCoastJustinFeb 2015
“At around 23:50 in the video, Rick Reed talks about slide #17”
Talk on WhatsApp's FreeBSD usage and versions
Full comment
There was a talk + slides about WhatsApp FreeBSD usage [1, 2]. At around 23:50 in the video, Rick Reed talks about slide #17, they say they are running 9.1 - 9.3, and looking at 10.1 (not in a hurry as 9 works for them). [1] this video [2] link
Cites itignoramousMar 2019
“WhatsApp engineering was adamant that FreeBSD was a key precursor that allowed them to scale 2m+ connections per host”
WhatsApp engineers on FreeBSD enabling 2m+ connections per host
Full comment
> no big player took to developing cool things on top. Just one data-point, but WhatsApp engineering was adamant that FreeBSD was a key precursor that allowed them to scale 2m+ connections per host on their (rather beefy) boxes: this video > It just shows you that having a technically good solution is irrelevant. True. I've seen many promising projects die/stagnate at the hands of unpopularity, *BSDs wouldn't be the first. Sigh.