Talks to Watch

AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)

18K views · Dec 13, 2017 · 56:55 · 0 HN recommenders · 3 mentions · discussed 2018–2022

A Netflix performance engineer presents how Netflix tunes EC2 instances, covering instance type choice, Xen modes, SR-IOV and kernel tuning. The goal is near bare-metal performance in the cloud.

Why Hacker News points people here: HN cites it as an example of workload-dependent performance tuning at scale and of Netflix's AWS practices.

“performance tuning is an art form as it is workload dependant”HN comment, 2019

What Hacker News said 3

Cites itscarface74May 2018

“Most of the optimization's they do are standard things at scale”

Netflix's AWS usage and performance tuning by measurement

Full comment

They use a lot of AWS services - not just virtual machines - First they use Ubuntu Linux - SES (Email) - ElasticSearch (AWS has their own managed version) - SQS (queueing system) - S3 (storage) -auto scaling Most of the optimization's they do are standard things at scale where they are tuning by measuring performance. this video and the slide deck from the presentation. link But that's even more of a reason to choose AWS, Netflix has open sourced dozens of tools specifically related to AWS. You get to take advantage of their tools and knowledge.

in “Show HN: Corral – A Serverless MapReduce Framework” · view on HN
Cites itignoramousMar 2019

“performance tuning is an art form as it is workload dependant”

Performance tuning is workload dependent

Full comment

Well, most distributions choose saner defaults. For instance, RHEL/CentOS/AmazonLinux use noop io-scheduler by default for SSD based machines. Though, I get your point: for instance, the TCP keep-alive defaults aren't suitable for all kinds of workloads: link I guess, that's why performance tuning is an art form as it is workload dependant: this video

in “The creation of the io.latency block I/O controller” · view on HN
Cites itdijitMay 2022

“Talk (2017)”

Full comment

it was actually 5x, my bad, but here's the references: Original info being mentioned as a rumour (2016): link Slides for confirmation by Greeg (2017): link Talk (2017): this video More discussion: link Original tweet has been deleted, but I have a screenshot here slide 9: link

in “Cloud Pricing Comparison: AWS vs. Azure vs. Google Cloud Platform in 2022” · view on HN