John Carmack speaks at UMKC's 2017 commencement event about the difficulties of VR, especially end-to-end latency across hardware and software. He covers why latency and buffering matter and how nausea is addressed.
Why Hacker News points people here: Recommended whenever latency, buffering or VR comfort comes up, as an accessible account from someone who dealt with it directly.
“a lecture where he describes the difficulties in VR in a manner that anybody with minimal programming experience can understand”HN comment, 2017
“This talk blew my mind and made me feel like a terrible engineer.”
Carmack on end-to-end latency across hardware and software in VR.
Full comment
If you care about end-to-end latency, I highly recommend this talk by John Carmack: this video This talk blew my mind and made me feel like a terrible engineer. He's talking about end-to-end latency in VR, which actually has a commercial motivation because VR products with high latency will make you sick. (this obviously doesn't happen with shells and terminals!) He's talking about the buffering and filtering at every step of the way. And it's not just software -- sensors have their own controllers to do filtering, which requires buffering, before your OS kernel can even SEE the the first byte, let alone user space. On the other side, display devices and audio output devices also do nontrivial processing after you've sent them your data. It's an integrated hardware/software problem and Carmack is great at explaining it! It's a dense, long-ish talk, but worth it.
RecommendschubotJul 2017
“an excellent talk by John Carmack on this very subject”
Carmack on end-to-end hardware/software latency.
Full comment
Oh definitely, see my comment here about an excellent talk by John Carmack on this very subject (end-to-end hardware/software latency in VR): this videolink
RecommendswaivekAug 2017
“a lecture where he describes the difficulties in VR in a manner that anybody with minimal programming experience can understand”
Accessible lecture on the difficulties of VR.
Full comment
this video I disagree. See the above link for a lecture where he describes the difficulties in VR in a manner that anybody with minimal programming experience can understand.
RecommendsDig1tMay 2023
“There's an excellent video of John Carmack talking about this and how to solve it.”
Carmack on VR nausea and how to solve it.
Full comment
>Also, prolonged use causes nausea in a large percentage of people. There's an excellent video of John Carmack talking about this and how to solve it. This is much less of an issue now. this video I agree with you though that there aren't any killer apps for VR/AR yet, and it remains to be seen if there will be any at all.
Cites ithotenJun 2023
“John Carmack's lecture on systems engineering / reducing latency for VR mentions buffers repeatedly”
Carmack lecture on reducing VR latency mentioning buffers.
Full comment
John Carmack's lecture on systems engineering / reducing latency for VR mentions buffers repeatedly: this video
