LiveNAS
Stream high-quality live videos even when the network becomes congested
Summary
Live video accounts for a significant volume of today’s Internet video. Despite a large number of efforts to enhance user quality of experience (QoE) both at the ingest and distribution side of live video, the fundamental limitations are that streamer’s upstream bandwidth and computational capacity limit the quality of experience of thousands of viewers.
To overcome this limitation, we design LiveNAS, a new live video ingest framework that enhances the origin stream’s quality by leveraging computation at ingest servers. Our ingest server applies neural super-resolution on the original stream, while imposing minimal overhead on ingest clients. LiveNAS employs online learning to maximize the quality gain and dynamically adjusts the resource use to the real-time quality improvement. LiveNAS delivers high-quality live streams up to 4K resolution, outperforming WebRTC by 1.96 dB on average in Peak-Signal-to-Noise-Ratio on real video streams and network traces, which leads to 12%-69% QoE improvement for live stream viewers.
LiveNAS Video Samples
Original Ingest (WebRTC)
360p, PSNR: 27.34 dBTarget Resolution (LiveNAS)
1080p, PSNR: 30.16 dBOriginal Ingest (WebRTC)
360p, PSNR: 26.63 dBTarget Resolution (LiveNAS)
1080p, PSNR: 29.65 dBOriginal Ingest (WebRTC)
720p, PSNR: 29.69 dBTarget Resolution (LiveNAS)
4K, PSNR: 31.83 dBOriginal Ingest (WebRTC)
720p, PSNR: 33.96 dBTarget Resolution (LiveNAS)
4K, PSNR: 35.46 dBVideo Side-by-side
Publications
-
SIGCOMM