Real-time 360-degree video communication requires transmitting full spherical video frames even though users view only a small portion at any moment, wasting bandwidth and degrading viewport quality. Low-latency requirements prevent the use of buffering, complex prediction models, or heavy processing borrowed from on-demand streaming, and existing real-time communication frameworks are not designed to optimize 360-degree content. This leads to inefficient transmission, poor visual fidelity in the user’s field of view, and difficulty meeting real-time performance constraints.
The invention uses content-adaptive oriented projection techniques to dynamically reshape 360-degree video frames so that pixel density is concentrated in a user’s current viewing direction. Real-time viewport feedback and network conditions determine projection parameters, which are applied using GPU-accelerated transformations for low-latency processing. Projection metadata is transmitted using RTP header extensions, allowing receivers to accurately reverse the transformation and display high-quality viewport content while minimizing transmission of unviewed pixels.
• Improves viewport visual quality through dynamic projection
• Reduces bandwidth consumption by minimizing unviewed pixel transmission
• Achieves real-time performance using GPU-accelerated transformations
• Integrates seamlessly with existing WebRTC workflows
• Enhances user experience with adaptive content and bitrate control
• United States – 63/090,273 – Provisional – Filed 10/11/2020 – Issued 10/12/2020 – Status: Converted
• United States – 17/449,893 – US20220116441A1 – Patent No. 11,785,069 – Utility – Filed 10/4/2021 – Issued 10/10/2023 – Status: Patented
Prototype
This technology is available for licensing.
Strong potential for adoption by video communication platforms, immersive media providers, and telepresence solution developers seeking bandwidth-efficient, low-latency, and high-quality 360-degree streaming technologies.
Additional technical details and implementation information available upon request.