Skip to content

AI-based upscaling #846

Open
Open

Description

@cryptochrome

What should the engine do?

Provide AI-based upscaling of media content that has a lower resolution than the target resolution of the display. E. g. upscale 720p or 1080p videos to 4k.

Motivating media or use case

Apple's own upscaler in Apple TV devices has notoriously bad quality, and most TVs have dated, subpar upscaling technology built in. This leads to bad picture quality.

Devices like the Nvidia Shield and apps like Infuse offer built-in, AI-based upscaling that often looks better than Apple's or the TV's by orders of magnitude.

Having a similar option right in AetherEngine would allow player apps utilizing the engine to offer high-quality upscaling.

I realize this is likely a bigger effort, as it probably requires quite a bit of research and fine-tuning, but it would give Aether yet another unique capability that would be very much appreciated by the enthusiast community at large.

Area

Other

Host app / integration context

No response

Would you be willing to open a PR?

Maybe, with guidance

Activity

  1. kristofferR commented on Oct 21, 2026

    @kristofferR
    Contributor

    This is a really interesting suggestion, would be especially great for stuff like IPTV and old movies/TV.

    Apple actually added an API for this very use case in iOS 26, so this shouldn't be too hard actually!

    https://www.youtube.com/watch?t=865&v=EbRvY6j8d7g

    https://developer.apple.com/documentation/videotoolbox/vtlowlatencysuperresolutionscalerconfiguration

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions