Affiliation:
1. National Tsing-Hua University, Taiwan
2. Tunghai University, Taiwan
3. National Taiwan University of Science and Technology, Taiwan
Abstract
As technology advances from simple 2D designs to intricate 3D environments, the demand for high-quality visuals in video games and interactive media necessitates robust image quality assessment (IQA) techniques. Traditional methods like PSNR and SSIM, reliant on reference images, struggle with the unique challenges of 3D rendered content, highlighting the need for specialized non-reference IQA approaches. This paper introduces a novel multi-task learning architecture that corrects and predicts aliasing artifacts simultaneously, enhancing predictive accuracy without reference images. It also incorporates temporal information to improve visual coherence and smoothness. An automated labeling pipeline developed using Unity ensures a stable and unbiased dataset for model training and evaluation. Our experiments demonstrate that this approach reliably detects aliasing across various complexities, achieving state-of-the-art performance. By addressing specific challenges in rendered image assessment and leveraging innovative learning techniques, our work advances IQA for video games and simulations, ensuring high visual quality.
Publisher
Association for Computing Machinery (ACM)
Reference25 articles.
1. AMD. 2023. FidelityFX Super Resolution 2. https://gpuopen.com/fidelityfx-superresolution-2/.
2. Pontus Andersson, Jim Nilsson, Tomas Akenine-Möller, Magnus Oskarsson, Karl Johan Åström, and Mark D. Fairchild. 2020. FLIP: A Difference Evaluator for Alternating Images. Proc. ACM Comput. Graph. Interact. Tech. 3 (2020), 15:1--15:23. https://api.semanticscholar.org/CorpusID:220643528
3. Real Image Denoising With Feature Attention
4. Kernel-predicting convolutional networks for denoising Monte Carlo renderings
5. DehazeNet: An End-to-End System for Single Image Haze Removal