Export Citations
Save this search
Please login to be able to save your searches and receive alerts for new content matching your search criteria.
- research-articleFebruary 2025
Multi-Modality Multi-Attribute Contrastive Pre-Training for Image Aesthetics Computing
IEEE Transactions on Pattern Analysis and Machine Intelligence (ITPM), Volume 47, Issue 2Pages 1205–1218https://doi.org/10.1109/TPAMI.2024.3492259In the Image Aesthetics Computing (IAC) field, most prior methods leveraged the off-the-shelf backbones pre-trained on the large-scale ImageNet database. While these pre-trained backbones have achieved notable success, they often overemphasize object-...
- research-articleDecember 2024
MISC: Ultra-Low Bitrate Image Semantic Compression Driven by Large Multimodal Model
- Chunyi Li,
- Guo Lu,
- Donghui Feng,
- Haoning Wu,
- Zicheng Zhang,
- Xiaohong Liu,
- Guangtao Zhai,
- Weisi Lin,
- Wenjun Zhang
IEEE Transactions on Image Processing (TIP), Volume 34Pages 335–349https://doi.org/10.1109/TIP.2024.3515874With the evolution of storage and communication protocols, ultra-low bitrate image compression has become a highly demanding topic. However, all existing compression algorithms must sacrifice either consistency with the ground truth or perceptual quality ...
- research-articleDecember 2024
Q-Bench<inline-formula><tex-math notation="LaTeX">$^+$</tex-math><alternatives><mml:math><mml:msup><mml:mrow/><mml:mo>+</mml:mo></mml:msup></mml:math><inline-graphic xlink:href="zhang-ieq1-3445770.gif"/></alternatives></inline-formula>: A Benchmark for Multi-Modal Foundation Models on Low-Level Vision From Single Images to Pairs
IEEE Transactions on Pattern Analysis and Machine Intelligence (ITPM), Volume 46, Issue 12Pages 10404–10418https://doi.org/10.1109/TPAMI.2024.3445770The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in <italic>low-level visual perception and understanding</...
- research-articleOctober 2024
G-Refine: A General Quality Refiner for Text-to-Image Generation
- Chunyi Li,
- Haoning Wu,
- Hongkun Hao,
- Zicheng Zhang,
- Tengchuan Kou,
- Chaofeng Chen,
- Lei Bai,
- Xiaohong Liu,
- Weisi Lin,
- Guangtao Zhai
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 7375–7384https://doi.org/10.1145/3664647.3681152With the evolution of Text-to-Image (T2I) models, the quality defects of AI-Generated Images (AIGIs) pose a significant barrier to their widespread adoption. In terms of both perception and alignment, existing models cannot always guarantee high-quality ...
- research-articleOctober 2024
LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM
- Zicheng Zhang,
- Haoning Wu,
- Yingjie Zhou,
- Chunyi Li,
- Wei Sun,
- Chaofeng Chen,
- Xiongkuo Min,
- Xiaohong Liu,
- Weisi Lin,
- Guangtao Zhai
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 7783–7792https://doi.org/10.1145/3664647.3680946Although large multi-modality models (LMMs) have seen extensive exploration and application in various quality assessment studies, their integration into Point Cloud Quality Assessment (PCQA) remains unexplored. Given LMMs' exceptional performance and ...
-
- research-articleOctober 2024
T2I-Scorer: Quantitative Evaluation on Text-to-Image Generation via Fine-Tuned Large Multi-Modal Models
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 3676–3685https://doi.org/10.1145/3664647.3680939Text-to-image (T2I) generation is a pivotal and core interest within the realm of AI content generation. Amid the swift advancements of both open-source (such as Stable Diffusion) and proprietary (for example, DALLE, MidJourney) T2I models, there is a ...
- research-articleOctober 2024
Subjective-Aligned Dataset and Metric for Text-to-Video Quality Assessment
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 7793–7802https://doi.org/10.1145/3664647.3680868With the rapid development of generative models, AI-Generated Content (AIGC) has exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention. Though many T2V models have been released for ...
- research-articleOctober 2024
Q-Ground: Image Quality Grounding with Large Multi-modality Models
- Chaofeng Chen,
- Sensen Yang,
- Haoning Wu,
- Liang Liao,
- Zicheng Zhang,
- Annan Wang,
- Wenxiu Sun,
- Qiong Yan,
- Weisi Lin
MM '24: Proceedings of the 32nd ACM International Conference on MultimediaPages 486–495https://doi.org/10.1145/3664647.3680575Recent advances of large multi-modality models (LMM) have greatly improved the ability of image quality assessment (IQA) method to evaluate and explain the quality of visual content. However, these advancements are mostly focused on overall quality ...
- ArticleOctober 2024
Towards Open-Ended Visual Quality Comparison
- Haoning Wu,
- Hanwei Zhu,
- Zicheng Zhang,
- Erli Zhang,
- Chaofeng Chen,
- Liang Liao,
- Chunyi Li,
- Annan Wang,
- Wenxiu Sun,
- Qiong Yan,
- Xiaohong Liu,
- Guangtao Zhai,
- Shiqi Wang,
- Weisi Lin
AbstractComparative settings (e.g. pairwise choice, listwise ranking) have been adopted by a wide range of subjective studies for image quality assessment (IQA), as it inherently standardizes the evaluation criteria across different observers and offer ...
- ArticleOctober 2024
Enhancing Diffusion Models with Text-Encoder Reinforcement Learning
AbstractText-to-image diffusion models are typically trained to optimize the log-likelihood objective, which presents challenges in meeting specific requirements for downstream tasks, such as image aesthetics and image-text alignment. Recent research ...
- research-articleAugust 2024
AGIQA-3K: An Open Database for AI-Generated Image Quality Assessment
IEEE Transactions on Circuits and Systems for Video Technology (IEEETCSVT), Volume 34, Issue 8Pages 6833–6846https://doi.org/10.1109/TCSVT.2023.3319020With the rapid advancements of the text-to-image generative model, AI-generated images (AGIs) have been widely applied to entertainment, education, social media, etc. However, considering the large quality variance among different AGIs, there is an urgent ...
- research-articleJuly 2024
Q-ALIGN: teaching LMMs for visual scoring via discrete text-defined levels
- Haoning Wu,
- Zicheng Zhang,
- Weixia Zhang,
- Chaofeng Chen,
- Liang Liao,
- Chunyi Li,
- Yixuan Gao,
- Annan Wang,
- Erli Zhang,
- Wenxiu Sun,
- Qiong Yan,
- Xiongkuo Min,
- Guangtao Zhai,
- Weisi Lin
ICML'24: Proceedings of the 41st International Conference on Machine LearningArticle No.: 2216, Pages 54015–54029The explosion of visual content available online underscores the requirement for an accurate machine assessor to robustly evaluate scores across diverse types of visual contents. While recent studies have demonstrated the exceptional potentials of large ...
- research-articleOctober 2024
Research on the application and practice of curriculum with AI assistance based on students' adaptive learning needs
IECT '24: Proceedings of the 2024 International Conference on Intelligent Education and Computer TechnologyPages 30–34https://doi.org/10.1145/3687311.3687317In the era of continuous development of education from informationization to digital transformation, in order to improve students' learning autonomy in mechanics courses and to solve the problem of resource richness and personalized demand of mechanics ...
- research-articleMay 2024
Is hyperinterpolation efficient in the approximation of singular and oscillatory functions?
Journal of Approximation Theory (JAPT), Volume 299, Issue Chttps://doi.org/10.1016/j.jat.2023.106013AbstractSingular and oscillatory functions play a crucial role in various applications, and their approximation is crucial for solving applied mathematics problems efficiently. Hyperinterpolation is a discrete projection method approximating functions ...
- research-articleMarch 2024
GMS-3DQA: Projection-Based Grid Mini-patch Sampling for 3D Model Quality Assessment
- Zicheng Zhang,
- Wei Sun,
- Haoning Wu,
- Yingjie Zhou,
- Chunyi Li,
- Zijian Chen,
- Xiongkuo Min,
- Guangtao Zhai,
- Weisi Lin
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), Volume 20, Issue 6Article No.: 178, Pages 1–19https://doi.org/10.1145/3643817Nowadays, most three-dimensional model quality assessment (3DQA) methods have been aimed at improving accuracy. However, little attention has been paid to the computational cost and inference time required for practical applications. Model-based 3DQA ...
- research-articleFebruary 2024
Iterative token evaluation and refinement for real-world super-resolution
AAAI'24/IAAI'24/EAAI'24: Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial IntelligenceArticle No.: 113, Pages 1010–1018https://doi.org/10.1609/aaai.v38i2.27861Real-world image super-resolution (RWSR) is a longstanding problem as low-quality (LQ) images often have complex and unidentified degradations. Existing methods such as Generative Adversarial Networks (GANs) or continuous diffusion models present their ...
- research-articleFebruary 2024
Bypassing the quadrature exactness assumption of hyperinterpolation on the sphere
AbstractThis paper focuses on the approximation of continuous functions on the unit sphere by spherical polynomials of degree n via hyperinterpolation. Hyperinterpolation of degree n is a discrete approximation of the L 2-orthogonal projection of the ...
- research-articleJanuary 2024
Blind Video Quality Prediction by Uncovering Human Video Perceptual Representation
IEEE Transactions on Image Processing (TIP), Volume 33Pages 4998–5013https://doi.org/10.1109/TIP.2024.3445738Blind video quality assessment (VQA) has become an increasingly demanding problem in automatically assessing the quality of ever-growing in-the-wild videos. Although efforts have been made to measure temporal distortions, the core to distinguish between ...
- research-articleJanuary 2024
TOPIQ: A Top-Down Approach From Semantics to Distortions for Image Quality Assessment
IEEE Transactions on Image Processing (TIP), Volume 33Pages 2404–2418https://doi.org/10.1109/TIP.2024.3378466Image Quality Assessment (IQA) is a fundamental task in computer vision that has witnessed remarkable progress with deep neural networks. Inspired by the characteristics of the human visual system, existing methods typically use a combination of global ...
- research-articleJanuary 2024
NeRF-SDP: Efficient Generalizable Neural Radiance Field with Scene Depth Perception
MMAsia '23: Proceedings of the 5th ACM International Conference on Multimedia in AsiaArticle No.: 11, Pages 1–7https://doi.org/10.1145/3595916.3626380In recent years, neural radiance fields have exhibited impressive performance in novel view synthesis. However, exploiting complex network structures to achieve generalizable NeRF usually results in inefficient rendering. Existing methods for ...