4.6 Article

Describing UI Screenshots in Natural Language

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Proceedings Paper Computer Science, Interdisciplinary Applications

Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

Xiaoyi Zhang et al.

Summary: This study explores inferring accessibility metadata for mobile apps from pixels, using various models and heuristics, and building a system called Screen Recognition to generate accessibility metadata to enhance the accessibility of mobile apps.

CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (2021)

Article Computer Science, Artificial Intelligence

Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization

Ramprasaath R. Selvaraju et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2020)

Article Ecology

Robustness of linear mixed-effects models to violations of distributional assumptions

Holger Schielzeth et al.

METHODS IN ECOLOGY AND EVOLUTION (2020)

Proceedings Paper Computer Science, Cybernetics

Twitter A11y: A Browser Extension to Make Twitter Images Accessible

Cole Gleason et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Proceedings Paper Computer Science, Cybernetics

Person, Shoes, Tree. Is the Person Naked? What People with Vision Impairments Want in Image Descriptions

Abigale Stangl et al.

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20) (2020)

Article Computer Science, Artificial Intelligence

Explanation in artificial intelligence: Insights from the social sciences

Tim Miller

ARTIFICIAL INTELLIGENCE (2019)

Article Computer Science, Theory & Methods

A Comprehensive Survey of Deep Learning for Image Captioning

Md Zakir Hossain et al.

ACM COMPUTING SURVEYS (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Adversarial Semantic Alignment for Improved Image Captions

Pierre Dognin et al.

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) (2019)

Proceedings Paper Computer Science, Theory & Methods

X-Ray: Screenshot Accessibility via Embedded Metadata

Sujeath Pareddy et al.

ASSETS'19: THE 21ST INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY (2019)

Article Computer Science, Artificial Intelligence

Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation

Albert Gatt et al.

JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH (2018)

Article Computer Science, Information Systems

Automatic image annotation: the quirks and what works

Ayushi Dutta et al.

MULTIMEDIA TOOLS AND APPLICATIONS (2018)

Article Computer Science, Information Systems

Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)

Amina Adadi et al.

IEEE ACCESS (2018)

Proceedings Paper Computer Science, Software Engineering

Learning Design Semantics for Mobile Apps

Thomas F. Liu et al.

UIST 2018: PROCEEDINGS OF THE 31ST ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY (2018)

Article Computer Science, Artificial Intelligence

Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models

Bryan A. Plummer et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2017)

Article Computer Science, Artificial Intelligence

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

Ranjay Krishna et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2017)

Proceedings Paper Computer Science, Artificial Intelligence

Help, It Looks Confusing: GUI Task Automation Through Demonstration and Follow-up Questions

Thanapong Intharah et al.

IUI'17: PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (2017)

Proceedings Paper Computer Science, Software Engineering

Rico: A Mobile App Dataset for Building Data-Driven Design Applications

Biplab Deka et al.

UIST'17: PROCEEDINGS OF THE 30TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY (2017)

Proceedings Paper Computer Science, Artificial Intelligence

With most of it being pictures now, I rarely use it: Understanding Twitter's Evolving Accessibility to Blind Users

Meredith Ringel Morris et al.

34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016 (2016)

Proceedings Paper Computer Science, Artificial Intelligence

Rich Image Captioning in the Wild

Kenneth Tran et al.

PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016) (2016)

Article Computer Science, Interdisciplinary Applications

Guiding Novice Web Workers in Making Image Descriptions Using Templates

Valerie S. Morash et al.

ACM TRANSACTIONS ON ACCESSIBLE COMPUTING (2015)

Article Physics, Fluids & Plasmas

Estimating mutual information -: art. no. 066138

A Kraskov et al.

PHYSICAL REVIEW E (2004)