[Back]

C. Herzog, I. Kordomatis, W. Holzinger, R. Fayzrakhmanov, B. Krüpl-Sypien:
"Feature-based object identification for web automation";
in: "Proceedings of the 28th Annual ACM Symposium on Applied Computing", D. Shin (ed.); ACM, 2013, ISBN: 978-1-4503-1656-9, 742 - 749.

In this paper, we address automatic identification of common functional structures on web pages, a fundamental problem for web automation applications and graphical user interface testing. In contrast to other approaches, we aim to identify relevant patterns without relying on the source code of a web page or keywords, utilizing mostly geometrical and visually perceptible properties. We achieve this by transforming pages into an independent geometrical representation, on top of which we extract a set of features that allows us to employ traditional machine learning techniques for the identification task. We evaluate this approach by analyzing three typical scenarios, reviewing the obtained information retrieval key metrics and estimating the relevance of the chosen features. Our initial results demonstrate the feasibility of the proposed approach.

web object identi cation; web automation; web accessibility; machine learning; web page visual representation

http://dx.doi.org/10.1145/2480362.2480504

http://dl.acm.org/citation.cfm?id=2480504

Project Head Reinhard Pichler:
TASK MINING from CROWD BEHAVIOUR