Region segmentation of content displayed on a computing device based on the pixels of the screenshot image that captured the content

摘要

To a method and apparatus for partitioning content displayed on a computing device into regions to facilitate user interaction with graphics content. Dividing the content displayed on the computing device into regions is accomplished through the analysis of pixels of a " screenshot image " that captures at least a portion (e.g., all) of the displayed graphical content. Individual pixels of the screenshot image may be analyzed to determine one or more regions of the screenshot image, and optionally to assign corresponding semantic types to each region. Some embodiments are directed to generating interactive content that provides a presentation to a user via a computing device, based on one or more areas.