Testing through images
This section covers image-based testing, which is different from what has been covered so far. In image-based testing, the user interface is treated as a black box and no object internals of the applications are exposed.
Sikuli
Sikuli is a leading tool that performs automation through computer vision, that is, recognition of images on the screen. As a human being, we can distinguish an object's properties by looking at it, but this is not straightforward in case of computers as computers can only match binary or textual information. Thus, there is a need for computer vision or knowing if a given image is present on a larger screen or not. In simple sense, Sikuli uses the user-supplied screenshot images to perform action over various items and displays the generated script visually in the Sikuli IDE. Following is one such script to do a search:
As is evident from the image, the script does the following:
Check if the Chrome browser icon exists on the screen
Click on the...
