Progress in computer vision algorithms is strongly driven by datasets and benchmarks. The latter are annual events in which the latest algorithms compete against each other. One of the most impactful one to date is the ImageNet challenge. Here, participants compete in any of three categories:
Given an image of an object, figure out what that object is.
Find where the object is in the image and draw a bounding box around it.
Find all of the objects in the image, draw a bounding box around each object, and classify each of them.
Of course the above tasks often require drawing bounding boxes around objects. It may be important to find the shape of the image as well.
Find where each object is in an image and within the bounding box, classify each pixel that belongs to the object.
Given an image, classify each pixel into different classes. These classes could include sky or background.
Combination of instance and semantic segmentation.