Activity Based Video Shot Retrieval and Ranking

Most existing web video search engines index videos by file names, URLs, and surrounding texts. These types of video metadata roughly describe the whole video in an abstract level without taking the rich content, such as semantic content descriptions ...

A new shot level video browsing method based on semantic visual features (e.g., car, mountain, and fire) is proposed to facilitate content-based retrieval. The video's binary semantic feature vector is utilized to calculate the score of similarity ...

Image-Text Retrieval (ITR) is essentially a ranking problem. Given a query caption, the goal is to rank candidate images by relevance, from large to small. The current ITR datasets are constructed in a pairwise manner. Image-text pairs are ...

• The paper addresses the image-text retrieval task.
• We integrate listwise ranking into conventional pairwise-based image-text retrieval.
• We propose a RSC module to calculate the relevance scores of the entire ranked list.
• We ...