Information Maximizing Visual Question Generation

Example questions generated for a set of images and answer categories. Incorrect questions are shown in grey and occur when no relevant question van be generated for a given image and answer category Authors Ranjay Krishna, Michael Bernstein, Li Fei-Fei Abstract Though image-to-sequence generation models have become overwhelmingly popular in human-computer communications, they suffer from

Read More

A Glimpse Far into the Future: Understanding Long-term Crowd Worker Accuracy

A selection of individual workers’ accuracy over time during the question answering task. Each worker remains relatively constant throughout his or her entire lifetime. Authors Kenji Hata, Ranjay Krishna, Li Fei-Fei, Michael Bernstein Abstract Microtask crowdsourcing is increasingly critical to the creation of extremely large datasets. As a result, crowd workers spend weeks or months

Read More

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

An overview of the data needed to move from perceptual awareness to cognitive understanding of images. We present a dataset of images densely annotated with numerous region descriptions, objects, attributes, and relationships. Region descriptions (e.g. “girl feeding large elephant” and “a man taking a picture behind girl”) are shown (top). The objects (e.g. elephant), attributes

Read More

Generating Semantically Precise Scene Graphs from Textual Descriptions for Improved Image Retrieval

Actual results using a popular image search engine (top row) and ideal results (bottom row) for the query a boy wearing a t-shirt with a plane on it. Authors Sebastian Schuster, Ranjay Krishna, Angel Chang, Li Fei-Fei and Christopher D. Manning Abstract Semantically complex queries which include attributes of objects and relations between objects still

Read More

Image Retrieval using Scene Graphs

Image search using a complex query like “man holding fish and wearing hat on white boat” returns unsatisfactory results in (a). Ideal results (b) include correct objects (“man”, “boat”), attributes (“boat is white”) and relationships (“man on boat”). Authors Justin Johnson, Ranjay Krishna, Michael Stark, Li-Jia Li, David Ayman Shamma, Michael Bernstein, Li Fei-Fei Abstract

Read More

Editorial Algorithms: Using Social Media to Discover and Report Local News

Screenshot of CityBeat interface showing the Detected Events List, Event Window and the Statistics Sidebar Authors Schwartz, R., Naaman M., Teodoro R. Abstract The role of algorithms in the detection, curation and broadcast of news is becoming increasingly prevalent. To better understand this role we developed CityBeat, a system that implements what we call “editorial algorithms”

Read More

CityBeat: Real-time Social Media Visualization of Hyper-local City Data

Authors Xia C., Schwartz, R., Xie K., Krebs A., Langdon A., Ting J. and Naaman M. Abstract With the increasing volume of location-annotated content from various social media platforms like Twitter, Instagram and Foursquare, we now have real-time access to people’s daily documentation of local activities, interests and attention. In this demo paper, we presentCityBeat1,

Read MoreRead More