Where to Buy It:
Matching Street Clothing Photos in Online Shops

M. Hadi Kiapour, Xufeng Han, Svetlana Lazebnik, Alexander C. Berg, Tamara L. Berg

Abstract

In this paper, we tackle a new task, Exact Street to Shop, where our goal is to match a real-world example of a garment item to the same item in an online shop. This is an extremely challenging task due to visual differences between street photos, pictures of people wearing clothing in everyday uncontrolled settings, and online shop photos pictured on people, mannequins, or in isolation, captured by professionals. We introduce a novel dataset for this application and develop deep learning approches to this retrieval problem.

Publication

M. Hadi Kiapour, Xufeng Han, Svetlana Lazebnik, Alexander C. Berg, Tamara L. Berg. Where to Buy It:Matching Street Clothing Photos in Online Shops. In International Conference on Computer Vision (2015). [Paper] [Poster]

BibTeX

@inproceedings{
            WhereToBuyItICCV15,
            title     = {Where to Buy It:Matching Street Clothing Photos in Online Shops}
            author    = {M. Hadi Kiapour, Xufeng Han, Svetlana Lazebnik, Alexander C. Berg, Tamara L. Berg},
            booktitle = {International Conference on Computer Vision},
            year      = {2015}
            }
            

Exact Street2Shop Dataset

Download

File Size Description
Photos 36 Mb Contains urls for street and shop photos.
Meta 3 Mb Contains meta data for street2shop pairs, products and retrieval sets.
README.txt

Contact

M. Hadi Kiapour (hadi -at- cs.unc.edu) Tamara Berg (tlberg -at- cs.unc.edu)