Recovering layers of brush strokes through statistical analysis of color and shape: an application to van Gogh's "Self portrait with grey felt hat"

Morteza Shahram; David G. Stork; David Donoho

doi:10.1117/12.765773

19 March 2008 Recovering layers of brush strokes through statistical analysis of color and shape: an application to van Gogh's Self portrait with grey felt hat

Morteza Shahram, David G. Stork, David Donoho

Author Affiliations +

Proceedings Volume 6810, Computer Image Analysis in the Study of Art; 68100D (2008) https://doi.org/10.1117/12.765773
Event: Electronic Imaging, 2008, San Jose, California, United States

Abstract

We used digital image processing and statistical clustering algorithms to segment and classify brush strokes in master paintings based on two-dimensional space and three-dimensional chromaticity coordinates. For works executed in sparse overlapping brush strokes our algorithm identifies candidate clusters of brush strokes of the top (most visible) layer and digitally removes them. Then, it applies modified inpainting algorithms based on statistical structure of strokes to fill in or "inpaint" the remaining, partially hidden brush strokes. This processes can be iterated, to reveal and fill in successively deeper (partially hidden) layers of brush strokes-a process we call "de-picting." Of course, the reconstruction of strokes at each successively deeper layer is based on less and less image data from the painting and requires cascading estimates and inpainting; as such our methods yield poorer accuracy and fidelity for such deeper layers. Our current software is semi-automatic; the operator such as a curator or art historian guides certain steps. Future versions of our software will be fully automatic, and estimate more accurate statistical models of the brush strokes in the target painting yield better estimates of hidden brush strokes. Our software tools may aid art scholars in characterizing the images of paintings as well as the working methods of some master painters.

Citation Download Citation

Morteza Shahram, David G. Stork, and David Donoho "Recovering layers of brush strokes through statistical analysis of color and shape: an application to van Gogh's Self portrait with grey felt hat", Proc. SPIE 6810, Computer Image Analysis in the Study of Art, 68100D (19 March 2008); https://doi.org/10.1117/12.765773

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available