SoSe 2015

Textursynthese Seminar

Instructors: Ph. D. Chuan Li; Univ.-Prof. Dr. Michael Wand
Shortname: 08.079.642
Course No.: 08.079.642
Course Type: Seminar

Requirements / organisational issues

Target group

  1. Advanced bachelor students (having taken the basic/mandatory lectures already) and master students.

Prerequisites

  1. Basic courses in computer science of the first two years (EiP, EiS, ADS, Math lectures,...) or similar background from other sources. Knowledge in Computer Graphics or Machine Learning is very useful, but not strictly required (plan for some extra time if you do not know about computer graphics yet).


The seminar addresses the topic of texture synthesis: the automatic creation of images by statistical techniques. Texture synthesis techniques have become quite popular recently for a number of applications, such as texturing of 2D and 3D objects based on small examples, semi-automatic retouch of photographs, or even the automatic creation of complex images and 3D models from example data. Much of the facination of this technique is due to the rather simple formal framework (and often really simple algorithms) that are able to create amazing results.

The seminar will discuss the theoretical foundations as well as practical implementations of different variants of texture synthesis, ranging from classical results to recent research papers.

By participating in the seminar, you can learn at least three different things:

  1. An introduction to the theory of non-parametric texture- and geometry synthesis, which is an important current research area.
  2. Gain experience in reading and understanding current research literature.
  3. Practice presentation of scientific topics.

Each participant has to:

  1. Give a talk based on one topic. The focus should be on presenting the major concepts and ideas rather than enumerating details. Each talk should take about 35 minutes (+ 5min Question/Answer).
  2. You are expected to cover ALL papers listed under the topic. Remember NOT to loose your focus and NOT to run over your time.
  3. Be prepared to give feedback on other people's talks -- it is a very important part of the seminar.
  4. Discuss your topic with the assistant at the very beginning of your preparation.
  5. Reharsal your talk with the assistant at least two weeks before the presentation.

The practical (Texture Synthesis Lab) will be held during the semester break (August/September). Sign up now and you will gain practical experience in this area by implementing algorithms for making cool pictures!

Recommended reading list

Topic 1 – Introduction of Texture Synthesis

  1. Efros A. A., Leung T. K., Texture synthesis by non-parametric sampling. In: Proc. ICCV 1999
  2. Wei L.-Y., Levoy M., Fast texture synthesis using tree-structured vector quantization. In: Proc. SIGGRAPH 2000

Topic 2 – Better Coherence

  1. Kwatra V., Essa I., Bobick A., Kwatra N., Texture optimization for example-based synthesis. In: Proc. SIGGRAPH 2005
  2. Matusik W., Zwicker M., Durand F., Texture Design Using a Simplicial Complex of Morphable Textures. In: Proc. SIGGRAPH 2005.

Topic 3 – Image Stitching

  1. Kwatra V., Schödl A., Essa I., Turk G., Bobick A., Graphcut textures: image and video synthesis using graph cuts. In: Proc. SIGGRAPH 2003.
  2. Pritch Y., Kav-Venaki E., and Peleg S., Shift-Map Image Editing, In: Proc. ICCV 2009.

Topic 4 – Real Time Texture Synthesis

  1. Cohen M. F., Shade J., Hiller S., Deussen O., Wang tiles for image and texture generation. In: Proc. SIGGRAPH 2003.
  2. Barnes C., Shechtman E., Finkelstein A., Goldman D., PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing. In: Proc. SIGGRAPH 2009.

Topic 5 – User Guidance

  1. Hertzmann A., Jacobs C. E., Oliver N., Curless B.,Salesin D. H., Image analogies. In: Proc. SIGGRAPH 2001
  2. Agarwala A., Dontcheva M., Agrawala M., Drucker S., Colburn A., Curless B., Salesin D., and Cohen M., Interactive Digital Photomontage. In: Proc: SIGGRAPH 2004.

Topic 6 – Inverse Texture Synthesis

  1. Wei L., Han J., Zhou K., Bao H., Guo, B., Shum H., Inverse texture synthesis. In: Proc. SIGGRAPH 2008
  2. Simakov D., Caspi Y., Shechtman E., Irani M., Summarizing Visual Data Using Bidirectional Similarity. In: Proc. CVPR 2008.

Topic 7 – Structure Awareness

  1. Liu Y., Lin W.C., Hays J., Near-regular texture analysis and manipulation, In: Proc. SIGGRAPH 2004.
  2. Sun J., Yuan L., Jia J., Shum H.-Y., Image completion with structure propagation. In: Proc. SIGGRAPH 2005.

Topic 8 – Image Statistics

  1. He K. and Sun J., Statistics of Patch Offsets for Image Completion, In: Proc. ECCV 2012.
  2. Zhang Y., Xiao J., Hays J., Tan P., FrameBreak: Dramatic Image Extrapolation by Guided Shift-Maps, In: Proc. CVPR 2013.

Topic 9 – Millions of Images

  1. Hays J., Efros A. A., Scene completion using millions of photographs. In: Proc. SIGGRAPH 2007.
  2. Chen T., Cheng M.M., Tan P., Shamir A., Hu S.M., Sketch2Photo: Internet Image Montage. In: Proc. SIGGRAPH ASIA 2009.

Topic 10 – Texture on 3D Surface

  1. Turk G., Texture synthesis on surfaces. In: Proc. SIGGRAPH 2001.
  2. Bhat P., Ingram S., Turk G., Geometric texture synthesis by example. In: Proc. SGP 2004.

Topic 11 – Video Textures 

  1. Schödl A., Szeliski R., Salesin D., and Essa I., Video textures. In: Proc. SIGGRAPH 2000,
  2. Agarwala A., Zheng C., Pal C., Agrawala M., Cohen M., Curless B., Salesin D., Szelisk, D., Panoramic video textures. In: Proc. SIGGRAPH 2005.

Topic 12 – Shape Synthesis 

  1. Bokeloh M., Wand M., Seidel H.-P., A Connection between Partial Symmetry and Inverse Procedural Modeling. In: Proc. SIGGRAPH 2010.

Contents

See the course webpage for details.

Dates

Date (Day of the week) Time Location
04/22/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
04/29/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
05/06/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
05/13/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
05/20/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
05/27/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
06/03/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
06/10/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
06/17/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
06/24/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
07/01/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
07/08/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
07/15/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik
07/22/2015 (Wednesday) 14:00 - 16:00 04 426
2413 - Neubau Physik/Mathematik