History

« Previous - Version 20/50 (diff) - Next » - Current version
Gary Bradski, 2015-11-24 07:05 pm

Ideas Page for OpenCV Google Summer of Code 2015 (GSoC 2015)

STILL UNDER CONSTRUCTION ...

OpenCV 3D recognition and pose from last year.

General Information:

  • Next important dates:
    • Feb 20 19:00 UTC: Organization Application Deadline. DONE!
    • Mar 02 19:00 UTC: List of accepted Organizations.
    • Mar 16 16:00 UTC: Student Application period begins!
    • Mar 27 19:00 UTC: Student Application period ends!
    • Apr 13 Deadline for OpenCV to request # of slots.
    • Apr 15 Google publishes how many slots we get.
    • Apr 21 Try to eliminate duplication of students.
    • Apr 24 IRC for OpenCV to resolve all duplications.
    • Apr 27 19:00 UTC: Accepted students announced.
    • May 25 Let Coding begin!
    • Jun 26 19:00 UTC: Mid term evaluation begins.
    • Jul 03 19:00 UTC: Mid term end.
    • Aug 21 19:00 UTC: Coding stop; Pull requests must be in; Mentors: final evaluation begins...
    • Aug 28 19:00 UTC: Final evaluation deadline; Students begin submitting code.
    • Sept 25 19:00 UTC: Deadline for Google Code submission
    • Oct 24-25: Mentor Summit!
Times:
  • UTC to PDT (Pacific Daylight Time == Daylight savings time. In winter it's PST).

Resources:

For students or mentors interested in applying

\/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/

2015 Project Ideas:

Students may propose their own projects (give us a clear summary and why you can do this project). However, below are some of our priorities for this year Contact us and/or discuss ideas at https://groups.google.com/forum/?fromgroups#!forum/opencv-gsoc-2015

These are not in order of priority

1 Google Cardboard
  • Do visual odometry, SLAM etc for Google Cardboard
2 Projection mapping (Projected Augmented Reality)
  • Calibrate a camera to a projector
  • Put out structured light to learn the 3D map of what's in front of the camera
  • Project the camera image, suitably rotated and shifted onto the scene
  • Unity or some other program to start transforming the scene for projection mapping
3 Update OpenCV file storage so that it's readable by Python in OpenCV (move to YAML 1.2 Edition 3) 4 Stereo correspondence improvements
  • More accurate and faster stereo correspondence (StereoBM/StereoSGBM) by using LBP/BRIEF/DAISY etc. per-pixel descriptors instead of sum-of-absolute-differences.
5 Self-contained video codec(s)
  • There is draft version of self-contained motion jpeg encoder to be integrated to OpenCV.
  • We will also need decoder, 12-bit jpeg support, multi-threaded encoder and decoder.
  • There are some other codecs, like libvpx, which we can support and link right into highgui, without dependency from ffmpeg/libav.
6 Deep learning
  • It would be cool if OpenCV could load and run deep networks trained with popular DNN packages like Caffe, Theano or Torch.
  • GPU/OpenCL optimization and/or other optimizations (that can partly be contributed back to the upstream projects) are also encouraged.
7 Better interactive camera calibration
  • Modern algorithms would allow us to recompute camera parameters after almost each frame, compute reprojection error, compute confidence intervals for the parameters.
  • the partially occluded calibration patterns could be handled somehow to, especially if we want to estimate intrinsic parameters only.
  • the application may show us the areas where the corner borders have been shown so that user can see how good are the data
8 Create a much better calibration target, we will call it "Charuco
  • We know how to combine Aruco targets with checker boards to create a "super calibration" object
  • It also can express ~1 billion distinct codes
  • Implement this for OpenCV
9 Color Calibration and white balance
  • With McBeth chart and with gray world algorithm (improve exisiting color constancy algorithms)
  • Possibly collect deep learning way of doing this (needs large training set)
10 Tracking improvements
  • TLD algorithm is implemented in OpenCV, but it needs improvements and optimizations.
  • ASM/AAM can also be implemented, as well as the particle filter.
11 Realtime image preprocessing algorithms
  • We and many other OpenCV users would definitely enjoy very fast denoising, color improvements, white balance etc. algorithms.
12 PBM (part-based models) improvements
  • There is latentsvm package in opencv_contrib that needs to be improved (quality-wise and speed-wise).
  • Adding training, even if it involves execution of external svmperf or other tool, is definitely appreciated too.
13 Improving ICF/ACF + <some>Boost training and detection
  • In opencv_contrib there is initial version of the training application and detector based on integral channel features and boosting. Further improvements of this part would be really useful.
14 numl+OpenCV, lua+OpenCV
  • there is emerging numl language, suitable for implementation of complex computationally-intensive algorithms. OpenCV bindings for this language would be really useful.
  • the other language that is now used more often for ML and CV (thanks to Torch) is Lua; there are old bindings for a tiny part of OpenCV; could be useful to extend our autogenerated bindings to Lua.
15 human interaction
  • gesture recognition
  • human skeleton based on 2d or 3d (latest paper on that ?)
16 SfM
  • update libmv to OpenMVG and get the 3d viz from OpenCV
/\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\ /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\

Accepted Projects for OpenCV GSoC 2015:

OpenCV GSoC 2015 students, projects, mentors are below. WHEN THEY ARE KNOWN

Student                 Project                                           Mentor(s)
=======                 =======                                           ========

Project notes will be compiled here .

Mentors

Actual signed up mentors

  • Alexander Mordvintsev zzznah(+)gmail.com
  • Sid Bao ybao(+)magicleap.com
  • Vincent Rabaud vincent.rabaud(+)gmail.com
  • Vadim Pisarevsky vadim.pisarevsky(+)gmail.com
  • Adrian Kaehler therealadrian(+)gmail.com
  • Terry Boult tboult(+)vast.uccs.edu
  • spmallick spmallick(+)taaz.com
  • Serge Belongie sjb344(+)cornell.edu
  • Stefano s.fabri10(+)gmail.com
  • Prasanna pras.bits(+)gmail.com
  • Pablo Alcantarilla pablofdezalc(+)gmail.com
  • Bence Magyar mw.mzperx(+)gmail.com
  • Manuele manuele.tamburrano(+)gmail.com
  • Grace Vesom grace.vesom(+)gmail.com
  • Open Source Computer Vision Library (OpenCV) garybradski(+)gmail.com
  • Douglas Lee dougabug(+)gmail.com
  • Claudia Rapuano c.rapuano(+)gmail.com
  • Antonella Cascitelli antonellacascitelli(+)gmail.com
  • Anatoly Baksheev anatoly.baksheev(+)itseez.com
  • Alexander alexander.shishkov(+)itseez.com
  • Alexander Smorkalov alexander.smorkalov(+)itseez.com
  • Alexander Bovyrin alexander.bovyrin(+)itseez.com

In the below, get rid of the ''-delete-'' to make the emails work.

Anatoly Baksheev
 Researcher, Vision Algorithms on GPU
 Argus/Itseez
   
Alexander Bovyrin
  PhD, Senior Researcher
  Argus/Itseez founder
  NNU Lecturer
  
Gary Bradski
 Founder, Industrial Perception Inc.
 Consulting Prof. Stanford U.
 OpenCV Founder, Technical Content Owner, GSoC Admin
 Co-author of Learning OpenCV Book
 http://www.willowgarage.com/pages/people/gary-bradski-senior-researcher
 
Antonella Cascitelli
 Grad student, University of Rome
 
Eric Christiansen
 PhD, UCSD
 
Stefano Fabri
 CRR Team leader, University of Rome
 
Victor Eruhimov
 OpenCV founding team/Senior Researcher
 Argus/Itseez founder
 NNU Lecturer
 
Adrian Kaehler
 Principle Engineer, Applied Minds
 Co-author of Learning OpenCV Book.
 
Peter Karasev
 PhD Student, MINERVA Research Group
 Georgia Tech
 
Vadim Pisarevsky
 OpenCV founding team/Czar
 
Manuele Tamburrano
 Grad Student, University of Rome
 
Vincent Rabaud
 Principle Engineer, Aldebaran Robotics
 
Claudia Rapuano
  Grad student, University of Rome
  
Grace Vesom
 Lawrence Livermore 
 -delete-grace.vesom@-delete_gmail.com
Bence Magyar
 Pal Robotics
 
Pablo Alcantarilla
 Toshiba Research Europe Ltd.

Back up Mentors

Mark Asbach
 Fraunhofer IAIS
 Schloss Birlinghoven
 Sankt Augustin, Germany
 http://mmprec.iais.fraunhofer.de/asbach.html
 
Nicolas Saunier, Ph.D.
 Assistant Professor
 Civil, Geological and Mining Department (CGM)
 École Polytechnique de Montréal
 http://nicolas.saunier.confins.net
 
Alexander Mordvintsev
 Software Engineer
 http://znah.net
 
Andrey Morozov
 Software Engineer
 Argus/Itseez

OpenCV Org. Application to GSoC 2015

OpenCV GSoC Application

Previous Years

3D_recog.jpg (91.8 kB) Gary Bradski, 2015-02-11 09:57 am