h1. GSoC2013OpenCVApplication

h3. Org ID?

OpenCV

h3. Org name?

Open Source Computer Vision Library (OpenCV)

h3. Description?

The Open Source Computer Vision Library (OpenCV) is a comprehensive computer vision library and machine learning (over 2500 functions) written in C++ and C with additional Python and Java interfaces. It officially supports Linux, Mac OS, Windows, Android and iOS. OpenCV has specific optimizations for SSE instructions, CUDA and especially Tegra. 

OpenCV is now supported by a non-profit organization: OpenCV.org. It has an active user group of 55 thousand members and over 6M downloads. OpenCV has uses from gesture recognition, Android and iPhone vision apps on up to medical, robotics, mine safety and Google Streetview.

h3. URL?

http://opencv.org/

h3. License?

New and Simplified BSD

h3. Backup Admin?

Vadim.Pisarevsky

h3. Ideas Page?

http://code.opencv.org/projects/gsoc2013/wiki

h3. IRC channel?

<pre>

#opencv on freenode

</pre>

h3. Mailing list?

http://tech.groups.yahoo.com/group/OpenCV/

h3. Why participate?

OpenCV has several full time contractors working on robotic applications and another paid group working on CUDA. However, the scope of the library is much larger and GSoC interns were invaluable last year in addressing other critical areas:

* getting a solid port of OpenCV to iOS, 

* developing a QT based graphical interface, the old GUI was decidedly limited and stale

* creating an automatic interface to PASCAL VOC http://pascallin.ecs.soton.ac.uk/challenges/VOC/ (the main computer vision object recognition challenge) 

* coding up a long time winning classifier in PASCAL VOC: Latent SVM

* features and support for feature tracking

* A set of tutorials

* A set of python examples

All the above things were out of scope of the paid work and had substantial impact on OpenCV, especially making it work with Mobile. In addition, 3 of the interns are now regular contributors. 2 more are occasional contributors.

Thus, why we are applying: We want to bring in a new generation of contributors and also to fill out areas where to don't have active development. We hope to gain pretty much a repeat of last year: Filling out new areas, perhaps co-authoring new papers and getting new regular contributors.

h3. Past summer of code, If so, challenges?

VETERAN HISTORY:

OpenCV (C++) has been involved in GSoC for 3 years now. It has been an amazing help to us. It generated our ports to Android, IOS and initialized our Python and Java interfaces.  It has vastly improved our sample code base and added some very key algorithms such as image denoising, image stitching and camera stabilization. A very popular addition (I use it every time I code) is a QT backend for viewing images. This came from GSOC 2010, Yannick Verdie.

GSOC 12 HIGHLIGHTS:

An offical iOS port was added to OpenCV. Eduard Feicho and Charu Hans improved the port and created detailed tutorials on how to add OpenCV to an iOS app 

http://docs.opencv.org/doc/tutorials/ios/table_of_content_ios/table_of_content_ios.html

They made a cool tutorial for it:

gsoc2012:source:/ios/trunk/doc/CVPR2012_OpenCV4IOS_Tutorial.pdf

Python was a big success for '12. The interface was improved and the student, Alexander Mordvintsev, wrote several key code examples

https://github.com/Itseez/opencv/tree/master/samples/python2 

OpenCV has a lot of machine learning algorithms. Many people want to use these "out of the box", so in the course of working on new feature types for our cascade classifier, Attila Novak, pre-trained it on two new classes.  The algorithm is extensively used for frontal face, he added profile faces. And, silverware detectors (for a robot project): 

https://github.com/Itseez/opencv/tree/master/data/lbpcascades

People have been asking for better computational photography support. Victor Passichenko  implemented a non-local means denoising algorithm 

http://docs.opencv.org/trunk/modules/photo/doc/denoising.html

For movie effects and VR, we've been wanting a dense optical flow algorithm for a long time. Yuri Zemlyansky implemented "simple flow" (it's not so simple, but it is dense -- assigns motion vectors to every point in a reasonable way).

https://github.com/Itseez/opencv/tree/master/samples/cpp/simpleflow_demo.cpp

OpenCV has been dying for SLAM and SfM (basically 3D reconstruction code) for years. It's a hard project to get right, it's not in yet, but Srimalj made good progress and we'll probably combine this with Google's own libmv this year.

Finally, no one student, but we kicked off a tutorial section 2 years ago and many students have contributed since. We'd now like each student to end their work with a tutorial example of how to use what they coded ... which ensures that it actually does get used.  Tutorials have grown quite a bit and past students have continued to add tutorials:

http://docs.opencv.org/doc/tutorials/tutorials.html 

PASS/FAIL RATES

We were allocated 12 students, 10 passed. 

The failures were in: Active Appearance Models, and Fast Linear Program Solver.  Our library is computer vision and machine learning. Many things border on active research, many algorithms have complex mathematical underpinnings. Some students look capable of performing these tasks "on paper" and with code samples but simply aren't. 

Mentors try to help but sometimes the student just stops responding. Sometimes we suspect they have multiple jobs and may just be overwhelmed or have other priorities. We often have the best results from people who are pushing code at us well before the start and/or whose thesis area covers what we want implemented. We'll try to vet more closely based on these criteria, but we always seem to get about this rate of fall off.  

h3. Ideas page?

We have a page at http://code.opencv.org/projects/gsoc2013/wiki

+*Summary:*+

*Contact info:*

* Please provide:

** Your name

** A phone number

** An email address where we can reach you for daily communication.

*** If you have a website that discusses your research, work and/or coding, let us know.

*Requirements:*

* We are looking for people who have strong programming backgrounds, there is no time to "learn on the job".  

** Most of the positions will require advanced ability and experience in *C++* and/or *Python*. 

*** Exception might be for help working on the website itself

** Most of the projects require knowledge of computer vision techniques. If so, your application will not be accepted if you don't have such experience. These will be stated on the projects ideas page. 

Again, you must meet the requirements -- it is not enough to "want" to work on computer vision, we have limited time and so we need people who already have the necessary background. If you lack this background, spend the next year getting the background and apply then, we intend to be back for GSoC 2013.

Students will be expected to ''meet'' with their mentors by email, skype or google chat once a week and to twitter at least 2x/day on their current coding activities

*Sample Code:*

** With your application: *Please send in some sample code that you are proud of and are prepared to answer questions on.*

** If you have other useful skills such as experience with code optimization, or knowledge of SSE, MMX, CUDA or especially development experience on Android or iPhone let us know.

*Courses Taken:*

List the courses that you have taken in:

** Math

** Computer programming, especially:

** Programming languages

** Data structures

** Web programming

** Data base

** Computer vision

** Engineering

h2. Work Experience 

* List any work experience that you've had in 

** software development and/or in 

** computer vision.

*Open Source Experience:*

* If you have already contributed to other open source projects, please tell us what it was and when you did this.

*Which project you are interested in and and why you want to do it:*

* Please tell us which of the project ideas you are interested and why you want to work on that one.

* If you have your __own idea__, please describe it clearly and provide a timeline of progress towards that goal.

*References:*

* Please list 2 or 3 academic or programming work references.

h3. Mentor selection criterion?

# All mentors but one are known developers of OpenCV. The one who is not is a Professor of Computer Vision.

# All mentors have extensive computer vision and coding background.

# All mentors are people who have interns or students to manage every year, either in companies, academic settings or research groups.

h3. Disappearing students?

* We will try to prevent this by having mentors keep regular contact via skype meetings 1/week, twitter and email, but if it happens:

* We will post the orphaned project to our user group and offer a some of the mentor compensation (~$200) to someone who completes the project.

h3. What is your plan for dealing with disappearing mentors?

* First, this isn't expected since we only use mentors well known and trusted by the admin.

* We have 2 backup mentors who are on call to step in.

* Worst case, the admins will pick up the slack.

h3. Steps for interaction?

These techniques were used in 2010, 2011 and 2012 and worked well, so we'll use them again:

* Before the project, we will encourage them to post a detailed project plan to the user group (also socially committing them to complete).

* We will set up a 2x daily twitter feed for all the summer's development projects.

* Project results will go up on a youtube channel that will be posted to the large user group. This should provide a large amount of feedback.

* We hope to set up projects with 3 goals: Quick and turn around (within a few weeks they should have a baseline accomplishment), this will be followed by the main, reasonable summer goal, but there will also be a more comprehensive "stretch goal" that we will encourage them to complete, getting feedback and feature requests from the community.

* For the more advanced projects, we may write a paper with the students (we have an ICCV submission with one GSoC student from last year)

The best students may become interns at mentor's work places (which has happened 4 times now).

h3. New organization with someone to vouch for us?

No, we're an established org, 2010 and 2011.  Still, talk to Jean-Yves Bouguet "Jean-Yves Bouguet" <jyb atthat google>,  in the streetview group for a view.  Or talk to Sebastian Thrun "Sebastian Thrun" <thrun atthat google>, head of GoogleX who knows me (Gary Bradski) well. 

h3. Vouch for younger orgs?

None that I know of. We make extensive use of Eigen, ffmpeg, and numpy.

----

[[Gsoc2013|Back]]