GSoC2012OpenCVApplication
Version 2 (Gary Bradski, 2012-03-07 02:36 am) → Version 3/6 (Gary Bradski, 2012-03-07 02:36 am)
h1. GSoC2012OpenCVApplication
h3. Org ID
OpenCV
h3. Org name
Open Source Computer Vision Library (OpenCV)
h3. Description
The Open Source Computer Vision Library (OpenCV) is a comprehensive computer vision library and machine learning (over 2500 functions) written in C++ and C with additional Python and Java interfaces. It officially supports Linux, Mac OS, Windows, Android and iOS. OpenCV has specific optimizations for SSE instructions, CUDA and especially Tegra. There is an active user group of 50 thousand members and download are approaching > 4M. OpenCV has uses from gesture recognition, Android and iPhone vision apps on up to medical, robotics, mine safety and Google Streetview.
h3. URL
http://opencv.willowgarage.com/wiki
h3. License
New and Simplified BSD
h3. Backup Admin
Vadim.Pisarevsky
h3. Ideas Page
http://code.opencv.org/projects/gsoc2012/wiki/Gsoc2012
h3. IRC channel
<pre>
#opencv on freenode
</pre>
h3. Mailing list
http://tech.groups.yahoo.com/group/OpenCV/
h3. Why participate
OpenCV has several full time contractors working on robotic applications and another paid group working on CUDA. However, the scope of the library is much larger and GSoC interns were invaluable last year in addressing other critical areas:
* getting a solid port of OpenCV to iOS,
* developing a QT based graphical interface, the old GUI was decidedly limited and stale
* creating an automatic interface to PASCAL VOC http://pascallin.ecs.soton.ac.uk/challenges/VOC/ (the main computer vision object recognition challenge)
* coding up a long time winning classifier in PASCAL VOC: Latent SVM
* features and support for feature tracking
* A set of tutorials
* A set of python examples
All the above things were out of scope of the paid work and had substantial impact on OpenCV, especially making it work with Mobile. In addition, 3 of the interns are now regular contributors. 2 more are occasional contributors.
Thus, why we are applying: We want to bring in a new generation of contributors and also to fill out areas where to don't have active development. We hope to gain pretty much a repeat of last year: Filling out new areas, perhaps co-authoring new papers and getting new regular contributors.
h3. Past summer of code, If so, challenges
We participated in 2010 and 2011.
There were 12 interns total, 8 worked out. As a side note, I have now permanently hired 2 of the interns from the 2 past years of GSoC.
I mentored 2 interns developing working tutorials to vision functionality. This started slowly since we had to decide on, set up an learn a new infrastructure. We ended up using a sphinx and then coding and explanation started. It worked out well and gave us a basic coverage of tutorials to get started with different aspects of the library, computer vision being a large field: http://opencv.itseez.com/doc/tutorials/tutorials.html .
Since we have a good supported port of OpenCV to Android from 2010, we went on to iOS in 2011. This resulted in a complete port which we have been testing and refining. This is planned for official release in April. We will be giving a tutorial turned course ware on this at the Computer Vision and Pattern Recognition Conference in June http://www.cvpr2012.org/program-details/tutorials and we were extended an invitation to give this again at the European Conference on Computer Vision in October http://eccv2012.unifi.it/
We had someone working on developing samples for our Python port and this was very successful resulting in a large suite of example code under @.../opencv/samples/python2@. We did this to popularize the existence of this interface but I just started a company, Industrial Perception Inc, adding the eyes and brains to industrial robots and find myself making extensive use of these examples.
We had a failure with a student who was implementing OpenCL optimization for OpenCV. The student just wouldn't do much work, was not very responsive and was terminated at midterm. Ironically, other developers saw this start of this work and we now have a whole group developing OpenCL ports.
We had a student doing Structure from Motion. Again, this was a failure because, despite what looked like solid background, the student just wasn't up to the task. On the other hand, it got us in touch with 2 people at Google who have been developing libmv and they may contribute this. We will put an intern on this effort this year if we get accepted.
We had students working on tracking which resulted in new methods of dense optical flow (Farnback optical flow). This has already been used by others for robotic visual odometry work.
What we learned is that anything near "state of the art" is best done only by top students who are doing current research in that area. We've done this a couple of time and those are some of the interns I ended up hiring. But, infrastructure type work (pascal samples, tutorials, code ports etc work well for the general student.
h3. Application Template
We have a page at http://code.opencv.org/projects/gsoc2012/wiki/GSoCApplicationTemplate
+*Summary:*+
*Contact info:*
* Please provide:
** Your name
** A phone number
** An email address where we can reach you for daily communication.
*** If you have a website that discusses your research, work and/or coding, let us know.
*Requirements:*
* We are looking for people who have strong programming backgrounds, there is no time to "learn on the job".
** Most of the positions will require advanced ability and experience in *C++* and/or *Python*.
*** Exception might be for help working on the website itself
** Most of the projects require knowledge of computer vision techniques. If so, your application will not be accepted if you don't have such experience. These will be stated on the projects ideas page.
Again, you must meet the requirements -- it is not enough to "want" to work on computer vision, we have limited time and so we need people who already have the necessary background. If you lack this background, spend the next year getting the background and apply then, we intend to be back for GSoC 2013.
Students will be expected to ''meet'' with their mentors by email, skype or google chat once a week and to twitter at least 2x/day on their current coding activities
*Sample Code:*
** With your application: *Please send in some sample code that you are proud of and are prepared to answer questions on.*
** If you have other useful skills such as experience with code optimization, or knowledge of SSE, MMX, CUDA or especially development experience on Android or iPhone let us know.
*Courses Taken:*
List the courses that you have taken in:
** Math
** Computer programming, especially:
** Programming languages
** Data structures
** Web programming
** Data base
** Computer vision
** Engineering
h2. Work Experience
* List any work experience that you've had in
** software development and/or in
** computer vision.
*Open Source Experience:*
* If you have already contributed to other open source projects, please tell us what it was and when you did this.
*Which project you are interested in and and why you want to do it:*
* Please tell us which of the project ideas you are interested and why you want to work on that one.
* If you have your __own idea__, please describe it clearly and provide a timeline of progress towards that goal.
*References:*
* Please list 2 or 3 academic or programming work references.
----
[[Gsoc2012|Back]]
h3. Org ID
OpenCV
h3. Org name
Open Source Computer Vision Library (OpenCV)
h3. Description
The Open Source Computer Vision Library (OpenCV) is a comprehensive computer vision library and machine learning (over 2500 functions) written in C++ and C with additional Python and Java interfaces. It officially supports Linux, Mac OS, Windows, Android and iOS. OpenCV has specific optimizations for SSE instructions, CUDA and especially Tegra. There is an active user group of 50 thousand members and download are approaching > 4M. OpenCV has uses from gesture recognition, Android and iPhone vision apps on up to medical, robotics, mine safety and Google Streetview.
h3. URL
http://opencv.willowgarage.com/wiki
h3. License
New and Simplified BSD
h3. Backup Admin
Vadim.Pisarevsky
h3. Ideas Page
http://code.opencv.org/projects/gsoc2012/wiki/Gsoc2012
h3. IRC channel
<pre>
#opencv on freenode
</pre>
h3. Mailing list
http://tech.groups.yahoo.com/group/OpenCV/
h3. Why participate
OpenCV has several full time contractors working on robotic applications and another paid group working on CUDA. However, the scope of the library is much larger and GSoC interns were invaluable last year in addressing other critical areas:
* getting a solid port of OpenCV to iOS,
* developing a QT based graphical interface, the old GUI was decidedly limited and stale
* creating an automatic interface to PASCAL VOC http://pascallin.ecs.soton.ac.uk/challenges/VOC/ (the main computer vision object recognition challenge)
* coding up a long time winning classifier in PASCAL VOC: Latent SVM
* features and support for feature tracking
* A set of tutorials
* A set of python examples
All the above things were out of scope of the paid work and had substantial impact on OpenCV, especially making it work with Mobile. In addition, 3 of the interns are now regular contributors. 2 more are occasional contributors.
Thus, why we are applying: We want to bring in a new generation of contributors and also to fill out areas where to don't have active development. We hope to gain pretty much a repeat of last year: Filling out new areas, perhaps co-authoring new papers and getting new regular contributors.
h3. Past summer of code, If so, challenges
We participated in 2010 and 2011.
There were 12 interns total, 8 worked out. As a side note, I have now permanently hired 2 of the interns from the 2 past years of GSoC.
I mentored 2 interns developing working tutorials to vision functionality. This started slowly since we had to decide on, set up an learn a new infrastructure. We ended up using a sphinx and then coding and explanation started. It worked out well and gave us a basic coverage of tutorials to get started with different aspects of the library, computer vision being a large field: http://opencv.itseez.com/doc/tutorials/tutorials.html .
Since we have a good supported port of OpenCV to Android from 2010, we went on to iOS in 2011. This resulted in a complete port which we have been testing and refining. This is planned for official release in April. We will be giving a tutorial turned course ware on this at the Computer Vision and Pattern Recognition Conference in June http://www.cvpr2012.org/program-details/tutorials and we were extended an invitation to give this again at the European Conference on Computer Vision in October http://eccv2012.unifi.it/
We had someone working on developing samples for our Python port and this was very successful resulting in a large suite of example code under @.../opencv/samples/python2@. We did this to popularize the existence of this interface but I just started a company, Industrial Perception Inc, adding the eyes and brains to industrial robots and find myself making extensive use of these examples.
We had a failure with a student who was implementing OpenCL optimization for OpenCV. The student just wouldn't do much work, was not very responsive and was terminated at midterm. Ironically, other developers saw this start of this work and we now have a whole group developing OpenCL ports.
We had a student doing Structure from Motion. Again, this was a failure because, despite what looked like solid background, the student just wasn't up to the task. On the other hand, it got us in touch with 2 people at Google who have been developing libmv and they may contribute this. We will put an intern on this effort this year if we get accepted.
We had students working on tracking which resulted in new methods of dense optical flow (Farnback optical flow). This has already been used by others for robotic visual odometry work.
What we learned is that anything near "state of the art" is best done only by top students who are doing current research in that area. We've done this a couple of time and those are some of the interns I ended up hiring. But, infrastructure type work (pascal samples, tutorials, code ports etc work well for the general student.
h3. Application Template
We have a page at http://code.opencv.org/projects/gsoc2012/wiki/GSoCApplicationTemplate
+*Summary:*+
*Contact info:*
* Please provide:
** Your name
** A phone number
** An email address where we can reach you for daily communication.
*** If you have a website that discusses your research, work and/or coding, let us know.
*Requirements:*
* We are looking for people who have strong programming backgrounds, there is no time to "learn on the job".
** Most of the positions will require advanced ability and experience in *C++* and/or *Python*.
*** Exception might be for help working on the website itself
** Most of the projects require knowledge of computer vision techniques. If so, your application will not be accepted if you don't have such experience. These will be stated on the projects ideas page.
Again, you must meet the requirements -- it is not enough to "want" to work on computer vision, we have limited time and so we need people who already have the necessary background. If you lack this background, spend the next year getting the background and apply then, we intend to be back for GSoC 2013.
Students will be expected to ''meet'' with their mentors by email, skype or google chat once a week and to twitter at least 2x/day on their current coding activities
*Sample Code:*
** With your application: *Please send in some sample code that you are proud of and are prepared to answer questions on.*
** If you have other useful skills such as experience with code optimization, or knowledge of SSE, MMX, CUDA or especially development experience on Android or iPhone let us know.
*Courses Taken:*
List the courses that you have taken in:
** Math
** Computer programming, especially:
** Programming languages
** Data structures
** Web programming
** Data base
** Computer vision
** Engineering
h2. Work Experience
* List any work experience that you've had in
** software development and/or in
** computer vision.
*Open Source Experience:*
* If you have already contributed to other open source projects, please tell us what it was and when you did this.
*Which project you are interested in and and why you want to do it:*
* Please tell us which of the project ideas you are interested and why you want to work on that one.
* If you have your __own idea__, please describe it clearly and provide a timeline of progress towards that goal.
*References:*
* Please list 2 or 3 academic or programming work references.
----
[[Gsoc2012|Back]]