GSoC 2015

Version 14 (Gary Bradski, 2015-11-24 07:05 pm)

1 1
h1. *Ideas Page for OpenCV Google Summer of Code 2015 (GSoC 2015)*
2 1
3 7 Gary Bradski
*STILL UNDER CONSTRUCTION ...*
4 1
5 1
6 3 Gary Bradski
*OpenCV 3D recognition and pose from last year.*
7 11 Gary Bradski
!3D_recog.jpg!
8 1
9 1
----
10 1
11 1
h2. General Information:
12 1
13 3 Gary Bradski
* "GSoC 2015 site: http://www.google-melange.com/gsoc/homepage/google/gsoc2015":http://www.google-melange.com/gsoc/homepage/google/gsoc2015
14 3 Gary Bradski
* Mailing list for OpenCV GSOC 2015: [email protected]
15 3 Gary Bradski
** Group site https://groups.google.com/forum/#!forum/opencv-gsoc-2015
16 3 Gary Bradski
* "Timeline for GSoC 2015":http://www.google-melange.com/gsoc/events/google/gsoc2015
17 3 Gary Bradski
18 1
** *Next important dates:*
19 7 Gary Bradski
*** -Feb 20 19:00 UTC: Organization Application Deadline.- *DONE!*
20 3 Gary Bradski
*** Mar 02 19:00 UTC: List of accepted Organizations.
21 3 Gary Bradski
*** Mar 16 16:00 UTC: Student Application period begins!
22 3 Gary Bradski
*** Mar 27 19:00 UTC: Student Application period ends!
23 3 Gary Bradski
*** Apr 13 Deadline for OpenCV to request # of slots.
24 3 Gary Bradski
*** Apr 15 Google publishes how many slots we get.
25 3 Gary Bradski
*** Apr 21 Try to eliminate duplication of students.
26 3 Gary Bradski
*** Apr 24 IRC for OpenCV to resolve all duplications.
27 3 Gary Bradski
*** Apr 27 19:00 UTC: Accepted students announced.
28 3 Gary Bradski
*** May 25 Let Coding begin!
29 3 Gary Bradski
*** Jun 26 19:00 UTC: Mid term evaluation begins.
30 3 Gary Bradski
*** Jul 03 19:00 UTC:  Mid term end.
31 3 Gary Bradski
*** Aug 21 19:00 UTC: Coding stop; Pull requests must be in; Mentors: final evaluation begins...
32 3 Gary Bradski
*** Aug 28 19:00 UTC: Final evaluation deadline; Students begin submitting code.
33 3 Gary Bradski
*** Sept 25 19:00 UTC: Deadline for Google Code submission
34 3 Gary Bradski
*** Oct 24-25: Mentor Summit!
35 1
36 3 Gary Bradski
* we'll create a video just like we did 2013 year http://www.youtube.com/watch?v=_TTtN4frMEA
37 3 Gary Bradski
* 2014 *Vincent?!*
38 1
39 1
*Times:*
40 1
*  UTC to PDT (Pacific Daylight Time == Daylight savings time. In winter it's PST).
41 1
** "utc time converter":http://weatherarc.com/utc-time-conversion
42 1
43 1
*Resources:*
44 1
45 1
* "OpenCV Developers Site":http://code.opencv.org/projects/opencv/wiki
46 1
* "OpenCV User's Site":http://opencv.org
47 1
* [[How_to_contribute|How to Contribute Code]]
48 1
* Source Code can be found at "GitHub":https://github.com/Itseez/opencv. 
49 1
** To get the source code, point your git client to @git://github.com/Itseez/opencv.git@. Here are [[Working_with_OpenCV_git_repository|instructions]].
50 1
<pre>
51 1
git clone git://github.com/Itseez/opencv.git
52 1
</pre>
53 1
** The rest of the history plus matches between git commits and SVN revisions are stored at a separate "OpenCV Attic" repository: git://code.opencv.org/opencv_attic.git.
54 1
** Also OpenCV Extra was put to a separate repository: git://code.opencv.org/opencv_extra.git.
55 1
* [[OpenCV Development Process]]
56 1
** [[Meeting_notes|Developer meeting notes]]
57 1
58 1
h2. For students or mentors interested in applying
59 1
60 1
* You *must* already know how to program well in C++
61 1
** Some projects may require Python or Matlab skills
62 4 Gary Bradski
* Discuss projects below or other ideas with us https://groups.google.com/forum/?fromgroups#!forum/opencv-gsoc-2015
63 1
64 1
<pre>
65 12 Gary Bradski
\/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/
66 9 Gary Bradski
</pre>
67 9 Gary Bradski
68 8 Gary Bradski
h1. 2015 Project Ideas:
69 1
70 1
*Students may propose their own projects (give us a clear summary and why you can do this project). However, below are some of our priorities for this year* Contact us and/or discuss ideas at https://groups.google.com/forum/?fromgroups#!forum/opencv-gsoc-2015
71 1
72 9 Gary Bradski
*1 Google Cardboard*
73 9 Gary Bradski
* Do visual odometry, SLAM etc for Google Cardboard
74 1
75 9 Gary Bradski
*2 Projection mapping (Projected Augmented Reality)*
76 9 Gary Bradski
* Calibrate a camera to a projector
77 9 Gary Bradski
* Put out structured light to learn the 3D map of what's in front of the camera
78 9 Gary Bradski
* Project the camera image, suitably rotated and shifted onto the scene
79 1
* Unity or some other program to start transforming the scene for projection mapping
80 1
** See http://www.creativebloq.com/video/projection-mapping-912849 to get ideas of what you can do with this
81 1
82 1
*3 Update OpenCV file storage so that it's readable by Python in OpenCV (move to YAML 1.2 Edition 3)*
83 1
* Mentor Prasanna
84 1
* OpenCV C++ writes out its own YAML tags which makes it incompatible with it's own Python and with external python readers
85 1
* References
86 1
** YAML http://www.yaml.org
87 1
** Problem statement: http://stackoverflow.com/questions/11141336/filestorage-for-opencv-python-api
88 14 Gary Bradski
** Speedup fs reading/writing, add JSON support, add base64 (+RLE) support for large amounts of numerical data.
89 14 Gary Bradski
90 14 Gary Bradski
*4 Stereo correspondence improvements*
91 14 Gary Bradski
* More accurate and faster stereo correspondence (StereoBM/StereoSGBM) by using LBP/BRIEF/DAISY etc. per-pixel descriptors instead of sum-of-absolute-differences.
92 14 Gary Bradski
93 14 Gary Bradski
*5 Self-contained video codec(s)*
94 14 Gary Bradski
* There is draft version of self-contained motion jpeg encoder to be integrated to OpenCV.
95 14 Gary Bradski
* We will also need decoder, 12-bit jpeg support, multi-threaded encoder and decoder.
96 14 Gary Bradski
* There are some other codecs, like libvpx, which we can support and link right into highgui, without dependency from ffmpeg/libav.
97 14 Gary Bradski
98 14 Gary Bradski
*6 Deep learning*
99 14 Gary Bradski
* It would be cool if OpenCV could load and run deep networks trained with popular DNN packages like Caffe or Torch.
100 14 Gary Bradski
* GPU/OpenCL optimization and/or other optimizations (that can partly be contributed back to the upstream projects) are also encouraged.
101 14 Gary Bradski
102 14 Gary Bradski
*7 Better interactive camera calibration*
103 14 Gary Bradski
* Modern algorithms would allow us to recompute camera parameters after almost each frame, compute reprojection error, compute confidence intervals for the parameters.
104 14 Gary Bradski
* the partially occluded calibration patterns could be handled somehow to, especially if we want to estimate intrinsic parameters only.
105 14 Gary Bradski
* the application may show us the areas where the corner borders have been shown so that user can see how good are the data
106 14 Gary Bradski
107 14 Gary Bradski
*8 Tracking improvements*
108 14 Gary Bradski
*TLD algorithm is implemented in OpenCV, but it needs improvements and optimizations.
109 14 Gary Bradski
*ASM/AAM can also be implemented, as well as the particle filter.
110 14 Gary Bradski
 
111 14 Gary Bradski
*9 Realtime image preprocessing algorithms*
112 14 Gary Bradski
*We and many other OpenCV users would definitely enjoy very fast denoising, color improvements, white balance etc. algorithms.
113 14 Gary Bradski
114 14 Gary Bradski
*10 PBM (part-based models) improvements*
115 14 Gary Bradski
*There is latentsvm package in opencv_contrib that needs to be improved (quality-wise and speed-wise).
116 14 Gary Bradski
*Adding training, even if it involves execution of external svmperf or other tool, is definitely appreciated too.
117 14 Gary Bradski
118 14 Gary Bradski
*11 Improving ICF/ACF + <some>Boost training and detection*
119 14 Gary Bradski
* In opencv_contrib there is initial version of the training application and detector based on integral channel features and boosting. Further improvements of this part would be really useful.
120 14 Gary Bradski
121 14 Gary Bradski
*12 numl+OpenCV, lua+OpenCV*
122 14 Gary Bradski
* there is emerging numl language, suitable for implementation of complex computationally-intensive algorithms. OpenCV bindings for this language would be really useful.
123 14 Gary Bradski
* the other language that is now used more often for ML and CV (thanks to Torch) is Lua; there are old bindings for a tiny part of OpenCV; could be useful to extend our autogenerated bindings to Lua.
124 1
125 1
<pre>
126 1
/\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\ /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\ 
127 1
</pre>
128 13 Gary Bradski
129 13 Gary Bradski
130 13 Gary Bradski
h1. Accepted Projects for OpenCV GSoC 2015:
131 13 Gary Bradski
132 13 Gary Bradski
OpenCV GSoC 2015 students, projects, mentors are below. *WHEN THEY ARE KNOWN*
133 13 Gary Bradski
134 13 Gary Bradski
135 13 Gary Bradski
<pre>
136 13 Gary Bradski
Student                 Project                                           Mentor(s)
137 13 Gary Bradski
=======                 =======                                           ========
138 13 Gary Bradski
139 13 Gary Bradski
</pre>
140 13 Gary Bradski
141 13 Gary Bradski
Project notes will be compiled "here":https://sites.google.com/a/opencv.org/opencv/gsoc-2015-project-notes .
142 13 Gary Bradski
143 13 Gary Bradski
144 1
145 1
h2. Mentors
146 1
147 1
*Actual signed up mentors*
148 1
149 1
* Alexander Mordvintsev	zzznah(+)gmail.com
150 1
* Sid Bao	ybao(+)magicleap.com
151 1
* Vincent Rabaud	vincent.rabaud(+)gmail.com
152 1
* Vadim Pisarevsky	vadim.pisarevsky(+)gmail.com
153 1
* Adrian Kaehler	therealadrian(+)gmail.com
154 1
* Terry Boult	tboult(+)vast.uccs.edu
155 1
* spmallick	spmallick(+)taaz.com
156 1
* Serge Belongie	sjb344(+)cornell.edu
157 1
* Stefano	s.fabri10(+)gmail.com
158 1
* Prasanna	pras.bits(+)gmail.com
159 1
* Pablo Alcantarilla	pablofdezalc(+)gmail.com
160 1
* Bence Magyar	mw.mzperx(+)gmail.com
161 1
* Manuele	manuele.tamburrano(+)gmail.com
162 1
* Grace Vesom	grace.vesom(+)gmail.com
163 1
* Open Source Computer Vision Library (OpenCV)	garybradski(+)gmail.com
164 1
* Douglas Lee	dougabug(+)gmail.com
165 1
* Claudia Rapuano	c.rapuano(+)gmail.com
166 1
* Antonella Cascitelli	antonellacascitelli(+)gmail.com
167 1
* Anatoly Baksheev	anatoly.baksheev(+)itseez.com
168 1
* Alexander	alexander.shishkov(+)itseez.com
169 1
* Alexander Bovyrin	alexander.bovyrin(+)itseez.com
170 1
171 1
172 1
173 1
In the below, get rid of the ''-delete-'' to make the emails work.
174 1
175 1
 Anatoly Baksheev
176 1
 Researcher, Vision Algorithms on GPU
177 1
 Argus/Itseez
178 1
 [email protected]  
179 1
 
180 1
  Alexander Bovyrin
181 1
  PhD, Senior Researcher
182 1
  Argus/Itseez founder
183 1
  NNU Lecturer
184 1
  [email protected]
185 1
186 1
 Gary Bradski
187 1
 Founder, Industrial Perception Inc.
188 1
 Consulting Prof. Stanford U.
189 1
 OpenCV Founder, Technical Content Owner, GSoC Admin
190 1
 Co-author of Learning OpenCV Book
191 1
 http://www.willowgarage.com/pages/people/gary-bradski-senior-researcher
192 1
 [email protected]
193 1
194 1
 Antonella Cascitelli
195 1
 Grad student, University of Rome
196 1
 [email protected]
197 1
198 1
 Eric Christiansen
199 1
 PhD, UCSD
200 1
 [email protected]
201 1
202 1
 Stefano Fabri
203 1
 CRR Team leader, University of Rome
204 1
 [email protected]
205 1
206 1
 Victor Eruhimov
207 1
 OpenCV founding team/Senior Researcher
208 1
 Argus/Itseez founder
209 1
 NNU Lecturer
210 1
 [email protected]
211 1
212 1
 Adrian Kaehler
213 1
 Principle Engineer, Applied Minds
214 1
 Co-author of Learning OpenCV Book.
215 1
 [email protected]
216 1
217 1
 Peter Karasev
218 1
 PhD Student, MINERVA Research Group
219 1
 Georgia Tech
220 1
 [email protected]
221 1
222 1
 Vadim Pisarevsky
223 1
 OpenCV founding team/Czar
224 1
 [email protected]
225 1
226 1
 Manuele Tamburrano
227 1
 Grad Student, University of Rome
228 1
 [email protected]
229 1
230 1
 Vincent Rabaud
231 1
 Principle Engineer, Aldebaran Robotics
232 1
 [email protected]
233 1
234 1
  Claudia Rapuano
235 1
  Grad student, University of Rome
236 1
  [email protected]
237 1
 
238 1
 Grace Vesom
239 1
 Lawrence Livermore 
240 1
 -delete-grace.vesom@-delete_gmail.com
241 1
242 1
 Bence Magyar
243 1
 Pal Robotics
244 1
 [email protected]
245 1
246 1
 Pablo Alcantarilla
247 1
 Toshiba Research Europe Ltd.
248 1
 [email protected]
249 1
250 1
h3.  Back up Mentors
251 1
252 1
 Mark Asbach
253 1
 Fraunhofer IAIS
254 1
 Schloss Birlinghoven
255 1
 Sankt Augustin, Germany
256 1
 http://mmprec.iais.fraunhofer.de/asbach.html
257 1
 [email protected]
258 1
259 1
260 1
 Nicolas Saunier, Ph.D.
261 1
 Assistant Professor
262 1
 Civil, Geological and Mining Department (CGM)
263 1
 École Polytechnique de Montréal
264 1
 http://nicolas.saunier.confins.net
265 1
 [email protected]
266 1
267 1
268 1
 Alexander Mordvintsev
269 1
 Software Engineer
270 1
 http://znah.net
271 1
 [email protected]
272 1
273 1
 Andrey Morozov
274 1
 Software Engineer
275 1
 Argus/Itseez
276 3 Gary Bradski
 [email protected] 
277 1
278 1
h2. OpenCV Org. Application to GSoC 2015
279 1
280 1
"OpenCV GSoC Application":http://code.opencv.org/projects/gsoc2013/wiki/GSoC2013OpenCVApplication
281 1
282 3 Gary Bradski
h2. Previous Years 
283 3 Gary Bradski
284 1
* 2014 "GSoC 2014 Ideas Page":http://code.opencv.org/projects/opencv/wiki/GSoC_2014
285 1
* 2013 "GSoC 2013 Ideas Page":http://code.opencv.org/projects/gsoc2013/wiki
286 1
* 2012 Ideas site http://code.opencv.org/projects/gsoc2012/wiki/Wiki/
287 1
* 2011 Ideas site http://opencv.willowgarage.com/wiki/GSOC_OpenCV2011
288 1
** 2011 Application GSoC page is http://opencv.willowgarage.com/wiki/GSoC2011OpenCVApplication
289 1
* 2010 Ideas site http://opencv.willowgarage.com/wiki/GSOC_OpenCV2010
290 1
** 2010 Application page http://opencv.willowgarage.com/wiki/ApplicationGSOC2010
291 1
292 1
----