GSoC 2015

Version 16 (Gary Bradski, 2015-11-24 07:05 pm)

1 1
h1. *Ideas Page for OpenCV Google Summer of Code 2015 (GSoC 2015)*
2 1
3 7 Gary Bradski
*STILL UNDER CONSTRUCTION ...*
4 1
5 1
6 3 Gary Bradski
*OpenCV 3D recognition and pose from last year.*
7 11 Gary Bradski
!3D_recog.jpg!
8 1
9 1
----
10 1
11 1
h2. General Information:
12 1
13 3 Gary Bradski
* "GSoC 2015 site: http://www.google-melange.com/gsoc/homepage/google/gsoc2015":http://www.google-melange.com/gsoc/homepage/google/gsoc2015
14 3 Gary Bradski
* Mailing list for OpenCV GSOC 2015: [email protected]
15 3 Gary Bradski
** Group site https://groups.google.com/forum/#!forum/opencv-gsoc-2015
16 3 Gary Bradski
* "Timeline for GSoC 2015":http://www.google-melange.com/gsoc/events/google/gsoc2015
17 3 Gary Bradski
18 1
** *Next important dates:*
19 7 Gary Bradski
*** -Feb 20 19:00 UTC: Organization Application Deadline.- *DONE!*
20 3 Gary Bradski
*** Mar 02 19:00 UTC: List of accepted Organizations.
21 3 Gary Bradski
*** Mar 16 16:00 UTC: Student Application period begins!
22 3 Gary Bradski
*** Mar 27 19:00 UTC: Student Application period ends!
23 3 Gary Bradski
*** Apr 13 Deadline for OpenCV to request # of slots.
24 3 Gary Bradski
*** Apr 15 Google publishes how many slots we get.
25 3 Gary Bradski
*** Apr 21 Try to eliminate duplication of students.
26 3 Gary Bradski
*** Apr 24 IRC for OpenCV to resolve all duplications.
27 3 Gary Bradski
*** Apr 27 19:00 UTC: Accepted students announced.
28 3 Gary Bradski
*** May 25 Let Coding begin!
29 3 Gary Bradski
*** Jun 26 19:00 UTC: Mid term evaluation begins.
30 3 Gary Bradski
*** Jul 03 19:00 UTC:  Mid term end.
31 3 Gary Bradski
*** Aug 21 19:00 UTC: Coding stop; Pull requests must be in; Mentors: final evaluation begins...
32 3 Gary Bradski
*** Aug 28 19:00 UTC: Final evaluation deadline; Students begin submitting code.
33 3 Gary Bradski
*** Sept 25 19:00 UTC: Deadline for Google Code submission
34 3 Gary Bradski
*** Oct 24-25: Mentor Summit!
35 1
36 3 Gary Bradski
* we'll create a video just like we did 2013 year http://www.youtube.com/watch?v=_TTtN4frMEA
37 3 Gary Bradski
* 2014 *Vincent?!*
38 1
39 1
*Times:*
40 1
*  UTC to PDT (Pacific Daylight Time == Daylight savings time. In winter it's PST).
41 1
** "utc time converter":http://weatherarc.com/utc-time-conversion
42 1
43 1
*Resources:*
44 1
45 1
* "OpenCV Developers Site":http://code.opencv.org/projects/opencv/wiki
46 1
* "OpenCV User's Site":http://opencv.org
47 1
* [[How_to_contribute|How to Contribute Code]]
48 1
* Source Code can be found at "GitHub":https://github.com/Itseez/opencv. 
49 1
** To get the source code, point your git client to @git://github.com/Itseez/opencv.git@. Here are [[Working_with_OpenCV_git_repository|instructions]].
50 1
<pre>
51 1
git clone git://github.com/Itseez/opencv.git
52 1
</pre>
53 1
** The rest of the history plus matches between git commits and SVN revisions are stored at a separate "OpenCV Attic" repository: git://code.opencv.org/opencv_attic.git.
54 1
** Also OpenCV Extra was put to a separate repository: git://code.opencv.org/opencv_extra.git.
55 1
* [[OpenCV Development Process]]
56 1
** [[Meeting_notes|Developer meeting notes]]
57 1
58 1
h2. For students or mentors interested in applying
59 1
60 1
* You *must* already know how to program well in C++
61 1
** Some projects may require Python or Matlab skills
62 4 Gary Bradski
* Discuss projects below or other ideas with us https://groups.google.com/forum/?fromgroups#!forum/opencv-gsoc-2015
63 1
64 1
<pre>
65 12 Gary Bradski
\/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/  \/
66 9 Gary Bradski
</pre>
67 9 Gary Bradski
68 8 Gary Bradski
h1. 2015 Project Ideas:
69 1
70 1
*Students may propose their own projects (give us a clear summary and why you can do this project). However, below are some of our priorities for this year* Contact us and/or discuss ideas at https://groups.google.com/forum/?fromgroups#!forum/opencv-gsoc-2015
71 1
72 9 Gary Bradski
*1 Google Cardboard*
73 9 Gary Bradski
* Do visual odometry, SLAM etc for Google Cardboard
74 1
75 9 Gary Bradski
*2 Projection mapping (Projected Augmented Reality)*
76 9 Gary Bradski
* Calibrate a camera to a projector
77 9 Gary Bradski
* Put out structured light to learn the 3D map of what's in front of the camera
78 9 Gary Bradski
* Project the camera image, suitably rotated and shifted onto the scene
79 1
* Unity or some other program to start transforming the scene for projection mapping
80 1
** See http://www.creativebloq.com/video/projection-mapping-912849 to get ideas of what you can do with this
81 1
82 1
*3 Update OpenCV file storage so that it's readable by Python in OpenCV (move to YAML 1.2 Edition 3)*
83 1
* Mentor Prasanna
84 1
* OpenCV C++ writes out its own YAML tags which makes it incompatible with it's own Python and with external python readers
85 1
* References
86 1
** YAML http://www.yaml.org
87 1
** Problem statement: http://stackoverflow.com/questions/11141336/filestorage-for-opencv-python-api
88 14 Gary Bradski
** Speedup fs reading/writing, add JSON support, add base64 (+RLE) support for large amounts of numerical data.
89 14 Gary Bradski
90 14 Gary Bradski
*4 Stereo correspondence improvements*
91 14 Gary Bradski
* More accurate and faster stereo correspondence (StereoBM/StereoSGBM) by using LBP/BRIEF/DAISY etc. per-pixel descriptors instead of sum-of-absolute-differences.
92 14 Gary Bradski
93 14 Gary Bradski
*5 Self-contained video codec(s)*
94 14 Gary Bradski
* There is draft version of self-contained motion jpeg encoder to be integrated to OpenCV.
95 14 Gary Bradski
* We will also need decoder, 12-bit jpeg support, multi-threaded encoder and decoder.
96 14 Gary Bradski
* There are some other codecs, like libvpx, which we can support and link right into highgui, without dependency from ffmpeg/libav.
97 14 Gary Bradski
98 14 Gary Bradski
*6 Deep learning*
99 14 Gary Bradski
* It would be cool if OpenCV could load and run deep networks trained with popular DNN packages like Caffe or Torch.
100 14 Gary Bradski
* GPU/OpenCL optimization and/or other optimizations (that can partly be contributed back to the upstream projects) are also encouraged.
101 14 Gary Bradski
102 14 Gary Bradski
*7 Better interactive camera calibration*
103 14 Gary Bradski
* Modern algorithms would allow us to recompute camera parameters after almost each frame, compute reprojection error, compute confidence intervals for the parameters.
104 14 Gary Bradski
* the partially occluded calibration patterns could be handled somehow to, especially if we want to estimate intrinsic parameters only.
105 14 Gary Bradski
* the application may show us the areas where the corner borders have been shown so that user can see how good are the data
106 14 Gary Bradski
107 14 Gary Bradski
*8 Tracking improvements*
108 15 Gary Bradski
* TLD algorithm is implemented in OpenCV, but it needs improvements and optimizations.
109 15 Gary Bradski
* ASM/AAM can also be implemented, as well as the particle filter.
110 14 Gary Bradski
 
111 14 Gary Bradski
*9 Realtime image preprocessing algorithms*
112 15 Gary Bradski
* We and many other OpenCV users would definitely enjoy very fast denoising, color improvements, white balance etc. algorithms.
113 14 Gary Bradski
114 14 Gary Bradski
*10 PBM (part-based models) improvements*
115 15 Gary Bradski
* There is latentsvm package in opencv_contrib that needs to be improved (quality-wise and speed-wise).
116 15 Gary Bradski
* Adding training, even if it involves execution of external svmperf or other tool, is definitely appreciated too.
117 14 Gary Bradski
118 14 Gary Bradski
*11 Improving ICF/ACF + <some>Boost training and detection*
119 14 Gary Bradski
* In opencv_contrib there is initial version of the training application and detector based on integral channel features and boosting. Further improvements of this part would be really useful.
120 14 Gary Bradski
121 14 Gary Bradski
*12 numl+OpenCV, lua+OpenCV*
122 14 Gary Bradski
* there is emerging numl language, suitable for implementation of complex computationally-intensive algorithms. OpenCV bindings for this language would be really useful.
123 14 Gary Bradski
* the other language that is now used more often for ML and CV (thanks to Torch) is Lua; there are old bindings for a tiny part of OpenCV; could be useful to extend our autogenerated bindings to Lua.
124 1
125 1
<pre>
126 1
/\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\ /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\  /\ 
127 1
</pre>
128 13 Gary Bradski
129 13 Gary Bradski
130 13 Gary Bradski
h1. Accepted Projects for OpenCV GSoC 2015:
131 13 Gary Bradski
132 13 Gary Bradski
OpenCV GSoC 2015 students, projects, mentors are below. *WHEN THEY ARE KNOWN*
133 13 Gary Bradski
134 13 Gary Bradski
135 13 Gary Bradski
<pre>
136 13 Gary Bradski
Student                 Project                                           Mentor(s)
137 13 Gary Bradski
=======                 =======                                           ========
138 13 Gary Bradski
139 13 Gary Bradski
</pre>
140 13 Gary Bradski
141 13 Gary Bradski
Project notes will be compiled "here":https://sites.google.com/a/opencv.org/opencv/gsoc-2015-project-notes .
142 13 Gary Bradski
143 13 Gary Bradski
144 1
145 1
h2. Mentors
146 1
147 1
*Actual signed up mentors*
148 1
149 1
* Alexander Mordvintsev	zzznah(+)gmail.com
150 1
* Sid Bao	ybao(+)magicleap.com
151 1
* Vincent Rabaud	vincent.rabaud(+)gmail.com
152 1
* Vadim Pisarevsky	vadim.pisarevsky(+)gmail.com
153 1
* Adrian Kaehler	therealadrian(+)gmail.com
154 1
* Terry Boult	tboult(+)vast.uccs.edu
155 1
* spmallick	spmallick(+)taaz.com
156 1
* Serge Belongie	sjb344(+)cornell.edu
157 1
* Stefano	s.fabri10(+)gmail.com
158 1
* Prasanna	pras.bits(+)gmail.com
159 1
* Pablo Alcantarilla	pablofdezalc(+)gmail.com
160 1
* Bence Magyar	mw.mzperx(+)gmail.com
161 1
* Manuele	manuele.tamburrano(+)gmail.com
162 1
* Grace Vesom	grace.vesom(+)gmail.com
163 1
* Open Source Computer Vision Library (OpenCV)	garybradski(+)gmail.com
164 1
* Douglas Lee	dougabug(+)gmail.com
165 1
* Claudia Rapuano	c.rapuano(+)gmail.com
166 1
* Antonella Cascitelli	antonellacascitelli(+)gmail.com
167 1
* Anatoly Baksheev	anatoly.baksheev(+)itseez.com
168 1
* Alexander	alexander.shishkov(+)itseez.com
169 16 Gary Bradski
* Alexander Smorkalov	alexander.smorkalov(+)itseez.com
170 1
* Alexander Bovyrin	alexander.bovyrin(+)itseez.com
171 1
172 1
173 1
174 1
In the below, get rid of the ''-delete-'' to make the emails work.
175 1
176 1
 Anatoly Baksheev
177 1
 Researcher, Vision Algorithms on GPU
178 1
 Argus/Itseez
179 1
 [email protected]  
180 1
 
181 1
  Alexander Bovyrin
182 1
  PhD, Senior Researcher
183 1
  Argus/Itseez founder
184 1
  NNU Lecturer
185 1
  [email protected]
186 1
187 1
 Gary Bradski
188 1
 Founder, Industrial Perception Inc.
189 1
 Consulting Prof. Stanford U.
190 1
 OpenCV Founder, Technical Content Owner, GSoC Admin
191 1
 Co-author of Learning OpenCV Book
192 1
 http://www.willowgarage.com/pages/people/gary-bradski-senior-researcher
193 1
 [email protected]
194 1
195 1
 Antonella Cascitelli
196 1
 Grad student, University of Rome
197 1
 [email protected]
198 1
199 1
 Eric Christiansen
200 1
 PhD, UCSD
201 1
 [email protected]
202 1
203 1
 Stefano Fabri
204 1
 CRR Team leader, University of Rome
205 1
 [email protected]
206 1
207 1
 Victor Eruhimov
208 1
 OpenCV founding team/Senior Researcher
209 1
 Argus/Itseez founder
210 1
 NNU Lecturer
211 1
 [email protected]
212 1
213 1
 Adrian Kaehler
214 1
 Principle Engineer, Applied Minds
215 1
 Co-author of Learning OpenCV Book.
216 1
 [email protected]
217 1
218 1
 Peter Karasev
219 1
 PhD Student, MINERVA Research Group
220 1
 Georgia Tech
221 1
 [email protected]
222 1
223 1
 Vadim Pisarevsky
224 1
 OpenCV founding team/Czar
225 1
 [email protected]
226 1
227 1
 Manuele Tamburrano
228 1
 Grad Student, University of Rome
229 1
 [email protected]
230 1
231 1
 Vincent Rabaud
232 1
 Principle Engineer, Aldebaran Robotics
233 1
 [email protected]
234 1
235 1
  Claudia Rapuano
236 1
  Grad student, University of Rome
237 1
  [email protected]
238 1
 
239 1
 Grace Vesom
240 1
 Lawrence Livermore 
241 1
 -delete-grace.vesom@-delete_gmail.com
242 1
243 1
 Bence Magyar
244 1
 Pal Robotics
245 1
 [email protected]
246 1
247 1
 Pablo Alcantarilla
248 1
 Toshiba Research Europe Ltd.
249 1
 [email protected]
250 1
251 1
h3.  Back up Mentors
252 1
253 1
 Mark Asbach
254 1
 Fraunhofer IAIS
255 1
 Schloss Birlinghoven
256 1
 Sankt Augustin, Germany
257 1
 http://mmprec.iais.fraunhofer.de/asbach.html
258 1
 [email protected]
259 1
260 1
261 1
 Nicolas Saunier, Ph.D.
262 1
 Assistant Professor
263 1
 Civil, Geological and Mining Department (CGM)
264 1
 École Polytechnique de Montréal
265 1
 http://nicolas.saunier.confins.net
266 1
 [email protected]
267 1
268 1
269 1
 Alexander Mordvintsev
270 1
 Software Engineer
271 1
 http://znah.net
272 1
 [email protected]
273 1
274 1
 Andrey Morozov
275 1
 Software Engineer
276 1
 Argus/Itseez
277 3 Gary Bradski
 [email protected] 
278 1
279 1
h2. OpenCV Org. Application to GSoC 2015
280 1
281 1
"OpenCV GSoC Application":http://code.opencv.org/projects/gsoc2013/wiki/GSoC2013OpenCVApplication
282 1
283 3 Gary Bradski
h2. Previous Years 
284 3 Gary Bradski
285 1
* 2014 "GSoC 2014 Ideas Page":http://code.opencv.org/projects/opencv/wiki/GSoC_2014
286 1
* 2013 "GSoC 2013 Ideas Page":http://code.opencv.org/projects/gsoc2013/wiki
287 1
* 2012 Ideas site http://code.opencv.org/projects/gsoc2012/wiki/Wiki/
288 1
* 2011 Ideas site http://opencv.willowgarage.com/wiki/GSOC_OpenCV2011
289 1
** 2011 Application GSoC page is http://opencv.willowgarage.com/wiki/GSoC2011OpenCVApplication
290 1
* 2010 Ideas site http://opencv.willowgarage.com/wiki/GSOC_OpenCV2010
291 1
** 2010 Application page http://opencv.willowgarage.com/wiki/ApplicationGSOC2010
292 1
293 1
----