2016

Version 7 (Gary Bradski, 2016-03-01 07:11 pm)

1 1
h1. 2016  OpenCV Meeting notes for the year 2016
2 1
3 1
Template is at http://code.opencv.org/projects/opencv/wiki/Template
4 1
http://code.opencv.org/help/wiki_syntax
5 1
6 1
[[Meeting_notes]]
7 1
8 1
{{>toc}}
9 1
10 1
11 1
<pre>
12 1
      <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
13 1
</pre>
14 1
15 7 Gary Bradski
h2. 2016-02-02
16 7 Gary Bradski
17 7 Gary Bradski
h3. _*Agenda*_
18 7 Gary Bradski
19 7 Gary Bradski
 * .
20 7 Gary Bradski
21 7 Gary Bradski
h3. *_Minutes_*
22 7 Gary Bradski
23 7 Gary Bradski
 * . 
24 7 Gary Bradski
25 7 Gary Bradski
h3. *_Reports_*
26 7 Gary Bradski
27 7 Gary Bradski
 * . Vadim
28 7 Gary Bradski
29 7 Gary Bradski
30 7 Gary Bradski
31 7 Gary Bradski
h3. *_Action Items_*
32 7 Gary Bradski
33 7 Gary Bradski
*Gary*
34 7 Gary Bradski
35 7 Gary Bradski
 * . 
36 7 Gary Bradski
37 7 Gary Bradski
*Vincent*
38 7 Gary Bradski
39 7 Gary Bradski
 * . 
40 7 Gary Bradski
41 7 Gary Bradski
*Vadim*
42 7 Gary Bradski
43 7 Gary Bradski
 * . 
44 7 Gary Bradski
45 7 Gary Bradski
*Grace*
46 7 Gary Bradski
47 7 Gary Bradski
 * . 
48 7 Gary Bradski
49 7 Gary Bradski
50 7 Gary Bradski
<pre>
51 7 Gary Bradski
      <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
52 7 Gary Bradski
</pre>
53 7 Gary Bradski
54 4 Gary Bradski
h2. 2016-01-26
55 4 Gary Bradski
56 4 Gary Bradski
h3. _*Agenda*_
57 4 Gary Bradski
58 6 Gary Bradski
 * GSoC gear up
59 6 Gary Bradski
 * Hardware Acceleration of vision
60 6 Gary Bradski
 * Economic ideas
61 6 Gary Bradski
 *Hardware acceleration layer HAL
62 6 Gary Bradski
 * Final payments for mentors and for contest need to go out
63 1
64 6 Gary Bradski
65 4 Gary Bradski
h3. *_Minutes_*
66 1
67 1
 * New summer of code, Feb 8 "See Timelene":https://developers.google.com/open-source/gsoc/timeline
68 6 Gary Bradski
 * Economic ideas for OpenCV ... 
69 6 Gary Bradski
 ** OpenCV has been brought current on all tax issues (yeah!)
70 1
 * NUML
71 5 Gary Bradski
 ** Performance is almost at C level, a few problems, but produces large C files (single C source) when optimization is turned on -O2 or -O3
72 1
 ** See report below
73 1
 ** Month to 2 months
74 6 Gary Bradski
 ** 1 month to version 1, then
75 6 Gary Bradski
 *** try wrapping some of opencv
76 6 Gary Bradski
 *** try wrapping some of tensorflow
77 6 Gary Bradski
 * Hardware acceleration layer (HAL)
78 6 Gary Bradski
 ** OpenCV has been improving its layer
79 6 Gary Bradski
 ** "OpenVX":https://www.khronos.org/openvx/ (starting to grow, "Imagination Pass":https://globenewswire.com/news-release/2016/01/06/799884/0/en/PowerVR-GPUs-From-Imagination-Pass-OpenVX-Conformance-With-Khronos.html
80 5 Gary Bradski
 * Industrial vision apps "Datalogic":http://www.datalogic.com/eng/products/industrial-automation/machine-vision-pc-16.html , "Cognex":http://www.cognex.com/
81 4 Gary Bradski
82 4 Gary Bradski
h3. *_Reports_*
83 4 Gary Bradski
84 4 Gary Bradski
 * . Vadim
85 4 Gary Bradski
86 4 Gary Bradski
*OpenCV:*
87 4 Gary Bradski
88 4 Gary Bradski
    After NY holidays we resumed the work on OpenCV. The approximate OpenCV 3.2 release time is end of May; before that we will do hackathon. Since it will be before GSoC 2016, not much new functionality should be expected. The major new features will be more or less complete HAL along with many bug fixes found in 3.0/3.1. We also continuously improve our continuous integration infrastructure. Along those lines, we've done the following during the 2 past weeks:
89 4 Gary Bradski
90 4 Gary Bradski
* - build fixes: world with CUDA / precompiled headers for world / include only available modules (via opencv2/opencv.hpp) / python detection issue on Ubuntu 14.04 / fix OSX framework build with contrib
91 4 Gary Bradski
* - buildbot infrastructure: 2016 copyright / limit (100) number of stored builds&logs / fix iOS nightly build / fix python library path for ARM
92 4 Gary Bradski
* - prepared proposal for OpenCV add-ons: this is quite important feature, requested by Vincent and other guys. The idea is to let users to build their own modules (or opencv_contrib modules) without rebuilding opencv itself. Alexander Alekhin has prepared the proposal on how to implement this feature.
93 4 Gary Bradski
* - OpenCV HAL. The 1D DFT API has been finalized and implemented. The first tests showed noticeable speed degradation, so we spend some more time to fix those issues and now the performance is more or less the same as it was before. 
94 4 Gary Bradski
* - There is test build and test run of OpenCV with coverage turned on. We plan to put it to the buildbot and get the test coverage information on regular basis as we did it in Willow Garage times.
95 4 Gary Bradski
* - ~10 PRs have been reviewed.
96 4 Gary Bradski
* 
97 4 Gary Bradski
  - Vlad Sovrasov joined our team as intern, he is working on converting some of the Python samples to tests, so we will have additional number of tests and besides we will check quality of Python bindings. So far he created 4 new tests
98 4 Gary Bradski
99 4 Gary Bradski
*OpenCV Plans:*
100 4 Gary Bradski
* - continue Python samples => tests transformation
101 4 Gary Bradski
* - add the coverage builder
102 4 Gary Bradski
* - add 2D DFT HAL API, then proceed with filtering functions
103 4 Gary Bradski
104 4 Gary Bradski
*Numl:*
105 4 Gary Bradski
106 4 Gary Bradski
  Basically we are now working on rewriting numl compiler in numl, which should greatly improve compile time (.nl=>.c) and also serve as a decent regression test.
107 4 Gary Bradski
* numlyacc parser generator tool is ready. It was able to reproduce it's own grammar parser. numlyacc takes ~6000 lines of code in numl and it's translated to 95000 lines of code in C. The generated C source takes ~3-4 minutes to compile with -O2 optimization (which reduces down to ~10-20 seconds with -O1). Obviously, we will need to split such huge files into smaller ones.
108 4 Gary Bradski
* The work on converting numl lexical scanner and the parser to numllex and numlyacc is started.
109 4 Gary Bradski
* The C code generator has been improved to produce smaller .c files without loosing efficiency (there is quite the opposite effect, in fact). In particular, 1 week ago numlyacc output took ~130000 lines of code in C, now it takes ~95000.
110 4 Gary Bradski
* Prepared some slides summarizing numl progress over the year: https://docs.google.com/presentation/d/1YmFCkvoo5qwtDAd70xyWpIazMFEWExz7aeZ2P4v2m40/edit#slide=id.p3
111 4 Gary Bradski
* There is the first draft of the output C language AST data structure. In the current compiler C code generator is very sophisticated single-pass procedure. We plan to move to the structured representation of C code and then make a few passes over it. It should help to further improve quality of the output code.
112 4 Gary Bradski
113 4 Gary Bradski
*Numl Plans:*
114 4 Gary Bradski
* *[done!]* Finish numlyacc, test the pair numllex + numlyacc.
115 4 Gary Bradski
* convert numl parser to numl, then proceed with type checker, k-normalization and optimizers of the k-form.
116 4 Gary Bradski
* add basic OOP capabilities. This is another item in progress.
117 4 Gary Bradski
* write some slides and initial documentation for the language and the standard library
118 4 Gary Bradski
* grow the standard library.
119 4 Gary Bradski
120 4 Gary Bradski
121 4 Gary Bradski
122 4 Gary Bradski
123 4 Gary Bradski
124 4 Gary Bradski
h3. *_Action Items_*
125 4 Gary Bradski
126 4 Gary Bradski
*Gary*
127 4 Gary Bradski
128 4 Gary Bradski
 * get out GSOC mentor payments
129 4 Gary Bradski
130 1
*Vincent*
131 4 Gary Bradski
132 5 Gary Bradski
 * Talk about NUML
133 4 Gary Bradski
134 4 Gary Bradski
*Vadim*
135 4 Gary Bradski
136 4 Gary Bradski
 * Have Sergey send Gary US account info
137 4 Gary Bradski
138 4 Gary Bradski
*Grace*
139 4 Gary Bradski
140 4 Gary Bradski
 * . 
141 4 Gary Bradski
142 4 Gary Bradski
143 4 Gary Bradski
<pre>
144 4 Gary Bradski
      <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
145 4 Gary Bradski
</pre>
146 4 Gary Bradski
147 3 Gary Bradski
h2. 2016-01-19
148 3 Gary Bradski
149 3 Gary Bradski
h3. _*Agenda*_
150 3 Gary Bradski
151 3 Gary Bradski
 * Taxes
152 3 Gary Bradski
 * OpenCV 3.1 progress
153 3 Gary Bradski
154 3 Gary Bradski
h3. *_Minutes_*
155 3 Gary Bradski
156 3 Gary Bradski
 * Paid OpenCV.org's taxes (yes we have taxes because not all income was paid out in the same year)
157 3 Gary Bradski
 * OpenCV
158 3 Gary Bradski
 ** Pulled in 20 pull requests
159 3 Gary Bradski
 ** We are extending the Hardware Acceleration Layer (HAL) -- an API that HW manufacturers can come under and speed up OpenCV
160 3 Gary Bradski
 *** Did the complex ones first
161 3 Gary Bradski
 *** Simpler ones next
162 3 Gary Bradski
 ** These comply with but go beyond OpenVX (it is 40 functions), but we will cover many more functions
163 3 Gary Bradski
 *** FFT, larger data types (beyond 8 bits)
164 3 Gary Bradski
 *** We will allow direct calls later for even more acceleration
165 3 Gary Bradski
 * NUML
166 3 Gary Bradski
 ** NUML compiler is being converted to NUML (port of YACC tool is now in NUML) 
167 3 Gary Bradski
 *** Parser is complicated, 500 states, but automatically generated 
168 3 Gary Bradski
 *** Parser is general, can be used for other functions, macros
169 3 Gary Bradski
 * Vincent in town for two weeks from France
170 3 Gary Bradski
 ** Meet with OpenCV, Willow and ROS people
171 3 Gary Bradski
 ** There will be official ARM support, current build bot already tests against ARM (Linux, but not Android)
172 3 Gary Bradski
 *** This will expand the ARM user population by quite a bit
173 3 Gary Bradski
 ** Reading up on SYCL (part of Chronos2, higher level than OpenCL)
174 3 Gary Bradski
 * OSI wants us to change our logo :-(  
175 3 Gary Bradski
 ** Rather than fight, we're probably going to redesign it
176 3 Gary Bradski
 ** Itseez has a professional designer and/or we could have a contest, but that may lead to conflict problems
177 3 Gary Bradski
178 3 Gary Bradski
h3. *_Reports_*
179 3 Gary Bradski
180 3 Gary Bradski
 * . Vadim
181 3 Gary Bradski
182 3 Gary Bradski
183 3 Gary Bradski
184 3 Gary Bradski
h3. *_Action Items_*
185 3 Gary Bradski
186 3 Gary Bradski
*Gary*
187 3 Gary Bradski
188 3 Gary Bradski
 * . 
189 3 Gary Bradski
190 3 Gary Bradski
*Vincent*
191 3 Gary Bradski
192 3 Gary Bradski
 * . 
193 3 Gary Bradski
194 3 Gary Bradski
*Vadim*
195 3 Gary Bradski
196 3 Gary Bradski
 * . 
197 3 Gary Bradski
198 3 Gary Bradski
*Grace*
199 3 Gary Bradski
200 3 Gary Bradski
 * . 
201 3 Gary Bradski
202 3 Gary Bradski
203 3 Gary Bradski
<pre>
204 3 Gary Bradski
      <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
205 3 Gary Bradski
</pre>
206 3 Gary Bradski
207 3 Gary Bradski
h2. 2016-01-12
208 1
209 1
h3. _*Agenda*_
210 1
211 2 Gary Bradski
 * New year
212 1
213 1
h3. *_Minutes_*
214 1
215 2 Gary Bradski
 * Maxime extending HAL (Hardware Acceleration Layer) 
216 2 Gary Bradski
 ** Fixed API, so OpenCV can be easily accelerated w/o needing any customization
217 2 Gary Bradski
 * Bug reports and pull requests for 3.0 and 3.1
218 2 Gary Bradski
 ** Working on
219 2 Gary Bradski
 * NUML
220 2 Gary Bradski
 ** NUML compiler converted from C to NUML
221 2 Gary Bradski
 *** 3 parts, 30K lines. If 30K lines compile and work, it's  a good sign of stability
222 2 Gary Bradski
 *** Already some bugs fixed
223 2 Gary Bradski
 *** Smaller footprint to get started
224 2 Gary Bradski
 ** NUML => C bootstrap. So can port to new platform easily
225 2 Gary Bradski
 ** Advantages: 
226 2 Gary Bradski
 *** Safe language is safe, can't go out of bounds. 
227 2 Gary Bradski
 *** parallel for is embedded
228 2 Gary Bradski
 *** matlab kind of productivity, but optimized C run speed
229 2 Gary Bradski
 **** NUML 20-50x faster than Python
230 2 Gary Bradski
 *** types are checked at compile time. No number to string adds for example
231 2 Gary Bradski
 *** Compile speed at speed of C compiler (NUML byte code to C) Bottleneck if C compiler
232 2 Gary Bradski
 *** 1000 lines of NUML => 10Ks of C code
233 2 Gary Bradski
 ** Working on this conversion, then tutorial slides
234 2 Gary Bradski
 *** Can write code in text editor, type NUML and then
235 2 Gary Bradski
 *** Notebooks
236 1
237 1
h3. *_Reports_*
238 1
239 1
 * . Vadim
240 1
241 1
242 1
243 1
h3. *_Action Items_*
244 1
245 1
*Gary*
246 1
247 1
 * . 
248 1
249 1
*Vincent*
250 1
251 1
 * . 
252 1
253 1
*Vadim*
254 1
255 1
 * . 
256 1
257 1
*Grace*
258 1
259 1
 * . 
260 1
261 1
262 1
<pre>
263 1
      <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><>
264 1
</pre>
265 1
266 1
267 1
268 1
269 1
[[Meeting_notes]]