Add performance tests in sanity check mode to buildbot (Feature #1770)


Added by Andrey Kamaev almost 13 years ago. Updated almost 13 years ago.


Status:Done Start date:2012-04-06
Priority:Normal Due date:
Assignee:Alexander Shishkov % Done:

0%

Category:infrastructure
Target version:2.4.0
Difficulty: Pull request:

Description

Most of our performance test have a simple sanity checks to validate the correctness of output.
I suggest adding them to buildbot to control the regression.

To run the performance tests in sanity check mode you need to do:
  1. Set OPENCV_TEST_DATA_PATH as for regular tests
  2. add --perf_min_samples=1 --perf_force_samples=1 to the test arguments.
    For example:
opencv_perf_core --perf_min_samples=1 --perf_force_samples=1
For now these checks are working for the following modules:
  • core
  • imgproc
  • calib3d
  • photo

But it makes sense to add perf tests for the other modules as well. Currently running all performance tests in sanity mode takes less than 1 minute on my desktop.

Standard output of perf tests is very close to the output of our accuracy tests so it should not be difficult to integrate.


History

Updated by Alexander Shishkov almost 13 years ago

  • Status changed from Open to Done

Also available in: Atom PDF