Make the BuildBot green on master branch (Bug #2597)

Added by Kirill Kornyakov over 12 years ago. Updated about 12 years ago.

Status:Done Start date:2012-12-04
Priority:Normal Due date:
Assignee:- % Done:

0%
Category:infrastructure
Target version:2.4.4
Affected version:branch '2.4' Operating System:
Difficulty: HW Platform:
Pull request:

Description

As we discussed, master branch should be always green. But that is not the case right now, since we have 12 failing tests. I suggest to come to a stable state and later register every time when a pull request passes the pre-commit testing, but later breaks the major BuildBot. This will help to test patches more strictly.

Vadim, how will we work on the current list of issues?

  1. Calib3d_FindEssentialMat.accuracy
  2. Calib3d_SolvePnPRansac.accuracy
  3. Core_Invert.small
  4. Features2d_FLANN_Auto.regression
  5. Highgui_Video_parallel_writers_and_readers.accuracy
  6. opencv_test_imgproc
GPU
  1. GPU_Denoising/FastNonLocalMeans.Regression/0, where GetParam
  2. GPU_ImgProc/HoughCircles.Accuracy/0, where GetParam
  3. GPU_ObjDetect/HOG.Detect/0, where GetParam
  4. GPU_SoftCascade/SCascadeTestAll.detect/0, where GetParam
  5. GPU_SoftCascade/SCascadeTestAll.detectOnIntegral/0, where GetParam
  6. GPU_SoftCascade/SCascadeTestAll.detectStream/0, where GetParam

These tests failed on precommit_windows builder, so I think there are no real issues.

  1. SCascade.detect
  2. SCascade.detectNoRoi
  3. SCascade.detectRoi
  4. SCascade.detectSeparate
  5. SCascade.readCascade

Related issues

related to Bug #2773: investigate test failures on Windows buildbot builders Cancelled 2013-02-06

Associated revisions

Revision 53f1e735
Added by Vladislav Vinogradov about 12 years ago

fixed Video_calcOpticalFlowDual_TVL1 test (Bug #2597)

uses RMSE instead of bitwise equivalence

Revision 7ae547a2
Added by Andrey Pavlenko almost 11 years ago

Merge pull request #2597 from ilya-lavrenov:ipp_countnonzero

History

#1
Updated by Vadim Pisarevsky over 12 years ago

Core_Invert.small test should pass after merging 2.4 into master.

I will look at the other Core_* and Highgui_* tests.
SolvePnPRansac needs to be fixed, both the algorithm and the test.

Optical Flow TVL1 - need to ask the author (Alexey?) to look at it.

ML tests fail only on android_arm, so I leave fixing those tests to the tegra team.
On GPU tests - need to.

In other words, I will fix the tests I can fix and then reassign the ticket to the next relevant person.

#2
Updated by Kirill Kornyakov over 12 years ago

OK, now I see that some tests are failing on Android only. It wasn't clear to me before...

Thank you for readiness to work on this! I've talked to Anatoly, and he promised to look on failures in 2 weeks (they are busy with some algorithm). We'll check all the Android issues, but they are looking strange, since we don't see such failures in our test environment. We'll check them anyway.

#3
Updated by Andrey Kamaev over 12 years ago

Core_Invert.small test should pass after merging 2.4 into master.

It was merged on Friday.

Optical Flow TVL1 - need to ask the author (Alexey?) to look at it.

I think it was Vlad.

#4
Updated by Kirill Kornyakov about 12 years ago

Updated description for today's state: Jan 10, 2013.

Marina, could you comment on SCascade issues, both GPU and precommit_windows?

  • Description changed from As we discussed, _master_ branch should be always green. But that is not the ... to As we discussed, _master_ branch should be always green. But that is not the ... More

#5
Updated by Kirill Kornyakov about 12 years ago

Here is ticket for the Report page.

  • Affected version set to branch 'master' (2.4.9)
  • Target version deleted (2.4.4)

#6
Updated by Vadim Pisarevsky about 12 years ago

  • Assignee deleted (Vadim Pisarevsky)

#7
Updated by Kirill Kornyakov about 12 years ago

I would say that we've almost succeed with this task. Of course there will be other test failures, but we'll work on them on during daily work and release preparation.

  • Target version set to 2.4.4
  • Affected version changed from branch 'master' (2.4.9) to branch '2.4'
  • Status changed from Open to Done

Also available in: Atom PDF