FileStorage Read fails > 32Gb. (Bug #4098)

Added by Kirk Mac about 10 years ago. Updated about 10 years ago.

Status:Cancelled Start date:2015-01-05
Priority:Normal Due date:
Assignee:Vadim Pisarevsky % Done:

100%
Category:core
Target version:2.4.11
Affected version:2.4.9 (latest release) Operating System:Linux
Difficulty: HW Platform:x64
Pull request:

Description

My computer has 320 GB of RAM, Ubuntu 12.04 x64, and OpenCV 2.4.9.1.

I have a yml file containing a 10643x100000 float matrix (saved by mexopencv, head and tail verified manually). The file is 4.4 GB. The Mat should be ~4 GB.
However, during the FileStorage read, I see the RAM usage go up around 32 GB, and then there's a segfault.

Program received signal SIGSEGV, Segmentation fault.
0x00007ffff6d13598 in cvReadRawDataSlice () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4

Here's the backtrace from gdb:

#0  0x00007ffff6d13598 in cvReadRawDataSlice () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4
#1  0x00007ffff6d149c6 in cvReadRawData () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4
#2  0x00007ffff6d156b0 in icvReadMat(CvFileStorage*, CvFileNode*) () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4
#3  0x00007ffff6d1e9d3 in cvRead () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4
#4  0x00007ffff6d20a62 in cv::read(cv::FileNode const&, cv::Mat&, cv::Mat const&) () from /home/kam/ssd/kam/repos/opencv-install/lib/libopencv_core.so.2.4
#5  0x00000000004150a1 in operator>><cv::Mat> (value=..., n=...) at /ssd/kam/repos/opencv-install/include/opencv2/core/operations.hpp:3169

History

#1
Updated by Kirk Mac about 10 years ago

Accidental duplicate of http://code.opencv.org/issues/4097.

  • Status changed from New to Cancelled
  • % Done changed from 0 to 100

Also available in: Atom PDF