Maximum array size allowed for an extern array in C++ on Visual Studio 2010
I asked a question yesterday which is found here trying to understand any potential problems with using large lookup tables specified via an extern array. These tables are all used for a set of nonparametric models that must be built into a DLL for our customer to use, where the DLL is expected to make computations with the at say 1000Hz or so.
Now in my project, the assortment of extern array lookup tables in total store about 66.2M floats, so in total around 265MB of data. The project, with all these tables, will compile fine but fail to complete the linking. However, the project compiles and links fine when I have less than about 180MB of data stored in the extern arrays.
Since my post yesterday, I have gathered a lot of evidence suggesting my project is hitting a limit on the amount of data I can have stored in extern arrays. Is there any actual limit with how much data can be stored in a set of extern arrays/variables? Is there maybe a bug in the linker that could break by having too much data in extern arrays? If there is some limit, is there a way to bump the limit to something higher or work around this issue somehow?
Note that my project is a Win32 project.
Edit
Note that more info about the problem, like the error that appears, is in my link at the start of the post. Below is some screen shots of the pop-up and message in VS 2010:
For array this large you should use dynamic memory instead of arrays. Arrays are allocated on stack or the data segment, in your case. In fact, anything larger than around 100KB shall never be allocated as array. It can cause all kinds of trouble. And even if you did get the program running, there's likely to be some severe performance penalty.
- Why does 1.0/100.0 == 0.1/10.0 give True?
- How to organize the receive msg and user current input in C network such that it's clean
- Using inclusive scan syntax in OpenMP in the C language
- Unable to understand context in book "OOP in C" by Axel Schreiner
- How to dereference member from struct in which the definition is hid from user?
- variable-length array in struct with TI compiler in C (socket programming)
- A faster way to test 32bpp DDBs for a valid Alpha channel
- How can I compile the zephyr example-application as a freestanding application?
- Why does my forked process sometimes overwrite data in a file?
- Why in C can I initialize more values than the size of an array?
- _Generic in C needs typecasting?
- Declaring/defining an unused variable changes the output from an unrelated variable
- How to use gdb to explore the stack/heap?
- How can I read an input string of unknown length?
- Confused by difference between expression inside if and expression outside if
- Fast Arc Cos algorithm?
- Discrepancy of `unsigned long` size between llvm and gcc in riscv32
- GCC (C) - error: 'x' redeclared as different kind of symbol
- Why does GCC’s static analyser falsely warn that a pointer to an allocated memory block itself stored in an allocated memory block may leak?
- c language gcc compiler *.i file #3 "" 2 what is this?
- How to make clang compile to llvm IR
- Hashtable implementation in C
- EFI variables or config file on the EFI partition for EFI application?
- Pack high bit of every byte in ARM, for 64 bytes like AVX512 vpmovb2m?
- Calling an external C function (in a shared lib) from Perl with Inline::C does not work
- Can a C program detect if its own source code has been modified?
- Is this declaration UB?
- Eclipse C/C++ how to find variable belongs to which struct quickly
- Is this truly best way to delete last element in C?
- flint/arb.h: No such file or directory