Running my code consumes too much RAM memory my computer doesn't have

[eli]

I have written a code in Free Pascal, but when I tried to run it in my computer, the computer collapsed, because its RAM memory is limited (Actually 3 GB, 64 bits). Is there any website, having sufficient RAM memory, where I can - both send my code (which includes no "read" instructions) - and receive the output?

[Laksen]

You can probably spin something up at AWS or one of the other large cloud providers. But it probably won't be cheap

Maybe a cheaper option would be to restructure your program to not need that much ram simultaneously?

[Jorg3000]

Do you even know why your program needs more than 3 GB of memory?
Did you forget to free unused objects or is the memory requirement intentional?

[eli]

Well, actually my program needs a three dimensional array of the size 2 X 4096 X 4096. The array contains integers in the range 0...1681.

Additionaly, my program needs a two dimensional array of the size 2 X 4096. The array contains pseudo-integers of the type: MpInteger, as defined in Gmp unit.

[Josh]

hi
the 3 dimensional array should take about 67mb when using int16;
what is the size in bytes of mpinteger ?

are your arrays dynamic?

[dbannon]

the 3 dimensional array should take about 67mb when using int16;
what is the size in bytes of mpinteger ?

Yep, while eli's code is likely to be 32bit integer (objfpc mode) we are still going to be struggling to use anything like 3Gig. Declariing them as smallint would help...

I have no idea what mpjntegers are but lets assume (for fun) they are 512bits, the second array is using 4Meg.

No, sorry eli, its got to be a coding issue, not a memory one.

Davo

[Thaddy]

Code: Pascal  [Select][+][-]

1. uses windows;
2. {$SetPeFlags(IMAGE_FILE_LARGE_ADDRESS_AWARE )}// is $0020

For 32 bit code on windows gives you at least 4Gb addressable space for a 32bit program on win64 and a maximum of 3GB on win32. But slightly less will be available because of processes and programs. See msdn.
If that is still not enough buy more memory. (Or use the overlapped file API)

[Gustavo 'Gus' Carreno]

Hey eli,

Ok, let's do some maths: 2*4096*4096 = 33'554'432 Cells

Let's assume were doing 64b integers: 33554432*64 = 2'147'483'648 bits = 268'435'456 bytes = 256 MB

That's nowhere near 3GB since its only a quarter of a Gig. On that amount of RAM you can have 12 of those matrices, well less since you do need the OS to be running.

And with the second matrix, like Davo mentioned, even with 512 bit integers, that would be only 4MB.

So, it's definitely nothing to do with memory but everything to do with the way you're manipulating that memory.

I'm unaware of how the GMP unit uses those MpIntegers, so I'm not really comfortable blaming the GMP unit just yet.

But, if you're running Windows on a 3GB system, well, how much RAM do you really have free, I wonder. I'm guessing that you have at least some 300MB of spare RAM to run the code and allocate the data space.
If you're able to have Lazarus open and running the code, I'm guessing your system can spare the 300MB...

So, again, back to how your code is manipulating that data.

If you would provide us with a test project, or a subset of your code so we can have a better look at how it's running, maybe we could me of more help.

Hope that helps!!

Cheers,
Gus

[eli]

Solved!

Thank you all. It seems you are right.

The problem stemmed from the way MpIntegers are to be treated. Actually, MpInteger is a Type of whole numbers having no bound (up to the RAM memory). They are treated well by Gmp unit, with all the useful arithmetical operations. However, when treating them, one must be careful with the operation of assignment, which is not as simple as I thought when I was running my code.

So yes, it was not the RAM memory that made my computer collapse. Anyway, it's okay now. Cheers!