I need to store information into a very big file, in form of many dictionaries. That's not so important, is just to say that I tried to first get all the data into these dictionaries and I run out of memory (~60Gb).
Fine, so I want to add the data in the file without actually loading it in memory, by doing a loop on the lines and attaching to each line a bit of text. Is that possible? if so, how?