Recent

Author Topic: TMemDataSet stream write error with huge amount of data  (Read 471 times)

zeljko

  • Hero Member
  • *****
  • Posts: 1022
    • http://wiki.lazarus.freepascal.org/User:Zeljan
TMemDataSet stream write error with huge amount of data
« on: January 07, 2019, 01:12:00 pm »
I'm trying to load huge csv file into TMemDataSet, but it crashes after some time when size of inserted data exceeds MaxInt, each record is 5453 bytes, when posting 393818 record I have "Stream write error". Found that it happens when stream size should pass 2GB (maxInt size exactly). Any idea how to load such data ?
Using fpc-3.0.4 64bit on linux 64bit machine with 32GB of ram, trunk lazarus.

zeljko

  • Hero Member
  • *****
  • Posts: 1022
    • http://wiki.lazarus.freepascal.org/User:Zeljan
Re: TMemDataSet stream write error with huge amount of data
« Reply #1 on: January 07, 2019, 01:45:35 pm »
ok, seem that TBufDataSet works (with usage of BufDataSet1.MergeChangeLog). So is this bug in TMemDataSet ? Anyone ?