Recent

Author Topic: CATWW  (Read 4447 times)

TRon

  • Hero Member
  • *****
  • Posts: 536
Re: CATWW
« Reply #60 on: August 28, 2020, 09:35:46 pm »
First: Concerning the StringGrid I can talk only about Linux/gtk. No experience how it behaves with other widget sets.
Even then it depends on where (what hardware) the widget(set) is running  ::)

Quote
Just made a test with filtering:
Filtered a subset of 102 rows out of 70.000 in 1.5 seconds. The next filterings are always a little bit faster (why??) : 1.2 seconds.
hmz, that is indeed a bit strange that you are getting different results on the first run. Have you perhaps constructed your filtering in such a way that it is able to cache ?

Quote
It is important for sorting/searching/filtering that you disable all visual stuff with
BeginUpdate.
Yes, I am aware. Thanks for the reminder  :)

fwiw: I went for a listview in virtual mode, and am still thinking about whether or not a tree-like approach would be more convenient. I'm really tempted to use a virtual treeview. The loading part is really causing the most delay, either when using a string-grid or something else. Although that isn't an issue when using a virtual listview and accessing the data with sqlite.

Does anyone happen to know if there is a class out there that is able to index csv files in such a way that it is able to present the access to the records/fields virtually and is able to actually access/cache them on demand when required ? afaik that would be the only way that could perhaps be faster then stuffing it into a db first.

winni

  • Hero Member
  • *****
  • Posts: 2018
Re: CATWW
« Reply #61 on: August 28, 2020, 10:45:27 pm »
Hi!

After I found out how to start kernel 5.7 that I could start VirtualBox again. And then Win7.
So I have made some tests with my 70.000 rows CSV file with Win7
At half speed (VirtualBox) !!

Loading the file via LoadFromCSVfile took
3124 milliseconds

Column sort was - like Linux - around 1 second.

So we summarize:
StringGrid is astonishing fast with gtk and Win7.
Dont know about the other widget sets.

That the first of some similar actions is slower than the next ones I also recognized while working with huge graphics. Memory allocation or whatever???

And now I know how to start older kernels.
So it was not useless ....

Winni



JLWest

  • Hero Member
  • *****
  • Posts: 934
Re: CATWW
« Reply #62 on: August 29, 2020, 12:14:21 am »
I can test on Windows 10 pro if you need it.
FPC 3.2.0, Lazarus IDE v2.0.4
 Windows 10 Pro 32-GB
 Intel i7 770K CPU 4.2GHz 32702MB Ram
GeForce GTX 1080 Graphics - 8 Gig
4.1 TB

winni

  • Hero Member
  • *****
  • Posts: 2018
Re: CATWW
« Reply #63 on: August 29, 2020, 11:08:53 pm »
Hi!

Another time arguing for the StringGrid.

I fetched nearly 8000 Airports from  https://openflights.org/data.html
I have put them in a StringGrid.

Then I wrote my own Quicksort for singles (Lat,long).
To sort these 8000 Airports took around 50 milliseconds.

So why should we need a DB???

Winni

TRon

  • Hero Member
  • *****
  • Posts: 536
Re: CATWW
« Reply #64 on: August 31, 2020, 06:38:56 pm »
Another time arguing for the StringGrid.

So why should we need a DB???
Don't let me stop you ;)

 

TinyPortal © 2005-2018