About ParallelVarFiler and ParallelHahsList

[aminer]

Hello,

As you know ParallelVarFiler is using ParallelHashList (a parallel hashtable), but as you know ParallelHashList is cache unfriendly since it's using a hash mechanism etc. and as you know
ParallelVarFiler and ParallelHashlist  are memory bound, so since ParallelHashList is cache unfriendly and  it's memory bound so i don't think ParallelVarFiler
or ParallelHahsList will scale very well, to avoid this problem
you have to use something like replication across computers using TCP/IP and using your database in each computer and
load balance between computer, but even if you are using
replication and load balancing this will make the memory truly
parallel but this will not avoid the problem with the network bandwidth limitation.

But ParallelVarFiler and ParallelHahslist are scaling to a certain point and they are fast, so they are still usufull.



Thank you,
Amine Moulay Ramdane.