Recent

Author Topic: Distributed Reader-Writer Mutex 1.0  (Read 7546 times)

aminer

  • Hero Member
  • *****
  • Posts: 956
Distributed Reader-Writer Mutex 1.0
« on: September 12, 2012, 05:18:18 am »

Hello,


Distributed Reader-Writer Mutex 1.0


Description:

Distributed Reader-Writer Mutex, ported by Amine Moulay Ramdane from the C++ Dmitry Vyukov Distributed Reader-Writer Mutex to Object Pascal, I have included in the following
Reader-Writer Mutexex in this distributed Reader-Writer mutex: TOmniMREW a light weight MREW that is very fast and in TMultiReadExclusiveWrite from JCL and now
both of them can scale better, and i have modified a little bit
Dmitry Vyukov Distributed Reader-Writer Mutex, i have not used
getcurrectprocessor() but i have used  GetCurrectThreadID()  like
this: nbr := getcurrentthreadid mod proc_count;
i have provided you with the source code, please take a look at the source code to understand better.


Language: FPC Pascal v2.2.0+ / Delphi 7+: http://www.freepascal.org/

Operating Systems: Win and Linux (x86).

Required FPC switches: -O3 -Sd -dFPC -dWin32 -dFreePascal

-Sd for delphi mode....

Required Delphi switches: -DMSWINDOWS -$H+

For Delphi use -DDelphi

And inside defines.inc you can use the following defines:

{$DEFINE CPU32} for 32 bits systems

{$DEFINE CPU64} for 64 bits systems

{$DEFINE TOmniMREW} to use Omnithread MREW

{$DEFINE TMultiReadExclusiveWrite} to use the jcl TMultiReadExclusiveWrite


You can download Distributed Reader-Writer Mutex 1.0 from:

http://pages.videotron.com/aminer/


Thank you,
Amine Moulay Ramdane.






aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #1 on: September 12, 2012, 05:23:48 am »

Hello,


Distributed Reader-Writer Mutex 1.0


Description:

Distributed Reader-Writer Mutex, ported by Amine Moulay Ramdane from the Dmitry Vyukov C++ Distributed Reader-Writer Mutex to Object Pascal, I have included the following
Reader-Writer Mutexex inside this Distributed Reader-Writer mutex: TOmniMREW a light weight MREW that is very fast and in TMultiReadExclusiveWrite from JCL and now
both of them can scale better, and i have modified a little bit
Dmitry Vyukov Distributed Reader-Writer Mutex, i have not used
getcurrectprocessor() but i have used  GetCurrectThreadID()  like
this: nbr := getcurrentthreadid mod proc_count;
i have provided you with the source code, please take a look at the source code to understand better.


Language: FPC Pascal v2.2.0+ / Delphi 7+: http://www.freepascal.org/

Operating Systems: Win and Linux (x86).

Required FPC switches: -O3 -Sd -dFPC -dWin32 -dFreePascal

-Sd for delphi mode....

Required Delphi switches: -DMSWINDOWS -$H+

For Delphi use -DDelphi

And inside defines.inc you can use the following defines:

{$DEFINE CPU32} for 32 bits systems

{$DEFINE CPU64} for 64 bits systems

{$DEFINE TOmniMREW} to use Omnithread MREW

{$DEFINE TMultiReadExclusiveWrite} to use the jcl TMultiReadExclusiveWrite


You can download Distributed Reader-Writer Mutex 1.0 from:

http://pages.videotron.com/aminer/


Thank you,
Amine Moulay Ramdane.


aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #2 on: September 12, 2012, 03:34:24 pm »

Hello,

The Object Pascal Distributed Reader-Writer Mutex 1.0
 is based on the following C++ Distributed Reader-Writer Mutex
by Dmitry Vyukov, read more here:

http://www.1024cores.net/home/lock-free-algorithms/reader-writer-problem/distributed-reader-writer-mutex


I have also modified the Dmitry Vyukov's Distributed
Reader-Writer Mutex  to use a variable number of MREWs,
you can pass the number of MREWs to the constructor like
this: drw:=TDRWLOCK.create(1000);

You can download Distributed Reader-Writer Mutex 1.0 from:

http://pages.videotron.com/aminer/


Thank you,
Amine Moulay Ramdane.



aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #3 on: September 12, 2012, 03:44:16 pm »

Hello,

You have four methods:

procedure wlock; // like the EnterWriteLock of TOmniMREW
procedure wunlock; // like the ExitWriteLock
procedure rlock; // like EnterReadLock
procedure runlock; // like the ExitReadLock


and you have to pass the number of MREWs(multiple-readers-exclusive-writer)
to the constructor like this:

drw:=TDRWLOCK.create(1000); // here we are creating 1000 MEWs


That's all.


Thank you,
Amine Moulay Ramdane




aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #4 on: September 13, 2012, 06:40:22 pm »

Hello,

Distributed Reader-Writer Mutex have been updated to version 1.02.

I have provided you now with two versions

In the first version i have not used GetCurrectProcessor() but i have used
GetCurrectThreadID() , and i have also provided you with a second
version that scales better, to be able to use the second version please use
the version2 in defines.inc, i have given you a test.pas example for
the first version and test1.pas for the second version, but don't forget to
use version2 inside defines.inc, to use the second version just uncomment
the version2 inside defines.inc and comment version1.

I have also done a cache line alignement in TOmniMREW, this has allowed
Drwlock to scale better.



You can download Distributed Reader-Writer Mutex version 1.02 from:

http://pages.videotron.com/aminer/



Thank you,
Amine Moulay Ramdane.


aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #5 on: September 13, 2012, 08:45:50 pm »


Hello,

Here is some scalability numbers:

I have used TOmniMREW of the Omnithread library and used
only EnterReadLock() and ExitReadLock() with four threads on a
quad cores and TOmniMREW gave a negative scalability of -5.51x

And when i have used the second version of Distributed Reader-Writer Mutex 1.02 using only  rlock() and runlock() , it gave me 3.94X scalability with four threads on four cores. So now it's scaling.


And about the second version , don't forget to initialize the number  that you pass to rlock() and runlock()  to 0 before
calling  rlock() and runlock() .



Thank you,
Amine Moulay Ramdane.




















aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #6 on: September 13, 2012, 09:22:25 pm »

Hello,

I don't think i have to align on cache line bounderies the array
elements, like have done  Dmitry Vyukov, i have just added a
cache line padding  inside TOmniMREW of Omnithread, and it
has worked perfectly.

You can download Distributed Reader-Writer Mutex 1.03 from:

http://pages.videotron.com/aminer/


Thank you,
Amien Moulay Ramdane.


aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #7 on: September 13, 2012, 09:32:49 pm »

Hello,

In the previous versions i  have aligned the array elements on cache line
bounderies like have done Dmitry Vyukov, and it didn't work correctly
when i have tested the second version, so i have thought about that and
after that i have decided to not align the array elements on cache line
bounderied but just add a cache line padding to TOmniMREW for example
and this time it has worked perfectly and now the second version is scaling perfectly..

So i have updated Distributed Reader-Writer Mutex to versoin 1.03 ,
you can download it from:


http://pages.videotron.com/aminer/


Thank you,
Amine Moulay Ramdane.

aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Distributed Reader-Writer Mutex 1.0
« Reply #8 on: September 13, 2012, 09:53:20 pm »

Hello again,


If you have noticed , there is still a weakness with the Dmitry Vyukov
C++ Distributed Reader-Writer Mutex, cause since he is using
GetCurrentProcessorNumber() he is limiting the array of rwlocks
to the number of avaiblable cores and this is not good i think , cause
if you have many more threads than the avaiblable cores and there is
high contention this will cause the performance to degrade, so i have
decided to change that in implementation and i have used a variable
number of rwlocks/MREWs so that you can lower more the contention
and this is better for scalability.


You can download Distributed Reader-Writer Mutex 1.03 from:
 
 http://pages.videotron.com/aminer/



Thank you,
Amine Moulay Ramdane


 

TinyPortal © 2005-2018