Recent

Author Topic: Parallel archiver using my ParallelZlib..  (Read 17266 times)

aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #30 on: February 20, 2013, 05:01:28 am »
Hello,


please read again...

You will be able to use my Parallel archiver as a hashtable
from the hardisk with 0(1) access, you can for example
stream your database row with my ParallelVarFiler into
a memory stream or into a string, and store it
with my Parallel archiver into an  archive, and after
that your can access your rows into the hardisk as
a hashtable with O(1) access, you can use it
like this as a database if you you have id keys that
you want to map to databse rows, that will be a good idea to
use my Parallel archiver as a hashtable.

I will add the Distributed Reader-Writer Mutex 1.13 that
i have implemented to my Parallel archiver soon, so
that you can parallelize the read access.


Thank you,
Amine Moulay Ramdane.


aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #31 on: February 20, 2013, 05:42:49 am »

Question:

What's your newest ideas behind your parallel archiver ?


Answer:


Of course my Parallel Archiver does support Parallel commpression etc.
but my newest ideas behind my Parallel Archiver are this:

I have played with Winzip and 7Zip , but if you want to
give some files to extract or to test there integrity,
they both (Winzip and 7Zip) will use sequential access and
that's bad i think, so i have decided to implement a O(1)
access that is very fast for extraction and and for testing the integrity etc. into my Parallel Archiver and for that i have
used an in-memory hashtable that maintains the files names and there correponding file positions , and my second idea is that my Parallel Archiver is fault tolerant to for exemple power failures and also
if your hardisk is full and you get file corruption etc. so my Parallel Archiver is fault tolerant to this kind of problems , 7Zip and Winzip i think are not fault tolerant to those kind of problems.



Thank you,
Amine Moulay Ramdane.


 

aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #32 on: February 20, 2013, 01:01:54 pm »

Hello,

I  wrote:
"and my second idea is that my Parallel Archiver is fault tolerant to for exemple power failures and also
if your hardisk is full and you get file corruption etc. so my Parallel Archiver is fault tolerant to this kind of problems , 7Zip and Winzip i think are not fault tolerant to those kind of problems."


I have just played with 7Zip , and i have compressed 3 files
into the archive and after than i have opened the archive with
an editor and i have deleted some bytes and i have saved the file and after that when i have tried to open the archive, 7zip responded
that the file is corrupted, so 7Zip is not fault tolerant, i think
that with WinZip it's the same, but i have done the same
test with  my Parallel archiver, and it's recovering from the file damage, so it's fault toerant to this kind of damages, such
as power failures and when also the disk is full and you get a file corruption etc. I have implemented this kind of  fault tolerancy
into my Parallel archiver.


Hope you will enjoy my Parallel archiver, and i will soon extended it more.


Thank's,
Amine Moulay Ramdane.


aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #33 on: February 20, 2013, 01:12:39 pm »

Hello,

You can do the test yourself, just compress 3 files into
the archive with my Parallel archiver, and after that open the archive with an editor
and delete some bytes from the end of the archive, and
after that save your archive again, and after that try to
open it with my Parallel archiver and try to decompress the files,
and you will notice that my Parallel archiver will be fault tolerant to
this kind of damages, such as power failures , and such as when
the disk is full and then you get a file damage etc. , 7Zip and Winzip are not fault tolerant to this kind of damages, and
i have just tested 7Zip and it's not recovering from this kind of damages.



Thank you,
Amine Moulay Ramdane.



aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #34 on: February 20, 2013, 02:31:09 pm »

Hello,

It took me two days to write 2000 lines of code to implement
my Parallel archiver and it take also two days to make of it a stable version version, you can be more confident with my
Parallel archiver version1.06 now, cause i have stress tested it.

And i will soon extended more...

You can download my Parallel archiver from:

http://pages.videotron.com/aminer/


Thank you,
Amine Moulay Ramdane.




 
 

aminer

  • Hero Member
  • *****
  • Posts: 956
Re: Parallel archiver using my ParallelZlib..
« Reply #35 on: February 20, 2013, 02:39:59 pm »

Hello,

I didn't counted the lines of code of my ParallelZlib ,
so it's almost 3000 lines of code (PZarchiver.pas + ParallelZlib.pas) and it took me two days to implement Parallel archiver and to make a stable version of it. You can be more confident with my Parallel archiver version 1.06 cause i have stress tested it.


I will soon extended it more, so enjoy it...





Thank's,
Amine Moulay Ramdane.   


 

TinyPortal © 2005-2018