... startfiles ....

[indiana_jones]

soon after i made my posting about "startfiles" to the morpheus
forum , it got nuked and everthing was lost.

since I think that these startfiles are a simple but powerful way to
supply p2p sharing in favour of the user, I don't want it to be forgotten.
(The idea is not new at all, see http://www.museekster.com/index2.html)

If dont think, that this forum is the right place for it, please tell me.
Its a rather specific matter for fasttrack clients as Morpheus and Kazaa.

Startfiles are simply ".dat" files, as they are used by the clients to store
there search information.

Whats new now:
Since i don't like executable binaries, I wrote a perl script to create startfiles out
of the ".dbb" files. (1024k for now). It actually creates a .vbs script, which can be
reviewed and downloaded and which creates local .dat files.

Since the the script and dat files contain checksums and some file signatur they
offer some reliability that you get the correct file, which you do no have if you search
for it on the net. I will give some examples in a followup.

indy

[indiana_jones]

the attached zip contains the perl scripts used

perl gdat.pl perl-regex
searches the data1024.dbb for entry with perl-regex in filename
output is to stdout, you can redirect it to > xxx.vbs

perl csum.pl xxxx.dat
shows sum interesting parameters of a dat file

programming's just a bit quick and dirty.
i would appreciate if a perl programmer had a look at it.

indy.

[indiana_jones]

janis joplin for beta testing

[indiana_jones]

loreena mckennit for beta testing

[indiana_jones]

van morrison - no guru .... for beta testing

[goldie]

Originally posted by indiana_jones
janis joplin for beta testing

Kewl Dude!!

Gotta love Janis Joplin

GR
*edited to let ya know I'll try the "Janet" as soon as I complete some toughies I've got going at the moment. I thought this an excellent idea when you first introduced it!

I'm also happy to see you've got some singles (the van morrison (whole cd) is too long for my slow conn).

Good going!

[JackSpratts]

Originally posted by indiana_jones
soon after i made my posting about "startfiles" to the morpheus
forum , it got nuked and everthing was lost.

If dont think, that this forum is the right place for it, please tell me.
Its a rather specific matter for fasttrack clients as Morpheus and Kazaa.

it's perfect here indy, it's what peer-to-peer is all about. thanks.

- js.

[Snarkridden]

Well Done Indiana- Was following your theme on Morph, when it got nuked, great idea to re-post it on here, especially with the downloadable feature this board provides.

Here is another little trick that morpheus users may not know, to help you find who is contactable for downloads, browsing their files etc, Been around a while, but deliberately kept quiet, time to spill the beans after the way things have happened I reckon..

So, what to do? enter this phrase in the search box resume.dat

Start a search everything, you will see everybody that your system and super nodes can see, select a user, right click and do a get more from USER, this allows you to browse, wait for the list to finish before you try a column sort, Morpheus sometimes freeks out on sorting un-finshed lists.

Only problem is the single search screen, so you have to search all over again for the next list, but it does allow you to browse, and have a good look at whats there, even if you mate is connected.

Give it a try, but don't say I told you so, if it bombs your system?

Snark.

[Dawn]

This is somewhat unrelated here, but I was getting some movies from Morph, I screwed up (again ), and lost them.

I restarted the downloads on Morph, then went to iMesh to get the exact same things. The downloads on iMesh are coming 10 times faster than on Morph.

Once again, thanks to napho.

[JackSpratts]

Originally posted by Snarkridden
...enter this phrase in the search box resume.dat

Start a search everything, you will see everybody that your system and super nodes can see, select a user, right click and do a get more from USER, this allows you to browse...

great tip snark, truly, and an easy one anybody can try. anymore like that back home?

- js.

[Snarkridden]

I restarted the downloads on Morph, then went to iMesh to get the exact same things. The downloads on iMesh are coming 10 times faster than on Morph.


Sounds like Port capping at your ISP Dawn, Morpheus uses 1214 I think, don't know what port the iMESH client uses, anyone?

Snark.

[Dawn]

Well Snark, I am quite blonde, but as far as I can tell, iMesh is also connected out on 1214.

[Kewbase]

Time to join the discussion about the startfiles that I have introduced at my website http://www.museekster.com.

I am impressed by the job that Indiana has done. I must confess that the way I make startfiles is less sophisticated.

This is how I do it.

Once I have discovered a high quality file, I again run a search with Grokster. After the identical file has shown up in my searchresults I cut off my internetconnection and hit the download button. Of course the download will not start but Grokster creates a datfile in your downloadfolder. That file is your startfile and ready for use.
The datfile is filled with a part of your free disk space and data like the usernames, filename and destination folder.

The free disk space that is included in this datfile may contain strange things.
Free disk space is not clean. It contains parts of files that have been deleted. When making a startfile this erased data becomes “active”. Part of video and music files are brought back to life. In a worst case scenario even a deleted virus can get activated and you spread it all around the planet in your startfile. Furthermore this data may prevent compressing the startfile to the smallest possible size.

I keep my free disk space clean with a utility called Eraser.
Eraser can be found at http://www.tolvanen.com/eraser/

One thing I have not figured out is how to edit these datfiles.
For instance changing the path or deleting usernames would be nice.
The datfiles can be opened with wordpad or a hexeditor but every change in the file is deadly. Maybe Indiana has a solution for this.


BTW. Nice board! The attachments option makes it a great place for exchanging startfiles.

[indiana_jones]

the primary idea was, that the creator extrcts the startfiles,
posts them in the forum (best as text files) and everybody can copy them
and d/l the correct files from the start, or someone has verified files
and makes this afterwards.

why i preferred a forum is, that comments can be posted, if
something is good or bad or even a fake.

the .dat files contain a few things to "protect" the d/l mechnism.
(just like those old tombs - i'm used to )
what i think, there is a long (16/20) byte signature (MD5 like) which
is actually used together with filzesize to find a file - it corresponds
to a parameter which is in the .dbb file too.

the . dat file itself is protected by a 4 byte checksum
(the info how it works i got from a ex- morph forum poster)
if the checksum is somehow wrong, the .dat is deleted after
startup. therfore you cannot just edit the .dat.
the algorithm how to recalculate the checksum is contained in
the perl script in my second posting in this thread.

in principle, you just need filesize and signature to find a file
- and some script or program which makes a .dat out of it.

indy

[JohnDoe345]

Hey, indiana_jones hopefully you've received my reply to your email. The startfiles are a good idea and I hope you continue with them. What users can also start doing is to give startfiles to each other through AIM, ICQ, etc.

I'm sure many users use AIM, for example, while they are on Morpheus. If startfiles become common knowledge then they could easily give them to their friends. And if you can't trust your friends to give you the correct files.......What we need to do is get the word out. Too bad the Morphues forums is currently down. I'm going to try and post some info about startfiles on my website and possibly link to other sites for more information. Do you know of any sites besides MuSeekster that explains startfiles?

You might have stated this, but how much of the file must be downloaded in order for it to work? All the dat files that I have recovered from a crash have been larger then 10 mb and they have resumed downloading without a problem.

[Kewbase]

Hi Johndoe.

Mind if I answer this? Startfiles are my invention basically. Indy took the creating of startfiles to a higher level.

Too bad I don't know a thing about perlscript so I have to stick to my own method.

They even work if you have downloaded nothing at all. Just check my post above. I contains a short how to.

I will soon add a manual in english on how to make startfiles to my website www.museekster.com.

As soon as there are more websites that offer startfiles I'll post them.

[indiana_jones]

I'm just working on modifying my script to become a "startfile.exe"
unfortunatly the zipped version will be larger than 400k an cannot be
posted here, so if anybody wants to try it, please pm me you email,
if it's ready i will send it to you.

it will be and command line application, to be started in the
command (or MSDOS) window and will say something like that:

C:\Morpheus>startfile
startfile 1.0.a 2002 by Indy
based on the startfile idea from kewbase at http://www.museekster.com/
enter "startfile" without any parameters to get some help!

Usage: startfile "pattern"
Searches the files .\Db\data1024.dbb and .\Db\data256.dbb
for entries with filename that contain "pattern"
and writes "kazaadownloadxyz.dat" files to folder ".\Startfiles"

The downloads will be to "C:\StartfileDownload", but you can change this
settings by editing the ".\startfile.ini"

"startfile" should be run from the Morpheus folder

Since the .dbb files are locked, when morpheus is running,
you must either close Morpheus or
copy the *.dbb files to *.dbb.1 files, which are searched alternatively.

"pattern" is a perl regular expression:
case sensitive
. means any character (\. means .)
.* zero or more, .+ one or more of any character
example: "Janis Joplin.+Baby.*\.mp3"
see i.e. http://www.dcs.qmul.ac.uk/publicatio...erlRegexp.html


This exe file was created with the evaluation version of Perl2Exe.
For more information visit http://www.indigostar.com
(The full version does not display this message with a 2 second delay.)
...

indy

... the future starts exactly ........ NOW!!!

[indiana_jones]

hi you all

dbb2dat.exe version 1.0.c

is available and produces startfiles, which at least are not at once deleted
by Morpheus.

additional alpha/beta/gamma tester are welcome.
cannot post the file here, because its to large, please pm your email address.

as an example I add the startfiles for an album from enya here.
the zip contains also .txt files, which hold the signature and file size.

because that's my next step:

sig2dat.exe

which can make a startfile from signature and filesize
when you see any on internet or get mailed you just type it in and get a .dat file.
such finding the correct files is done with a high reliabiltiy, but without searching.

filesize can easy be faked but the signature is 20 byte and calculated with a complex
algorithm - that means, if signature AND filesize are equal, it's as sure the same
as with fingerprint or genetic code.

i think, this would be interesting especially for movie and SW download.
maybe the signature could be also posted on that precious correct movie webbase

comments are welcome

indy

[AYB]

Hey indy, good stuff you got going here.

Where does the signature come in? Where is it in the DAT file? Do you know how to calculate it?

[indiana_jones]

hi AYB, glad to see you.

I must admit the "signature" is a little bit of a guess.
I read about fasttrack using some MD5 (additionally to your info) to
identify files.

see the "red" parameter type 3 below, same thing
in every dat. same string also in the .dbb file after download.

since MD5 sig is 16 Byte, I guessed it's something like that.
other parms, one can identify as some strings.
there are other binary values, which i do not know, what they mean.
some of them are some flags, for sure.

perl MD5 calculates a different result, but that doesn't say much. its
the only string in the .dbb, if there is nothing else.

indy


# ============================================================ ===
File: .\Startfiles\kazaadownload-Enya - Shepherd Moons - 04 - Ebuda.mp3.dat
Size of dat: 102922
Pointer: 420
CheckSum calculated: 17912884
CheckSum from File: 17912884
00000000
Sources: 1
# -- ---------------------------------------------------------------
Filename: Enya - Shepherd Moons - 04 - Ebuda.mp3 00 00
0e 3a 00 00 c3 0a 13 64 a8 24 53 55 2e 45 47 3d <.:.....d.$SU.EG=>
65 bd 02 77 4d af f6 83 <e..wM...>
Filesize: 2455731 [2398.174805] 002578b3
IP:Port, IP:Port: 206.142.53.203:1214, 137.73.4.105:1214
User: a1234@MusicCity.com 00
00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 <................>
00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 <................>
00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 <................>
00 00 00 01 00 00 00 00 00 00 00 01 00 00 00 00 <................>
00 00 00 01 00 00 00 00 00 00 01 <...........>
# -- ---------------------------------------------------------------
Parameters: 6
Parameter Type 4 Length 6:
45 62 75 64 61 00 <Ebuda.>
Parameter Type 6 Length 5:
45 6e 79 61 00 <Enya.>
Parameter Type 8 Length 15:
53 68 65 70 68 65 72 64 20 4d 6f 6f 6e 73 00 <Shepherd Moons.>
Parameter Type 14 Length 8:
4e 65 77 20 41 67 65 00 <New Age.>
Parameter Type 26 Length 26:
45 41 43 20 2d 20 20 4c 61 6d 65 20 2d 2d 72 33 <EAC - Lame --r3>
6d 69 78 20 2d 62 31 31 32 00 <mix -b112.>
Parameter Type 3 Length 20:
c3 0a 13 64 a8 24 53 55 2e 45 47 3d 65 bd 02 77 <...d.$SU.EG=e..w>
4d af f6 83 <M...>
00 00 00 00 ff ff ff ff 00 00 00 00 <............>
Path: C:\StartfileDownload\Enya - Shepherd Moons - 04 - Ebuda.mp3 00
00 00 00 00 01 00 00 00 00 00 00 00 ff ff ff ff <................>
b3 78 25 00 00 00 00 00 00 00 00 00 00 4b 41 5a <.x%..........KAZ>
41 a4 01 84 28 91 17 <A...(..>
# == ========================================================