Hi Rene,
The text was the Genesis (13kB).Rather small, but I believe, my method will reduce h2 significantly - especially with the sort -u option.Without -u the h2 goes up to 2.45.
And yes, a dictionary approach will help, even some special characters (gallows!?) would give some hints, how to interpret a word correctly.
Claus
-----Ursprüngliche Nachricht-----
Von: Rene Zandbergen [mailto:r_zandbergen@xxxxxxxxx]
Gesendet: Donnerstag, 7. August 2003 13:43
An: vms-list@xxxxxxxxxxx
Betreff: Re: VMs: Reducing the 2nd order entropy by sorting within words
I once did something similar, but with the
additional rule that the resulting word had
alternating consonants and vowels, i.e. the
two were sorted separately and then interleaved.
In that case, the h2 was still a bit high for
Voynichese. (Your value seems rather low, and it
is necessary to use a large enough sample to get
a good value).
The ambiguity is not such a big problem. One
can make a dictionary of original and encrypted
words, and only in a fraction of all cases there
are different words mapping onto the same PT word.
The dictionary would show them and context would be
sufficient to make a decision.
Cheers, Rene
--- "Anders, Claus" <Claus.Anders@xxxxxxxxxxxxx>
wrote:
> Just for fun I wrote a small awk program and let
> that work with some Latin
> text.It just sorts the characters with a word unique
> and guess what: the
> output h2 is as low as 2.277 (according to
> monkey).So, as the resulting
> words (no substition yet) are ambigious, I must find
> some way to enter some
> code, to make the reverse sorting possible.
> Seems, that sorting could be part of the encryption
> scheme.
> awk script:
> {
> o=sortw($1);
> for(i=2;i<=NF;i++)
> o=o " " sortw($i);
> print o;
> }
> function sortw(s)
> {
> print substr(s,1,1) > "tmpso";
> for(c=2;c<=length(s);c++)
> print substr(s,c,1) >> "tmpso";
> close("tmpso");
> cmd="sort -u tmpso";
> os=""
> while((cmd|getline x) >0)
> os=os x;
> close(cmd);
> return os;
> }
>
> Cheers
> Claus
>
__________________________________
Do you Yahoo!?
Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com ______________________________________________________________________
To unsubscribe, send mail to majordomo@xxxxxxxxxxx with a body saying: unsubscribe vms-list