AltME groups: search

Here's a breakdown for any encoding (Pcode, XML, REBOL, whatever):

Portability:

You need to build or acquire a decoder or encoder, and third-party 
code would need to as well. Advantage: XML


Faster execution: The main way you get that is to make the model 
of your data format match your data model. If the match is close 
enough you can translate the data to your internal model in insignificant 
time, like EBML to XML, Rebin to REBOL, or CPU instructions. If your 
internal semantic model is simple enough you can quickly do a direct 
interpretation of the data, like older Pcode interpreters or the 
original Java byte code, or the micro-operations inside modern CPUs.


In the case of REBOL, we have it easy because REBOL is primarily 
a data model. All we have to do is encode that data in an efficient 
binary format and then decode that format to the memory model. That's 
Rebin, the proposed Pcode of REBOL.


In the case of XML, it is slightly more difficult because there are 
competing binary encodings, and none of those will be supported in 
a web browser until it wins the format war. EBML is like a Zip for 
the XML data model, rather than its syntax (similar compression algorithm 
too) - much faster than unzipping XML and parsing it. The main problem 
is that only Matroska decoders support it right now - no web browsers. 
Similar constraints exist for the other binary encodings of XML.


In the case of SVG, we are much less lucky. SVG has its own data 
model on top of the XML data model. Once you decode the XML from 
whatever format it was encoded in, you end up with data of the XML 
model - then you have to interpret that data to get a dataset in 
the SVG model, much like the relation between REBOL and the Draw 
dialect. There may be some advantage to coming up with a Pcode for 
SVG.


The main thing that you need to keep in mind is that your Postscript 
experience is throwing you off: The semantic models of modern graphic 
formats are declarative, not programmatic - this was the main change 
between Postscript and PDF. A Pcode for a modern graphic model would 
not be executed like code, it would be loaded as data.

maybe it's a matter of url encoding to retrieve those files? the 
upload seemed to work.

ok - it was the progressive encoding i used on the jpeg it seems 
- reposting with standard encoding - blame photoshop :)

PeterWood, that string encoding doc and functions look very useful. 
Nice work.

Does anybody know what character encoding AltME uses uner Mac? It 
is clearly different from the one used in Windows.

ah, the difference is:

Content-Type: image/jpeg; name="2.jpg"
Content-Transfer-Encoding: base64
Content-Disposition: inline; filename="2.jpg"

--__REBOL--View--1.3.2.3.1--5318724__
Content-Type: application/octet-stream; name="bay.jpg"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="bay.jpg"

make-mime-header: func [file] [
        net-utils/export context [

            Content-Type: join {application/octet-stream; name="} [file {"}]
            Content-Transfer-Encoding: "base64"

            Content-Disposition: join {attachment; filename="} [file {"
}]
        ]
    ]

I was processing a Chinese text file using REBOL. The text file was 
in the Big5 Encoding, which is the de facto encoding we use in Taiwan. 
A Big5 character needs two bytes, so I used strings whose length 
is 2 to present Big5 characters. 


Something weird happened. After a while, I realized that REBOL treated 
two different characters as they were the same character.


Chinese-char1: to-string #{A4 68} ; Big5 Char for "Educated Person"
Chinese-char2: to-string #{A4 48} ; Big5 Char for "Human"

if Chinese-char1 = Chinese-char2 [
    print "This cannot not be happening..."
]
How would I fix my REBOL scrip? Thank you.

That's interesting, using a bit in each byte to "escape" and open 
up the next, more significant byte. So it's a variable-length encoding 
scheme. (I guess, kind of like UTF8)

Does the following line only work with e-mail?

system/options/binary-base: 64  ; best binary encoding

This is the client; put it in the folder containing the files you 
want to send.

rebol []
ip: request-text/title/default "IP Address: " "localhost"
port-num: request-text/title/default "Port Number: " "2006"
url: to-url rejoin ["tcp://" ip ":" port-num]
system/options/binary-base: 64  ; best binary encoding


print ["This program SENDS all files in its folder to receive-files-tcp." 
newline]
print "NOTE: receive-files-tcp must be running on the remote"
print ["computer before starting this program." newline]

files: read %. ; Note that 'files is a block of file names.
save %file-names files
server: open url

insert server compress as-binary read/binary %file-names ;send file 
names
file-block: []
foreach file files [
    if not find file "/" [insert file-block file] ;remove folders
]
files: file-block
foreach file files [
    insert server compress as-binary read/binary file
    print ["Successfully sent file: " file]
]
close server

ask [newline "The files transfer is complete. Press <Enter> to close."]

This project aims to propose a standard LDAP support for REBOL/Core 
by implementing the LDAP protocol using REBOL schemes (ldap://), 
so standard functions like open, insert, find, remove,... can be 
used directly on the port.


The implementation is an on-going work and has been suspended for 
some months now (due to higher priority projects). The current alpha 
supports the following features : 
BER encoding/decoding logic.
REBOL dialect for BER structures representation.
Basic LDAP v3 protocol.
Searching for record using a high level dialect
Port handler implemented.
What's not currently implemented: 
Clean and reliable low-level I/O.
Full v2/v3 protocol support.
Adding, Modifying, Deleting data.
Authentication.

The current work has been done following the classic REBOL port! 
communication model, that means : synchronous communications. There's 
great chances that I choose to port the current work under Uniserve 
to benefit from a full async model and not push the sync version 
to the end...

BTW, I noticed that rebol.org serves pages in utf-8 encoding, but 
the scripts themselves are latin-1. This is not a problem for the 
code, but it is a problem for the comments, which may contain accented 
characters. For example, names of authors (hint: Robert Müench), 
and they consequently appear garbled. I'm not saying pages should 
be served as latin-1, on the contrary, I am an utf-8 enthusiast, 
I think rebol scripts themselves should be encoded as utf-8, (it 
is possible with python, for example). I hope Rebol3 will be an all 
encompassing utf-8 system (am I dreaming?).

I am working on sript, that composes and sends html e-mail.

It is rather simple, but now I would like that e-mail will contain 
inline images.

I found out that they are multipart messages, and that image is referenced 
with cid in html image and in image part it is marked as Content-ID:

</HEAD>
<BODY bgColor=3D#ffffff>

<DIV><FONT face=3D"Courier New" size=3D2></FONT><IMG height=3D47=20
src=3D"cid:26DB76551F2E4591BBC3B599C3A7CCAE" width=3D320></DIV>
<DIV><FONT face=3D"Courier New" size=3D2></FONT>&nbsp;</DIV>
</BODY></HTML>

------=_NextPart_001_00A9_01C8DAAB.A817E460--

------=_NextPart_000_00A8_01C8DAAB.A817E460
Content-Type: image/bmp;
	name="ML.bmp"
Content-Transfer-Encoding: base64
Content-ID: <26DB76551F2E4591BBC3B599C3A7CCAE>


Qk22vQEAAAAAADYAAAAoAAAADwIAAEgAAAABABgAAAAAAIC9AQDEDgAAxA4AAAAAAAAAAAAA////

////////////////////////////////////////////////////////////////////////////

How to implement such html e-mail generation in rebol script?

you must work solely from the encoding in the file. intermixing input 
from the console will ruin that. I will post an example in a minute.

what I would do is get the offending chars from your file in a text 
editor and paste them in a separate file and save it in the same 
encoding as the original file. then read/binary it with rebol, and 
you can see the hex values directly.

The file! and url! types use url-encoding for their literals. At 
least with files you can quote them.

kib2: "Does that mean that we can use unicode encoding with the help 
of r2-forward ?"

No, I only can only spoof datatypes that don't exist in R2, and R2 
has a string! type. The code should be equivalent if the characters 
in the string are limited to the first 256 codepoints of Unicode 
(aka Latin-1), though only the first 128 codepoints (aka ASCII) can 
be converted from binary! to string and have the binary data be the 
same as minimized UTF-8.

Gregg: The table is great thanks. 


One small question, that started this thread, is char! compatible 
with integer! when:

>> same? #"1" 1

== false

>> same?
 #"1" 49

== true


The behaviour make sense based on an understading of character encoding 
but may appear incorrect at a higher level.

the binary and character lengths of strings aren't the same thing, 
depending on the encoding of strings.

What could cause font script(encoding) change from f.ex. baltics 
to western  when downloading and running scripts on other computer.

In this case I am getting language specific symbols displayed like 
the font encoding scipt is Western while I need Baltics.

At the same time I had no problem, when I called the same layout 
script in office.
Problem appears when I am at home connected to office via VPN.
Rebol view console font encoding script is set to Baltics.

I am trying to understand why my font encodings is diffrent on my 
job laptop and on my home desktop. Both have the same OS - WinXP. 
Rebol script is the same sitting on the webserver. I did not specified 
any specific font in my script.

I did not find yet anything in docs about what is responsible for 
font encoding.

What I found with AnaMonitor is that arial font is used. 

But it seams that problem is not there. I just downloded that script 
localy and it looks like encoding is changed in script by downloading 
but not font encoding paramer !?

But why it changes when I am downloading to my desktop but not -when 
to my laptop?

I once (in 1999) create a RemoteCanvas class in Java (sorry for that), 
it used the encoding that VNC has invented. I forgot the name, but 
it is fairly easy to implement (especially with rebcode ;-)

From the liitle time I've spent looking at the rebol.org system in 
respect of converting it to R3, the code changes required seem to 
be very small (I've only looked at the cgi and core code, no View 
or VID).


The biggest problem would seem to be the  need to change the source 
code to UTF-8. MUch of the rebol.org code is pretty old and was written 
without attention to string encoding. The newer code is mainly ISO-8859-1 
"aware" and seems to be ISO-8859-1encoded. Some of the Rebol.org 
code won't load in R3 because it contains invalid UTF-8 characters. 
Changing the source encoding is trivial but with that comes the need 
to change all the data stored in Rebol.org to UTF-8 for it to be 
processed properly.

So Joanna, if you make sure that you always use UTF-8 encoding with 
Rebol 2 you should find few problems in later migrating to Rebol 
3.

i.e. a string is either coming from a source file, then you have 
the source file's encoding. or it's coming from another input, then 
you'll have to explicitly decode from binary. or it's created programmatically, 
then you have the codepoint values

You never notice this (and in fact, don't need to know), because 
strings are always converted on i/o. to binary! string will convert 
it to UTF-8. other i/o will convert it to the platform's standard 
encoding (UTF-8 on Mac and Linux, UTF-16 on Windows)

Hello - hope someone can find the newbie mistake I'm making here. 
 Wanted to use REBOL to tackle a need to get data from Salesforce 
using their SOAP API.  New to SOAP, WSDL and Salesforce, but using 
SoapUI mananged to do this POST (edited only to hide personal info):

POST https://login.salesforce.com/services/Soap/u/19.0HTTP/1.1
Accept-Encoding: gzip,deflate
Content-Type: text/xml;charset=UTF-8
SOAPAction: ""
User-Agent: Jakarta Commons-HttpClient/3.1
Host: login.salesforce.com
Content-Length: 525


<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:urn="urn:partner.soap.sforce.com">
   <soapenv:Header>
      <urn:CallOptions>
         <urn:client></urn:client>
         <urn:defaultNamespace></urn:defaultNamespace>
      </urn:CallOptions>
   </soapenv:Header>
   <soapenv:Body>
      <urn:login>
         <urn:username>[jort-:-xxxxxxxxxxxxx-:-com]</urn:username>

         <urn:password>xxxxxxxxxx78l6g7iFac5uaviDnJLFxxxxx</urn:password>
      </urn:login>
   </soapenv:Body>
</soapenv:Envelope>

and get the desired response:

HTTP/1.1 200 OK
Server: 
Content-Encoding: gzip
Content-Type: text/xml; charset=utf-8
Content-Length: 736
Date: Fri, 02 Jul 2010 20:32:14 GMT


<?xml version="1.0" encoding="UTF-8"?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns="urn:partner.soap.sforce.com" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><loginResponse> 
......

Then using SoapUI I am able to send a successful Logout message.


Using REBOL 2.7.7.3.1, I created an "upload" string containing the 
POST block above without the "POST " at the beginning, set my url 
to:

>> url
== https://login.salesforce.com/services/Soap/u/19.0

and tried this:

>> response: read/custom url reduce ['POST upload]

but consistently get a Server 500 error:


** User Error: Error.  Target url: https://login.salesforce.com:443/services/Soap/u/19.0 
could not be retrieved.  Se
rver response: HTTP...
** Near: response: read/custom url reduce ['POST upload]

For completeness, here's the upload value:

>> print mold upload
{https://login.salesforce.com/services/Soap/u/19.0HTTP/1.1
Accept-Encoding: gzip,deflate
Content-Type: text/xml;charset=UTF-8
SOAPAction: ""
User-Agent: Jakarta Commons-HttpClient/3.1
Host: login.salesforce.com
Content-Length: 525


<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:urn="urn:partner.soap.sforce.com">

   <soapenv:Header>
      <urn:CallOptions>
         <urn:client></urn:client>
         <urn:defaultNamespace></urn:defaultNamespace>
      </urn:CallOptions>
   </soapenv:Header>
   <soapenv:Body>
      <urn:login>
         <urn:username>[jort-:-researchpoint-:-com]</urn:username>

         <urn:password>metrics12378l6g7iFac5uaviDnJLFVprDl</urn:password>
      </urn:login>
   </soapenv:Body>
</soapenv:Envelope>}

Would appreciate any help you can give!

Thanks for anwers!

I don't know any thing about PDF, but I did couple functions for 
encoding conversation.

Could it be a "quick hack" or it requires good background of PDF 
format ?

it might be a quick hack, but i need to check the docs for PDF... 
but IIRC for an encoding different from the default you need to provide 
a char table or something like that...

my plan is to eventually have that in version 2 (a first release 
of version 2 is due in a couple weeks). however, note that while 
the pdf format directly supports latin1 encoding, it does not support 
unicode encodings directly. so it's a pain to make it work. openoffice, 
for example, creates divides the characters you use in the document 
in groups of 256, then creates a new custom font for each group. 
(i also assume that the 14 standard fonts do not support unicode, 
so you need custom font support to be able to use unicode.)

Can I use scripts of Oldes to get right encoding output of pdf from 
pdfMaker?

It seems that Rebol uses for my Win platform Win1257. 

In which encoding should I convert text for input to pdfMaker to 
get right accentuated characters in pdf generated by pdf maker?

the pdf format only supports adobe encoding, windows encoding and 
mac encoding. the pdf maker only uses windows encoding (which is 
basically latin1).

and which windows encoding? Maybe can janeks just set some flag or 
something which specifies his encoding in the file.

oldes: unfortunately, no. he has to specify the encoding in the font 
description. the only "built-in" encodings are Adobe, WinANSI (latin1) 
and Mac. I think adobe is a variant of latin1.

to support unicode you have to create a multibyte encoding for the 
fonts, and the spec does not give any detail on how this works.

so i will either need to figure out how to create a font encoding 
description that works for utf-16 (but i guess it would require a 
huge table, and so would make the documents big), or i'll need to 
use the same technique as OO

non-ascii: the only supported encoding so far is latin1 (basically... 
more precisely i think i have it set to the Windows variation, which 
iirc is windows-1252) - that is, the same that View uses on western 
Windows installations.

unfortunately the PDF format does not have direct support for encodings 
except for the default windows encoding, the default mac encoding, 
and an adobe encoding; they are all variations of latin1.

yes, we just started to suspect that what you said about encoding

if i ever get to the point of adding support for custom fonts, then 
i might be able to also give the fonts any encoding.

( but encoding is 100x bigger problem for me )

do you think that /Encoding /Differences [
200 /Ccaron
232 /ccaron
] 

doesn't work because it's PDF-1.3  and in that example it's PDF 1.6, 
maybe this is more recent feature?

I tried that and nothing happened then I changed the encoding object 
headers to <<
/Type /Encoding
/BaseEncoding /WinAnsiEncoding
/Differences [
and got error while opening (18)

I found an example of PDF from Haru library which uses all ISO8859 
encoding 1 - 20 ... it is version PDF-1.3 , it does use the /Differences 
for each encoding, it also defines widths for them, I intend to look 
at it and somehow transfer it to pdf-maker .. but I am not sure how 
successfull I will be as pdf-maker seems quite complex beast

It's not possible to use utf8 encoding with pdf-maker ?

Yes... I would need latin2 encoding as well. So I hope you will solve 
it before I would like to use it:)

let me know if you find out that a new version of the format supports 
unicode or that there is a simple way to implement it. to me it looks 
like the only way would be to create your own 1 or 2 byte encoding 
with the glyphs you use, or to do like OpenOffice does - it creates 
a separate font for each set of 256 different characters and then 
selects the correct font for each character.

<?xml version="1.0" encoding="utf-8" ?> 

- <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:xsd="http://www.w3.org/2001/XMLSchema"xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
- <soapenv:Body>

- <ns1:getSpellingSuggestionsResponse soapenv:encodingStyle="http://schemas.xmlsoap.org/soap/encoding/"
xmlns:ns1="http://db.rxnorm.nlm.nih.gov">

- <getSpellingSuggestionsReturn soapenc:arrayType="soapenc:string[4]" 
xsi:type="soapenc:Array" xmlns:soapenc="http://schemas.xmlsoap.org/soap/encoding/">

  <getSpellingSuggestionsReturn xsi:type="soapenc:string">Penicillin 
  G</getSpellingSuggestionsReturn> 

  <getSpellingSuggestionsReturn xsi:type="soapenc:string">Penicillin 
  V</getSpellingSuggestionsReturn> 

  <getSpellingSuggestionsReturn xsi:type="soapenc:string">Penicillamine</getSpellingSuggestionsReturn> 

  <getSpellingSuggestionsReturn xsi:type="soapenc:string">Polycillin</getSpellingSuggestionsReturn> 
  </getSpellingSuggestionsReturn>
  </ns1:getSpellingSuggestionsResponse>
  </soapenv:Body>
  </soapenv:Envelope>

Yes, but that is a real conversion, with encoding and decoding.

It would be like run-length encoding your explicit stack.

I swear, it seems like he writes his code using a literate encoding 
engine so that he can remember what it does. Write-only code.

even with a complement bit, if you use a few chained union's & complements, 
etc, you'll eventually need to bake it... in the end, all the complement 
bit is usefull for is to keep the charset to below half the maximum 
size of the complete encoding.

I get whats happening now.  If i compare buffer and file I see the 
clipped text:

>> probe file
== "index.html"

>> probe buffer
{GET /a.html HTTP/1.1
Host: localhost

User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/531.21.8 
(KHTML, like Gecko) Version/4.0.4 Safar
i/531.21.10

Accept: application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
Accept-Language: en-US
Accept-Encoding: gzip, deflate
Connection: keep-alive
Address: 127.0.0.1}

>>probe parse buffer ["get" ["http" | "/ " | copy file to " "]]
== false

>> probe file
== "/a.html"
 
Should I have been able to see the results instead of  == false?

There's also an alternative approach, the SQL-ESCAPE encoding function 
of MySQL driver is exported in the global context, so you can use 
it when forming SQL queries directly :

send-sql db join "UPDATE table SET field=" sql-escape string


The prepared statement approach is recommended, because the driver 
will care about that for you automatically (so less risks that you 
forget to encode one value, opening a hole for SQL injection attacks).

At least, the whole networking support needs probably to be fully 
rewritten for R3. Beyond that I'm not sure what you work or not out 
of the box with R3. String encoding and Unicode might require some 
additional code. MD5 support is also required btw, if you want to 
use passwords with 4.1+ MySQL servers (for 3.x support, you would 
need to rewrite the whole current driver encryption code).

http://www.json.org/json.rwill help you with the encoding.

Also note that the above approach with CONCAT/GROUP_CONCAT does not 
help you with JSON-specific encoding. So changes to you'll in fact 
create wrong JSON are rather high.

What console is he running?  Under Konsole the list of encodings 
is overwhelming.  (From the Settings menu).

If it's xterm, then ... I dunno, but regardless, if it is xterm or 
other, drop a note and we'll track down an appropriate place to tweak 
the default encoding used by his REBOL console (whatever terminal 
he uses) session.


It might be easier (some gui menu), but it could well look something 
like

XTerm*locale: true

XTerm*font:             -misc-fixed-medium-r-normal--20-200-75-75-c-100-iso10646-1

in an X config file


From the root text console for REBOL/Core, we'd have to look into 
that as well; been there, kinda done that, too many details, forget 
all details, but keep foggy clue where to start looking ...  :)

(type the chars you want to see the encoding for, then enter, then 
CTRL-D)

(type the char you want to see the encoding for, REBOL will give 
you the binary encoding)

What is the character encoding expected by View under Linux?

Well, in Rebol/View 2.7.6.4.2, I can paste the multiply sign (copied 
from ascii-math.r) straight into the console and it shows correctly. 
In a field, however, it shows incorrectly, eg. if I try to paste 
it in the field:
	view layout [f: field]
I get two characters,  'Ã' and a dotted box, displayed instead.

The binary information is correct, it's just not rendered correctly, 
for if back in the console I do:
	probe f/text
then I get the multiply symbol displayed correctly again.

So it looks like View face/text rendering is expecting 8-bit ascii 
of some encoding.
Probably ISO/IEC_8859-1

Yes, it will be an 8-bit single character encoding system. I believe 
on Windows, it is the system default CodePage and on Mac it is MacRoman. 


Your message shows the 'square-root' sign in AltME on a Mac and 'Capital 
A with a tilde on top: in Windows.


Perhaps you could describe the first of the two characters displayed.

Does anybody know the character encoding used by Rebol/View under 
Linux?

Robert, afaik file names are utf8 by default on ext filesystems. 
(actually i think the filesystem does not care much about the encoding, 
but the os in general uses utf8.) i think you need that option on 
the ntfs filesystem, not the ext one.

Graham, the problem with url-encoding is not at the protocol level, 
it's at the URL! type parsing level. REBOL decodes characters at 
the wrong time.

this is a fix
 - no, because the %40 is converted to @

It might work if you do use %2540 (double encoding)...

20 years ago Wav and Midi format where the only ones now in day you 
have more than 10 sound encoding format ....  An alternative could 
be to traslate systematically the what ever encoded sound file to 
a WAV one and then play it but franckly do you thing people that 
are using a jukebox software (like winamp for example) will accept 
1) to wait 5 minutes for theire files to be translated then have 
a poor audio quality ???

Ok, so here it is:

-fixed image keying bug (swapped color components in keying tuple!)
-line width is now now changing according to scale

-fixed rendering of transformed images(now uses aplha premultiplied 
data)

-fixed LINE-PATTERN bug (multiple line patterns in DRAW block should 
work properly now)

-fixed MATRIX bug(wrong matrix calcualtion was corrected in this 
case)

-fixed SKEW command inconsistency (now it takes degrees as arguments 
instead of radians)

-fixed FILL-PEN bug when filling images (now it doesn't render images 
upside down)

-fixed ANTI-ALIAS cmd(now it is possible to switch this mode within 
one DRAW block)

-removed POP command (was obsolete, PUSH with block! arg is used 
instead)
-fixed fill/outline pixel aligning problem
-fixed visual bug when rendering circle with line-width > 1
-fixed text character encoding problem
-improved gradients: added REFLECT and REPEAT modes, example:
view layout [
	origin 0
	box 400x460 effect [
		draw [
			pen none
			fill-pen linear 10x10 0 190 0 1 1 black red green blue black
			box 10x10 390x90

   fill-pen linear 10x160 0 190 0 1 1 black red green blue black repeat
			box 10x100 390x180

   fill-pen linear 10x310 0 190 0 1 1 black red green blue black reflect
			box 10x190 390x270
			fill-pen radial 80x350 0 20 0 1 1 black red green blue black
			circle 80x350 70

   fill-pen radial 190x350 0 20 0 1 1 black red green blue black repeat
			circle 190x350 70

   fill-pen radial 320x350 0 20 0 1 1 black red green blue black reflect
			circle 320x350 70
		]
	]
]

a question - I have Windows app in cp-1250 encoding. Then I generate 
some html, which is server from Linux. When I look in Mozilla at 
the page source (http://www.jablunkovsko.cz), the browser displays 
some czech chars encoded, e.g. &aacute. But when I save the page 
locally on my Windows machine, I get correct czech chars ...

I saved page locally, and have still ´ I suppose it's fault 
 of WYSIWYG software made with english people in mind only (or not 
properly configured).

No need to encoding special chars this way if You have characters 
in declared encoding (that's what <meta http-equiv="Content-Type" 
for).

Then, you can try with HTTP chunked encoding (http://en.wikipedia.org/wiki/Chunked_transfer_encoding), 
it's the classic way to stream HTML to the browser. Having the page 
displayed while downloading chunks is browser specific. It's implemented 
in Cheyenne's HTTPd, but reading that wikipedia page makes me wonder 
if it still works with the new automatic HTTP compression introduced 
in 0.9.19 (haven't done regression tests for that case).

Does that mean that we can use unicode encoding with the help of 
r2-forward ?

I have published the string encoding utlilties that I wrote for rebol.org 
in the script library. They no doubt pale in comparison to those 
Gabriele has written but may help until his are finally released 
for publication.


The script package includes a minimal set of unit tests and some 
rudimentary documentation.

http://www.rebol.org/documentation.r?script=str-enc-utils.r

keep in mind that i will still record everything on tape and encode 
that later (maybe mpeg4, 2-pass encoding)

we'll be on altme too, and i'll have skype on, and hopefully the 
video stream works... other than that, yes, editing and encoding 
takes a lot of time.

i'll be back home on tuesday 4th, and will start editing and encoding 
the keynote immediately. hopefully, it will be ready by 5th...

Just re-read Gabriele's message .. he said he would post the videos 
next week.  I guess he managed to find some processing power somewhere 
to shorten the encoding process.

(still reading here) hey, encoding does not take WEEKS. i will have 
ALL videos up this week. my mini mac can easily handle that. :)

Carl's keynote should be up in a few hours. still encoding it. i 
want to upload it with bittorrent so that you can start downloading 
it while i'm still uploading it.

finished encoding carl's keynote... 131.5 MB

Volker: he surely means encoding :-)

after transfer we have encoding.

encoding BEER... will finish in about 2 hours.

Encoding Maarten's now.

encoding gregg's dialects right now

cheap digital camera (samsung vp-d101), Apple's iMovie for editing 
and encoding.

Yes, I thought about using transcode in linux. It's a shame all the 
variations don't make MP4 use as smooth as it could be. e.g. on Linux 
Fedora4 I could only get audio+video for your experimental encoding 
(trips to rome .. BTW, what is the band playing the background music 
?) . For the other files I could only get video but no audio so I 
had to check it in windows XP SP1 (where latest quicktime  and media 
player wouldn't play them (quicktime said incompatible profile) but 
an old VLC release played them fine)

For the encoding, I was asking this because all my accented chars 
in HTML appear correctly but one, the "à".

REBOL[]


send: func [
	"Send a message to an address (or block of addresses)"
	;Note - will also be used with REBOL protocol later.
	address [email! block!] "An address or block of addresses"
	message "Text of message. First line is subject."
	/only   "Send only one message to multiple addresses"
	/header "Supply your own custom header"
	header-obj [object!] "The header to use"
	/attach "Attach file, files, or [.. [filename data]]"
	files [file! block!] "The files to attach to the message"
	/subject "Set the subject of the message"
	subj "The subject line"
	/show "Show all recipients in the TO field"
	/local smtp-port boundary make-boundary tmp from
][
	make-boundary: does []

	if file? files [files: reduce [files]] ; make it a block
	if email? address [address: reduce [address]] ; make it a block
	message: either string? message [copy message] [mold message]

	if not header [                 ; Clone system default header
		header-obj: make system/standard/email [

   subject: any [subj copy/part message any [find message newline 50]]
		]
	]
	if subject [header-obj/subject: subj]
	either none? header-obj/from [

  if none? header-obj/from: from: system/user/email [net-error "Email 
  header not set: no from address"]
		if all [string? system/user/name not empty? system/user/name][
			header-obj/from: rejoin [system/user/name " <" from ">"]
		]
	][
		from: header-obj/from
	]
	if none? header-obj/to [
		header-obj/to: tmp: make string! 20
		if show [
			foreach email address [repend tmp [email ", "]]
			clear back back tail tmp
		]
	]
	if none? header-obj/date [header-obj/date: to-idate now]

	if attach [

  boundary: rejoin ["--__REBOL--" system/product "--" system/version 
  "--" checksum form now/precise "__"]
		header-obj/MIME-Version: "1.0"

  header-obj/content-type: join "multipart/mixed; boundary=" [{"} skip 
  boundary 2 {"}]
		message: build-attach-body message files boundary
	]

	;-- Send as an SMTP batch or individually addressed:
	smtp-port: open [scheme: 'esmtp]
	either only [ ; Only one message to multiple addrs
		address: copy address
		; remove non-email values
		remove-each value address [not email? :value]

  message: head insert insert tail net-utils/export header-obj newline 
  message
		insert smtp-port reduce [from address message]
	] [
		foreach addr address [
			if email? addr [
				if not show [insert clear header-obj/to addr]

    tmp: head insert insert tail net-utils/export header-obj newline 
    message
				insert smtp-port reduce [from reduce [addr] tmp]
			]
		]
	]
	close smtp-port
]

resend: func [
	"Relay a message"
	to from message /local smtp-port
][
	smtp-port: open [scheme: 'esmtp]
	insert smtp-port reduce [from reduce [to] message]
	close smtp-port
]

build-attach-body: function [
	{Return an email body with attached files.}
	body [string!] {The message body}

 files [block!] {List of files to send [%file1.r [%file2.r "data"]]}
	boundary [string!] {The boundary divider}
][
	make-mime-header
	break-lines
	file
	val
][
	make-mime-header: func [file] [
		net-utils/export context [

   Content-Type: join {application/octet-stream; name="} [file {"}]
			Content-Transfer-Encoding: "base64"

   Content-Disposition: join {attachment; filename="} [file {"^/}]
		]
	]
	break-lines: func [mesg data /at num] [
		num: any [num 72]
		while [not tail? data] [
			append mesg join copy/part data num #"^/"
			data: skip data num
		]
		mesg
	]
	if not empty? files [
		insert body reduce [boundary "^/Content-type: text/html^/^/"]
		append body "^/^/"
		if not parse files [
			some [
				(file: none)
				[
					set file file! (val: read/binary file)
					| into [
						set file file!
						set val skip ;anything allowed
						to end
					]
				] (
					if file [
						repend body [
							boundary "^/"
							make-mime-header any [find/last/tail file #"/" file]
						]
						val: either any-string? val [val] [mold :val]
						break-lines body enbase val
					]
				)
			]
		] [net-error "Cannot parse file list."]
		append body join boundary "--^/"
	]
	body
]

I'm just curious as to how they did it ...  to advocate using paper 
to backup data implies some dense encoding method

Louis: From what I can tell from DocBase; initially the unicode support 
will be that the Rebol source will be UTF-8 encoded. The next step 
seems to be changing string! to UTF-8 encoding.


It looks as though work hasn't yet started on the unicode! datatype.

Maybe encoding? ok, I'll try change encoding. one moment...

On the web site linked above in the Chunk-encoding section: transferts 
-> transfers

I found a possible bug in RSP yesterday: When RSP gets the values 
passed to it as get query parameters, it removes url-encoded html 
tags and comments from the values. This is not correct with values 
that come from a textarea, or probably other values as well. I haven't 
tested with multipart/form-data encoding yet.


This might be a setting change rather than a bug in RSP, but if so 
then show.rsp should be changed to not strip tags from values and 
then html-encode the values when shown.

I'll test it with Chrome too, seems that multipart encoding is not 
exactly the same as in IE. Does it work with FF?

Check if your FORM tags are using enctype="multipart/form-data" to 
indicate proper encoding for file uploading.

Same error after upgrading Chromium, here's the verbose 5 log of 
the request:


3/4-01:38:00.891-[HTTPd] ================== NEW REQUEST ==================

3/4-01:38:01.531-[HTTPd] Request Line=>POST /ecg/blah.rsp HTTP/1.1

3/4-01:38:02.109-[HTTPd] Trying phase method-support ( mod-static 
)

3/4-01:38:02.828-[HTTPd] Trying phase url-translate ( mod-static 
)
3/4-01:38:03.062-[uniserve] Calling >on-received< with {^M
Host: localhost:8080^M
Connection: keep-alive^M
Us}
3/4-01:38:03.547-[HTTPd] Request Headers=>
Host: localhost:8080
Connection: keep-alive

User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US) AppleWebKit/530.5 
(KHTML, like Gecko) Chrome/2.0.173.0 Safari/530.5
Referer: http://localhost:8080/ecg/blah.html
Content-Length: 153149
Cache-Control: max-age=0
Origin: http://localhost:8080

Content-Type: multipart/form-data; boundary=----WebKitFormBoundaryEv3SZArZWdjyznJZ

Accept: application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
Accept-Encoding: gzip,deflate,bzip2,sdch
Accept-Language: en-US,en;q=0.8
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3



3/4-01:38:03.797-[HTTPd] Trying phase url-to-filename ( mod-alias 
)
3/4-01:38:04.031-[HTTPd] => request processed
3/4-01:38:04.766-[HTTPd] Trying phase url-to-filename ( mod-rsp )
3/4-01:38:05-[HTTPd] => request processed

3/4-01:38:05.469-[HTTPd] Trying phase url-to-filename ( mod-internal 
)

3/4-01:38:05.719-[HTTPd] Trying phase url-to-filename ( mod-static 
)
3/4-01:38:05.969-[HTTPd] => request processed

3/4-01:38:06.453-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:06.703-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:06.953-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:07.437-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:07.906-[uniserve] >> Port: 3789, low-level reading: 19980

3/4-01:38:08.391-[uniserve] Calling >on-received< with "------WebKitFormBoundaryEv3SZArZWdjyznJZ^M^/Content-"

3/4-01:38:08.875-[uniserve] >> Port: 3789, low-level reading: 16680

3/4-01:38:09.344-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:09.844-[uniserve] >> Port: 3789, low-level reading: 17520

3/4-01:38:10.312-[uniserve] >> Port: 3789, low-level reading: 1149

3/4-01:38:10.797-[uniserve] Calling >on-received< with {037.17923" 
"4429 SUNNYSLOPE RD SW" "Port Orchard" }

3/4-01:38:11.266-## Error in [uniserve] : On-received call failed 
with error: make object! [
    code: 303
    type: 'script
    id: 'expect-arg
    arg1: 'insert
    arg2: 'series
    arg3: [series! port! bitset!]
    near: [insert/part tmp/port s skip e]
    where: 'process-bounded-content
] !
3/4-01:38:11.734-[uniserve] Port closed : 127.0.0.1