
<html>

  <head>

    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">

  </head>

  <body text="#000000" bgcolor="#FFFFFF">

    <div class="markdown-here-wrapper" data-md-url="Thunderbird"

      style="max-width: 40em;">

      <blockquote style="margin: 1.2em 0px;border-left: 4px solid

        rgb(221, 221, 221); padding: 0px 1em; color: rgb(119, 119, 119);

        quotes: none;">

        <p style="margin: 0px 0px 1.2em ! important;">how do you do it

          then, if not using <g>?</g></p>

      </blockquote>

      <p style="margin: 0px 0px 1.2em ! important;">I don’t :) I mostly

        work on spoken corpora, where the problem doesn’t arise. And

        even with written corpora, I think it’s a good idea to make

        tokenization as apparent as possible to users, as discussed

        previously. Though having a toggle for advanced users, as Vlado

        described it, can be a nice feature.</p>

      <p style="margin: 0px 0px 1.2em ! important;">D.</p>

      <div

title="MDH:Jmd0OyBob3cgZG8geW91IGRvIGl0IHRoZW4sIGlmIG5vdCB1c2luZyAmbHQ7Zy8mZ3Q7Pzxicj48YnI+SSBkb24ndCA6KSBJIG1vc3RseSB3b3JrIG9uIHNwb2tlbiBjb3Jwb3JhLCB3aGVyZSB0aGUg

cHJvYmxlbSBkb2Vzbid0IGFyaXNlLiBBbmQgZXZlbiB3aXRoIHdyaXR0ZW4gY29ycG9yYSwgSSB0

aGluayBpdCdzIGEgZ29vZCBpZGVhIHRvIG1ha2UgdG9rZW5pemF0aW9uIGFzIGFwcGFyZW50IGFz

IHBvc3NpYmxlIHRvIHVzZXJzLCBhcyBkaXNjdXNzZWQgcHJldmlvdXNseS4gVGhvdWdoIGhhdmlu

ZyBhIHRvZ2dsZSBmb3IgYWR2YW5jZWQgdXNlcnMsIGFzIFZsYWRvIGRlc2NyaWJlZCBpdCwgY2Fu

        IGJlIGEgbmljZSBmZWF0dXJlLjxicj48YnI+RC48YnI+"

style="height:0;width:0;max-height:0;max-width:0;overflow:hidden;font-size:0em;padding:0;margin:0;"></div>

    </div>

  </body>

</html>