[CWB] Indexing problems

[Eros Zanchetta]

 OK I figured it out: no bug, it's (sort of) my fault.

The line numbers are correct, but apparently you can't trust less to
jump to the correct line in a text file. I wrote a small script to count
the lines in the input file and now I can see that the error messages
are correct.

Thanks and sorry for the false alarm.

Eros

On 22/07/2010 15:46, Stefan Evert wrote:
>> Removing them solved most of my problems, I still get the syntax error
>> messages but they are probably caused by stray double quotes in the
>> attributes (line numbers are still not very helpful in identifying the
>> problem though...)
> They should be, though. :-/
>
> If you can spare a little time, could you test with cwb-encode from the 3.0.0 release, please?  The only possible explanation I can think of is that buffer overflows from very long lines throw off cwb-encode's line counting.
>
> I seem to remember that the bug fix back then was triggered by spurious error messages like the one you got: if the <text ...> line is very long, it doesn't fit into the line input buffer, and the incomplete tag is reported as a syntax error by the attribute parser.  If there's a real bug hiding behind your problems, though, I'd like to investigate and fix it.
>
> Cheers,
> Stefan
>
> _______________________________________________
> CWB mailing list
> CWB at sslmit.unibo.it
> http://devel.sslmit.unibo.it/mailman/listinfo/cwb
>