[CWB] CQPWeb 3.2.11 autosetup MySQL error
Hardie, Andrew
a.hardie at lancaster.ac.uk
Thu May 26 23:46:07 CEST 2016
Note the error here is simply that too many warning messages were emitted during index setup to fit into the database field. The CWB indexes have in fact been successfully set up.
The syntax error it is reporting is due to the /. Empty XML elements aren't supported in the version of the CWB core you're using. (More recently I've added a fix to treat them as an alternative syntax for open tags, but not as true empty elements).
You need to either remove the / or recompile the CWB core from a checkout from the trunk.
In either case, each <pb> will be treated as being "closed" when the next <pb> is encountered.
OR, just leave <pb> out of the XML specification, and CWB will encode them as literal index tokens (issuing a much smaller number of warnings).
best
Andrew.
-----Original Message-----
From: cwb-bounces at sslmit.unibo.it [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Stephen Barrett
Sent: 26 May 2016 15:33
To: Open source development of the Corpus WorkBench
Subject: Re: [CWB] CQPWeb 3.2.11 autosetup MySQL error
Thanks Andrew.
I have now checked out the latest trunk and everything seemed to work with a small test corpus. When I try to add a larger (ca. 20 million words) corpus I get an error:
"A mySQL query did not run successfully!"
Followed by a long series of reported errors in the format:
" \nAttributes of open tag <pb ...> ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #x)."
(It looks like it could be one for every page number XML element.)
The XML page elements are in the form:
<pb n="1"/>
And were included in the small test corpus that did install successfully.
The backtrace (with the bulk of the repeated errors cut out) is listed below.
Cheers
Stevie
------
Error # 1153: Got a packet bigger than 'max_allowed_packet' bytes
PHP debugging backtrace
array(7) {
[1]=>
array(4) {
["file"]=>
string(60) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/library.inc.php"
["line"]=>
int(270)
["function"]=>
string(20) "exiterror_mysqlquery"
["args"]=>
array(3) {
[0]=>
&int(1153)
[1]=>
&string(51) "Got a packet bigger than 'max_allowed_packet' bytes"
[2]=>
&string(5931919) "update corpus_info set indexing_notes = '/usr/local/bin/cwb-encode -xsB -c utf8 -d /usr/local/cwbFiles_v2/cqpweb/dasg -f /usr/local/cwbFiles_v2/upload/corpusFile.txt -R \"/usr/local/cwbFiles_v2/registry/dasg\" -S text+id -S pb+n 2>&1\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #3).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #250).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #701).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #1109).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #1559).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #2003).
[....]
\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24075411).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24075807).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24076285).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24076697).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24077059).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24077484).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.txt, line #24077903).\nAttributes of open tag ignored because of syntax error (file /usr/local/cwbFiles_v2/upload/corpusFile.
txt, line #24077974).\nWarning: missing tag inserted at end of input.\n/usr/local/bin/cwb-makeall -r \"/usr/local/cwbFiles_v2/registry\" -V DASG 2>&1\n=== Makeall: processing corpus DASG ===\nRegistry directory: /usr/local/cwbFiles_v2/registry\nATTRIBUTE word\n + creating LEXSRT ... OK\n - lexicon OK\n + creating FREQS ... OK\n - frequencies OK\n - token stream OK\n + creating REVCIDX ... OK\n + creating REVCORP ... OK\n ? validating REVCORP ... OK\n - index OK\n========================================\n/usr/local/bin/cwb-huffcode -r \"/usr/local/cwbFiles_v2/registry\" -A DASG 2>&1\nCOMPRESSING TOKEN STREAM of DASG.word\n- writing code descriptor block to /usr/local/cwbFiles_v2/cqpweb/dasg/word.hcd\n- writing compressed item sequence to /usr/local/cwbFiles_v2/cqpweb/dasg/word.huf\n- writing sync (every 128 tokens) to /usr/local/cwbFiles_v2/cqpweb/dasg/word.huf.syn\nVALIDATING DASG.word\n- reading code descriptor block from /usr/local/cwbFiles_v2/cqpweb/dasg/wor
d.hcd\n- reading compressed item sequence from /usr/local/cwbFiles_v2/cqpweb/dasg/word.huf\n- reading sync (mod 128) from /usr/local/cwbFiles_v2/cqpweb/dasg/word.huf.syn\n!! You can delete the file now.\n/usr/local/bin/cwb-compress-rdx -r \"/usr/local/cwbFiles_v2/registry\" -A DASG 2>&1\nCOMPRESSING INDEX of DASG.word\n- writing compressed index to /usr/local/cwbFiles_v2/cqpweb/dasg/word.crc\n- writing compressed index offsets to /usr/local/cwbFiles_v2/cqpweb/dasg/word.crx\nVALIDATING DASG.word\n- reading compressed index from /usr/local/cwbFiles_v2/cqpweb/dasg/word.crc\n- reading compressed index offsets from /usr/local/cwbFiles_v2/cqpweb/dasg/word.crx\n!! You can delete the file now.\n!! You can delete the file now.' where corpus = 'dasg'"
}
}
[3]=>
array(2) {
["function"]=>
string(18) "install_new_corpus"
["args"]=>
array(0) {
}
}
[4]=>
array(4) {
["file"]=>
string(60) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/execute.inc.php"
["line"]=>
int(157)
["function"]=>
string(20) "call_user_func_array"
["args"]=>
array(2) {
[0]=>
&string(18) "install_new_corpus"
[1]=>
&array(0) {
}
}
}
[5]=>
array(4) {
["file"]=>
string(66) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/admin-execute.inc.php"
["line"]=>
int(121)
["args"]=>
array(1) {
[0]=>
string(60) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/execute.inc.php"
}
["function"]=>
string(7) "require"
}
[6]=>
array(4) {
["file"]=>
string(62) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/adminhome.inc.php"
["line"]=>
int(39)
["args"]=>
array(1) {
[0]=>
string(66) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/admin-execute.inc.php"
}
["function"]=>
string(7) "require"
}
[7]=>
array(4) {
["file"]=>
string(54) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/adm/index.php"
["line"]=>
int(3)
["args"]=>
array(1) {
[0]=>
string(62) "/home/html/xxx.xxx.xxx.xx/www/corpus_dev/lib/adminhome.inc.php"
}
["function"]=>
string(7) "require"
}
}
-----Original Message-----
From: cwb-bounces at sslmit.unibo.it [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Hardie, Andrew
Sent: 13 May 2016 11:38
To: Open source development of the Corpus WorkBench <cwb at sslmit.unibo.it>
Subject: Re: [CWB] CQPWeb 3.2.11 autosetup MySQL error
Fixed in SVN.
best
Andrew.
-----Original Message-----
From: cwb-bounces at sslmit.unibo.it [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Stephen Barrett
Sent: 13 May 2016 09:37
To: Open source development of the Corpus WorkBench
Subject: Re: [CWB] CQPWeb 3.2.11 autosetup MySQL error
Thanks Andrew,
We took your advice and checked out the trunk - 3.2.15. The autosetup ran just fine and we got a corpus installed and up-and-running.
When I tried to delete a corpus, however, the system failed with a MySQL error (copied below with the PHP backtrace).
Cheers
Stevie
---
_______________________________________________
CWB mailing list
CWB at sslmit.unibo.it
http://devel.sslmit.unibo.it/mailman/listinfo/cwb
_______________________________________________
CWB mailing list
CWB at sslmit.unibo.it
http://devel.sslmit.unibo.it/mailman/listinfo/cwb
More information about the CWB
mailing list