[CWB] Computing distribution fails with uninformative error message
Hardie, Andrew
a.hardie at lancaster.ac.uk
Fri Apr 26 22:26:09 CEST 2019
The filesize will often go down if you do a delete-restore like this. InnoDB table files often contain "holes" - where data has been deleted but the space not reclaimed (because doing so would mean changing the on-disk layout of the whole table).
I m pretty much certain that the error does not have anything to do with a size limit issue, despite the nice round 16GB number. The key giveaway is that the query *worked* when you typed it in but *didn't work* when it came from PHP. Also, this in your original result:
>>> Error # 0:
... means that PHP did not get back the expected error code / error message from the mysql client library. So the issue is between the PHP client and the MySQL server (which is probably actually MariaDB on Ubuntu).
Normally I would expect this error to result from "load data local infile" being disabled. But, if l-d-l-I was disabled, it ought not to have worked from the mysql client app.
That's the puzzle!
best
Andrew.
-----Original Message-----
From: cwb-bounces at sslmit.unibo.it <cwb-bounces at sslmit.unibo.it> On Behalf Of Jörg Knappen
Sent: 26 April 2019 15:09
To: Open source development of the Corpus WorkBench <cwb at sslmit.unibo.it>
Subject: Re: [CWB] Computing distribution fails with uninformative error message
I am now even more stymied, because a brute force approach (destroying the mysql database and reading it from the backup file again) managed to reduce the size of /var/lib/mysql from 16G to 11G but the error still persists.
--Jörg Knappen
Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
> I'm afraid I can't help. If there is no error message, and if running
> the query in the mysql client works but via CQPweb doesn't, then I am
> utterly stumped, I'm afraid.
>
> Just to check: you are still on 3.2.31,right?
>
> Andrew.
>
> -----Original Message-----
> From: cwb-bounces at sslmit.unibo.it <cwb-bounces at sslmit.unibo.it> On
> Behalf Of Jörg Knappen
> Sent: 25 April 2019 18:15
> To: Open source development of the Corpus WorkBench
> <cwb at sslmit.unibo.it>
> Subject: Re: [CWB] Computing distribution fails with uninformative
> error message
>
> Ah ... something more worth mentioning:
>
> I do daily mysql dumps of the cqpweb database (for backup), and there
> was a remarkable growth of that dump yesterday:
>
> -rw-rw-r-- 1 knappen knappen 5.5G Apr 25 01:07 cqpweb.dump
> -rw-rw-r-- 1 knappen knappen 4.3G Apr 24 01:06 cqpweb.dump.bak
>
> --Jörg Knappen
>
> Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
>
>> It's not CQPweb configuration. The error is deep in the MySQL layer.
>> The fact that the query runs fine from the CL client, but causes an
>> error when done via the CQPweb code, is suggestive.
>>
>> Suggestion: Have a look at your Mysql config and see if there is a
>> difference in permissions between your account and that used by
>> CQPweb.
>>
>> Also, if this si a shared server, maybe check whether anyone else did
>> an Ubuntu update around the time the problem occurred??
>>
>> best
>>
>> Andrew.
>>
>> -----Original Message-----
>> From: cwb-bounces at sslmit.unibo.it <cwb-bounces at sslmit.unibo.it> On
>> Behalf Of Jörg Knappen
>> Sent: 25 April 2019 13:11
>> To: Open source development of the Corpus WorkBench
>> <cwb at sslmit.unibo.it>
>> Subject: Re: [CWB] Computing distribution fails with uninformative
>> error message
>>
>> Hallo Andrew,
>>
>> raw disk space is currently not a problem: There is only one
>> partition on the disk and it has 277G of free space.
>>
>> mysql itself eats up 16G of disk space:
>>
>> root at corpora:/var/lib/mysql# du -h ./
>> 23M ./mysql
>> 676K ./sys
>> 16G ./cqpweb
>> 1.1M ./performance_schema
>> 16G ./
>>
>> which might be a magical number accessible to configuration.
>>
>> --Jörg Knappen
>>
>> Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
>>
>>> Is it a lack of disk space available to your MySQL daemon, possibly?
>>>
>>> best
>>>
>>> Andrew
>>>
>>> -----Original Message-----
>>> From: cwb-bounces at sslmit.unibo.it <cwb-bounces at sslmit.unibo.it> On
>>> Behalf Of Jörg Knappen
>>> Sent: 25 April 2019 12:27
>>> To: cwb at sslmit.unibo.it
>>> Subject: [CWB] Computing distribution fails with uninformative error
>>> message
>>>
>>>
>>> I'm running CQPweb v3.2.31 © 2008-2018 on Ubuntu 18.04 LTS, and
>>> overnight "Distribution" queries started to fail with the following
>>> error message (I can confirm that "Distribution worked perfectly
>>> yesterday in the evening):
>>>
>>> A MySQL query did not run successfully!
>>>
>>> Original query: LOAD DATA LOCAL INFILE
>>> '/data2/cqpweb/cache/tab_dist_fycel9oplk' INTO TABLE
>>> `db_dist_g2f3ndxf40` FIELDS ESCAPED BY '' /* from User: knappen |
>>> Function: create_db() | 2019-Apr-25 11:23:01 */
>>>
>>> Error # 0:
>>>
>>>
>>> Because the error emerged overnight with nothing changed on the
>>> system, I suspect that some configured limit is hit, but I have no
>>> clue which.
>>>
>>> Inspecting /var/log/mysql/error.log revealed nothing; and running
>>> the sql query directly from the mysql prompt succeeds.
>>>
>>> What can it be?
>>>
>>> Thanks in advance,
>>>
>>> Jörg Knappen
>>>
>>> P.S. PHP debugging backtrace
>>>
>>> array(6) {
>>> [1]=>
>>> array(4) {
>>> ["file"]=>
>>> string(40) "/var/www/html/cqpweb/lib/library.inc.php"
>>> ["line"]=>
>>> int(299)
>>> ["function"]=>
>>> string(20) "exiterror_mysqlquery"
>>> ["args"]=>
>>> array(3) {
>>> [0]=>
>>> int(0)
>>> [1]=>
>>> string(0) ""
>>> [2]=>
>>> string(191) "LOAD DATA LOCAL INFILE
>>> '/data2/cqpweb/cache/tab_dist_fycel9oplk' INTO TABLE
>>> `db_dist_g2f3ndxf40` FIELDS ESCAPED BY ''
>>> /* from User: knappen | Function: create_db() | 2019-Apr-25 11:23:01 */"
>>> }
>>> }
>>> [2]=>
>>> array(4) {
>>> ["file"]=>
>>> string(40) "/var/www/html/cqpweb/lib/library.inc.php"
>>> ["line"]=>
>>> int(423)
>>> ["function"]=>
>>> string(14) "do_mysql_query"
>>> ["args"]=>
>>> array(1) {
>>> [0]=>
>>> &string(191) "LOAD DATA LOCAL INFILE
>>> '/data2/cqpweb/cache/tab_dist_fycel9oplk' INTO TABLE
>>> `db_dist_g2f3ndxf40` FIELDS ESCAPED BY ''
>>> /* from User: knappen | Function: create_db() | 2019-Apr-25 11:23:01 */"
>>> }
>>> }
>>> [3]=>
>>> array(4) {
>>> ["file"]=>
>>> string(35) "/var/www/html/cqpweb/lib/db.inc.php"
>>> ["line"]=>
>>> int(292)
>>> ["function"]=>
>>> string(21) "do_mysql_infile_query"
>>> ["args"]=>
>>> array(3) {
>>> [0]=>
>>> string(18) "db_dist_g2f3ndxf40"
>>> [1]=>
>>> string(39) "/data2/cqpweb/cache/tab_dist_fycel9oplk"
>>> [2]=>
>>> bool(true)
>>> }
>>> }
>>> [4]=>
>>> array(4) {
>>> ["file"]=>
>>> string(45) "/var/www/html/cqpweb/lib/distribution.inc.php"
>>> ["line"]=>
>>> int(81)
>>> ["function"]=>
>>> string(9) "create_db"
>>> ["args"]=>
>>> array(5) {
>>> [0]=>
>>> object(DbType)#428 (4) {
>>> ["type"]=>
>>> int(1)
>>> ["str"]=>
>>> string(4) "dist"
>>> ["colloc_atts"]=>
>>> NULL
>>> ["colloc_range"]=>
>>> NULL
>>> }
>>> [1]=>
>>> string(10) "fycel9oplk"
>>> [2]=>
>>> string(15) "[word="optics"]"
>>> [3]=>
>>> string(0) ""
>>> [4]=>
>>> string(0) ""
>>> }
>>> }
>>> [5]=>
>>> array(4) {
>>> ["file"]=>
>>> string(41) "/var/www/html/cqpweb/lib/redirect.inc.php"
>>> ["line"]=>
>>> int(124)
>>> ["args"]=>
>>> array(1) {
>>> [0]=>
>>> string(45) "/var/www/html/cqpweb/lib/distribution.inc.php"
>>> }
>>> ["function"]=>
>>> string(7) "require"
>>> }
>>> [6]=>
>>> array(4) {
>>> ["file"]=>
>>> string(37) "/var/www/html/cqpweb/exe/redirect.php"
>>> ["line"]=>
>>> int(1)
>>> ["args"]=>
>>> array(1) {
>>> [0]=>
>>> string(41) "/var/www/html/cqpweb/lib/redirect.inc.php"
>>> }
>>> ["function"]=>
>>> string(7) "require"
>>> }
>>> }
>>>
>>>
>>> _______________________________________________
>>> CWB mailing list
>>> CWB at sslmit.unibo.it
>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>> _______________________________________________
>>> CWB mailing list
>>> CWB at sslmit.unibo.it
>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>
>>
>>
>> _______________________________________________
>> CWB mailing list
>> CWB at sslmit.unibo.it
>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>> _______________________________________________
>> CWB mailing list
>> CWB at sslmit.unibo.it
>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>
>
>
> _______________________________________________
> CWB mailing list
> CWB at sslmit.unibo.it
> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
> _______________________________________________
> CWB mailing list
> CWB at sslmit.unibo.it
> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
_______________________________________________
CWB mailing list
CWB at sslmit.unibo.it
http://liste.sslmit.unibo.it/mailman/listinfo/cwb
More information about the CWB
mailing list