[CWB] mysql cache errors occurring recently
Jörg Knappen
j.knappen at mx.uni-saarland.de
Fri Apr 13 11:57:12 CEST 2018
Thanks, Anrew,
I finally grokt it. The relevant and effective parameter is (in our
version of cqpweb ...)
$mysql_db_size_limit = $default_max_fullsize_dbs_in_cache *
$colloc_db_premium * $default_max_dbsize;
and I enlarged it by increasing $default_max_fullsize_dbs_in_cache
Greetings from Saarbrücken,
Jörg Knappen
Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
> I can't reproduce that problem. Changing that config value on my
> server does indeed cause the size of the user-database cache, as
> reported in Database cache control, to change.
>
> Unless you can get further info in the form of more error messages,
> there's not much I can do to assist...
>
> Andrew.
>
> -----Original Message-----
> From: cwb-bounces at sslmit.unibo.it
> [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Jörg Knappen
> Sent: 12 April 2018 17:38
> To: Open source development of the Corpus WorkBench <cwb at sslmit.unibo.it>
> Subject: Re: [CWB] mysql cache errors occurring recently
>
> I set
>
> $db_cache_size_limit = 12884901888
>
> but it does not seem to be effective; the error still occurs and the
> cache tool shows the old value.
>
> Jörg
>
> Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
>
>> It's controlled by the config setting $db_cache_size_limit . See
>> admin manual, page 26.
>>
>> It defaults to 6 GB which is usually plenty.
>>
>> best
>>
>> Andrew.
>>
>>
>> -----Original Message-----
>> From: cwb-bounces at sslmit.unibo.it
>> [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Jörg Knappen
>> Sent: 12 April 2018 16:57
>> To: Open source development of the Corpus WorkBench <cwb at sslmit.unibo.it>
>> Subject: Re: [CWB] mysql cache errors occurring recently
>>
>> Andrew,
>>
>> there are indeed a lot of saved catqueries on our server; so I
>> probably need to grow the cache, how do I do this?
>>
>> Jörg
>>
>> Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
>>
>>> If all tables are properly tracked, then the oldest should be
>>> deleted whenever more space is needed. So the cache will rise to
>>> 99/100 % full, then stay at that level of fullness.
>>>
>>> (Before a new DB is created, a check is made for the cache being
>>> past its limit. The " DATABASE CACHE OVERLOAD " message appears if
>>> that process fails for any reason.)
>>>
>>> It's difficult for me to work out what the problem might be without
>>> actually being able to see your cache control window myself.
>>>
>>> One possibility is if your users have lots of categorised queries?
>>> These take up space in the DB cache, but cannot be deleted. If this
>>> is the problem, the solution is to grow the cache.
>>>
>>> You can look at the list of databases in cache for each corpus in
>>> the admin tools of that corpus - under "Cached databases" .
>>>
>>> best
>>>
>>> Andrew.
>>>
>>> -----Original Message-----
>>> From: cwb-bounces at sslmit.unibo.it
>>> [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Jörg Knappen
>>> Sent: 12 April 2018 16:41
>>> To: Open source development of the Corpus WorkBench <cwb at sslmit.unibo.it>
>>> Subject: Re: [CWB] mysql cache errors occurring recently
>>>
>>> Andrew,
>>>
>>> thanks for the answer. I found the tool and there were indeed a few
>>> orphaned cache entries,
>>> but their total size was negligible. The cache is still 99% in use;
>>> how can I clear more of it?
>>>
>>> Jörg Knappen
>>>
>>> Quoting "Hardie, Andrew" <a.hardie at lancaster.ac.uk>:
>>>
>>>> 3 things.
>>>>
>>>> First, the function names/line numbers in the debug backtrace
>>>> suggest this is rather an old version of the code. So, you might
>>>> consider upgrading.
>>>>
>>>> Second, you might find that if you look on the "cache control" /
>>>> "database cache" page in the admin interface, it will tell you what
>>>> is wrong. (This is assuming that your version of the code is not too
>>>> old to have that tool!) One possibility is that you have a number of
>>>> orphaned database table records which make the cache look fuller
>>>> than it actually is. Deleting the orphan records would in that case
>>>> solve the problem.
>>>>
>>>> Third, when you get the " Too many database processes " error, you
>>>> can look under "Manage MySQL processes" again in the admin UI, and
>>>> delete records of zombie processes.
>>>>
>>>> best
>>>>
>>>> Andrew.
>>>>
>>>>
>>>> -----Original Message-----
>>>> From: cwb-bounces at sslmit.unibo.it
>>>> [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Jörg Knappen
>>>> Sent: 12 April 2018 13:48
>>>> To: cwb at sslmit.unibo.it
>>>> Subject: [CWB] mysql cache errors occurring recently
>>>>
>>>> We run a cqpweb on Ubuntu 14.04 LTS using the following php version
>>>>
>>>>
>>>> PHP 5.5.9-1ubuntu4.24 (cli) (built: Mar 16 2018 12:41:43)
>>>> Copyright (c) 1997-2014 The PHP Group
>>>> Zend Engine v2.5.0, Copyright (c) 1998-2014 Zend Technologies
>>>> with Zend OPcache v7.0.3, Copyright (c) 1999-2014, by Zend
>>>> Technologies
>>>>
>>>>
>>>> and the mysql version
>>>>
>>>> mysql Ver 14.14 Distrib 5.5.59, for debian-linux-gnu (x86_64) using
>>>> readline 6.3
>>>>
>>>> We did not change cqpweb recently, nor did we anything but doing
>>>> reqular system upgrades using
>>>> apt-get upgrade.
>>>>
>>>> HOwever, when we try a frequency breakdown, the following error
>>>> appears (frst encountered about a week or so ago):
>>>>
>>>> CRITICAL ERROR - DATABASE CACHE OVERLOAD!
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> CQPweb tried to clear database cache space but failed!
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> Please report this error to the system administrator.
>>>>
>>>>
>>>> PHP debugging backtrace
>>>>
>>>> array(5) {
>>>> [1]=>
>>>> array(4) {
>>>> ["file"]=>
>>>> string(35) "/var/www/html/cqpweb/lib/db.inc.php"
>>>> ["line"]=>
>>>> int(581)
>>>> ["function"]=>
>>>> string(20) "exiterror_dboverload"
>>>> ["args"]=>
>>>> array(0) {
>>>> }
>>>> }
>>>> [2]=>
>>>> array(4) {
>>>> ["file"]=>
>>>> string(35) "/var/www/html/cqpweb/lib/db.inc.php"
>>>> ["line"]=>
>>>> int(95)
>>>> ["function"]=>
>>>> string(16) "delete_saved_dbs"
>>>> ["args"]=>
>>>> array(0) {
>>>> }
>>>> }
>>>> [3]=>
>>>> array(4) {
>>>> ["file"]=>
>>>> string(42) "/var/www/html/cqpweb/lib/breakdown.inc.php"
>>>> ["line"]=>
>>>> int(160)
>>>> ["function"]=>
>>>> string(9) "create_db"
>>>> ["args"]=>
>>>> array(6) {
>>>> [0]=>
>>>> &string(4) "sort"
>>>> [1]=>
>>>> &string(10) "fqa49mvvxx"
>>>> [2]=>
>>>> &string(12) "[word="des"]"
>>>> [3]=>
>>>> &string(0) ""
>>>> [4]=>
>>>> &string(0) ""
>>>> [5]=>
>>>> &string(0) ""
>>>> }
>>>> }
>>>> [4]=>
>>>> array(4) {
>>>> ["file"]=>
>>>> string(41) "/var/www/html/cqpweb/lib/redirect.inc.php"
>>>> ["line"]=>
>>>> int(73)
>>>> ["args"]=>
>>>> array(1) {
>>>> [0]=>
>>>> string(42) "/var/www/html/cqpweb/lib/breakdown.inc.php"
>>>> }
>>>> ["function"]=>
>>>> string(7) "require"
>>>> }
>>>> [5]=>
>>>> array(4) {
>>>> ["file"]=>
>>>> string(37) "/var/www/html/cqpweb/exe/redirect.php"
>>>> ["line"]=>
>>>> int(1)
>>>> ["args"]=>
>>>> array(1) {
>>>> [0]=>
>>>> string(41) "/var/www/html/cqpweb/lib/redirect.inc.php"
>>>> }
>>>> ["function"]=>
>>>> string(7) "require"
>>>> }
>>>> }
>>>>
>>>> and after a few more tries we finally reach the following error:
>>>>
>>>> Too many database processes!
>>>>
>>>> There are already 5 query sort databases being compiled.
>>>>
>>>> Please use the Back-button of your browser and try again in a few moments.
>>>>
>>>> Rebooting the server removes the latter error, but not the cache problem.
>>>>
>>>> What can be the cause of the cache problem and how can I remove it?
>>>>
>>>> Greetings from Saarbrücken,
>>>>
>>>> Jörg Knappen
>>>>
>>>>
>>>> _______________________________________________
>>>> CWB mailing list
>>>> CWB at sslmit.unibo.it
>>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>>> _______________________________________________
>>>> CWB mailing list
>>>> CWB at sslmit.unibo.it
>>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>>
>>>
>>>
>>> _______________________________________________
>>> CWB mailing list
>>> CWB at sslmit.unibo.it
>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>> _______________________________________________
>>> CWB mailing list
>>> CWB at sslmit.unibo.it
>>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>>
>>
>>
>> _______________________________________________
>> CWB mailing list
>> CWB at sslmit.unibo.it
>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>> _______________________________________________
>> CWB mailing list
>> CWB at sslmit.unibo.it
>> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
>
>
>
> _______________________________________________
> CWB mailing list
> CWB at sslmit.unibo.it
> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
> _______________________________________________
> CWB mailing list
> CWB at sslmit.unibo.it
> http://liste.sslmit.unibo.it/mailman/listinfo/cwb
More information about the CWB
mailing list