[CWB] Where to start looking for the problem?
"Andrés Chandía"
andres at chandia.net
Fri Apr 22 21:06:30 CEST 2022
I again Andrew, I did all that you suggested, I even restarted the server just in case,
but all remains the same...
still no error logs in mysql or apache but I get a notice in php
[php7:notice] [pid 1923] [client 84.89.139.1:63747] PHP Notice:Â Undefined variable:
execute in /cqpweb/lib/cqp.php on line 2409, referer:
http://corptedig-glif.upf.edu/cqpweb/adm/index.php?ui=systemDiagnostics
And on any corpus I do a query I get:
ERROR: CQP backend startup failed; the reported CQP version [] could not be parsed.
Running a stress-test on password encryption via Blowfish
Using the Blowfish
cost of 11 as in your current configuration.
This may take some time. Please
wait.
Running …
The stresstest gave an average time-per-password
of 187.77 milliseconds. (For maximum security, this time should be as high as is tolerable for
users.)
If you wish to change this time, alter the configuration variable
$blowfish_cost. Each cost increase of 1 point approximately doubles the time taken.
Â
Database version check
The system database is at version 3.2.40.
CQPweb's
code is at version 3.2.43.
It is normal for the database version to be a little behind
the code. But if there is a major mismatch between the two, you may run into trouble.
If in doubt, run the upgrade-databse script (see system adminisatrator's manual for detail).
Diagnosing connection to child process for CQP back-end
Beginning
diagnostics on CQP child process connection.
Using following configuration
variables:
$path_to_cqp = ``/usr/local/bin/''
$cwb_registry =
``/mnt/vmdata/corptedig-glif/corpora/cqp/registry/''
Checking that directory
/usr/local/bin/ exists... yes it does!
Checking that CQP program exists... yes it
does!
Checking that CQP program is readable by the user... yes it is!
Checking
that CQP program is executable by this user... yes it is!
Checking that
/mnt/vmdata/corptedig-glif/corpora/cqp/registry/ exists... yes it does!
Checking that
CWB registry is readable by this user... yes it is!
Now running process-open to get a
link to CQP ... ... complete.
Checking that the process we've set up to link to slave
cqp has the datatypes it ought to... yes it has!
Checking that we've got the right
pipes into and out of the CQP process... all looking good!
Checking that it's possible
to read lines of cqp output...
CHECK FAILED. Couldn't read a line from CQP.
Attempting to shut down test process...
Test process closed with an non-SUCCESS
termination status (code number 127).
CQP connection diagnostic complete.
Thanks and more thanks!!
El Vie, 22 de Abril de 2022, 17:02, Hardie, Andrew escribió:
<style type="text/css">-></style>
You’ve
got at least 2 problems.
Checking that we've got the right pipes into
and out of the CQP process... all looking good!
Checking that it's possible to read
lines of cqp output...
CHECK FAILED. Couldn't read a line
from CQP.
Attempting to shut down test
process...
Test process closed with an non-SUCCESS termination status (code number
127).
CQP connection diagnostic complete.
That’s
the big one. You need to find out what is wrong. Often the issue is that CQP just hasn’t
started properly.
There’s
also a problem with the MySQL database:
A MySQL query did not run successfully!
[…]: select * from
system_messages order by timestamp desc
This
is odd because the actual SQL command there is as follows:
"select * from `system_messages` order by `date_of_posting`
desc"
…
the version with “timestamp†instead of “date_of_posting†is older,
but you are supposed to have the code of 3.2.43!
IE,
database structure and code versions don’t match.
So
that’s a puzzle. Your next steps:
restart
web daemon. To double check that it has loaded in the updated code (.43) rather than old
code (.27).
find
out what actual version of the code is that is present in your live
installation
Other
than the two things highlighted, nothing else is an error you need to worry about before
fixing those two.
best
Andrew.
From:
"Andrés ChandÃa"
Sent: 22 April 2022 15:20
To: Hardie, Andrew
Cc: Open source development of
the Corpus WorkBench
Subject: Re: Re: [CWB] Where to start looking for
the problem?
CQPWEB updated to version 3.2.43
but now quering any corpus I get:
ERROR: CQP backend startup failed; the reported CQP version [] could not
be parsed
Database version check:
The system database is at version
3.2.40.
CQPweb's code is at version 3.2.43.
It is normal for the database version
to be a little behind the code. But if there is a major mismatch between the two, you may run
into trouble.
If in doubt, run the upgrade-databse script (see system adminisatrator's
manual for detail).
Diagnosing connection to child process for CQP back-end
Beginning diagnostics on CQP child process connection.
Using following configuration
variables:
$path_to_cqp = ``/usr/local/bin/''
$cwb_registry =
``/mnt/vmdata/corptedig-glif/corpora/cqp/registry/''
Checking that directory
/usr/local/bin/ exists... yes it does!
Checking that CQP program exists... yes it
does!
Checking that CQP program is readable by the user... yes it is!
Checking
that CQP program is executable by this user... yes it is!
Checking that
/mnt/vmdata/corptedig-glif/corpora/cqp/registry/ exists... yes it does!
Checking that
CWB registry is readable by this user... yes it is!
Now running process-open to get a
link to CQP ... ... complete.
Checking that the process we've set up to link to slave
cqp has the datatypes it ought to... yes it has!
Checking that we've got the right pipes
into and out of the CQP process... all looking good!
Checking that it's possible to read
lines of cqp output...
CHECK FAILED. Couldn't read a line from CQP.
Attempting to
shut down test process...
Test process closed with an non-SUCCESS termination status
(code number 127).
CQP connection diagnostic complete.
No error messages on apache or mysql logs...
going back to old cqpweb interface I get:
A MySQL query did not run successfully!
Original query: select * from system_messages order by timestamp desc
/* from User: admin | Function: display_system_messages() | 2022-Apr-22 14:18:16 */
Error # 1054: Unknown column 'timestamp' in 'order clause'
PHP debugging backtrace
array(4) { [1]=> array(4) {
["file"]=> string(53)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/library.inc.php" ["line"]=>
int(286)
["function"]=> string(20) "exiterror_mysqlquery"
["args"]=> array(3) { [0]=> int(1054) [1]=>
string(44) "Unknown column 'timestamp' in 'order clause'" [2]=>
string(139) "select * from system_messages order by timestamp desc /* from User:
admin
| Function: display_system_messages() | 2022-Apr-22 14:18:16 */" } }
[2]=>
array(4) { ["file"]=>
string(54) "/mnt/vmdata/corptedig-glif/cqpweb/lib/html-lib.inc.php"
["line"]=> int(532)
["function"]=> string(14) "do_mysql_query"
["args"]=> array(1) { [0]=> &string(139) "select
*
from system_messages order by timestamp desc /* from User: admin | Function:
display_system_messages() | 2022-Apr-22 14:18:16 */" } } [3]=>
array(4) { ["file"]=>
string(54) "/mnt/vmdata/corptedig-glif/cqpweb/lib/mainhome.inc.php"
["line"]=> int(265)
["function"]=> string(23)
"display_system_messages" ["args"]=> array(0) { } }
[4]=> array(4) { ["file"]=> string(43)
"/mnt/vmdata/corptedig-glif/cqpweb/index.php" ["line"]=>
int(4)
["args"]=> array(1) { [0]=> string(54)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/mainhome.inc.php" }
["function"]=> string(7) "require" } }
And
ERROR: CQP backend startup failed; the reported CQP version [] could not
be parsed.
when wuering any corpus or doing any action on the interface
Thanks
El Jue, 21 de Abril de 2022, 18:35, Hardie, Andrew
escribió:
Recommendation: Redo the CQP diagnostic after upgrading. I think it is
more thorough in 3.2.43.
best
Andrew.
From:
cwb-bounces at sslmit.unibo.it on behalf of "Andrés ChandÃa"
Sent:
Thursday, April 21, 2022 12:09:43 PM
To: Open source development
of the Corpus WorkBench
Subject: Re: [CWB] Where to
start looking for the problem?
Thanks again Andrew...
Generalised problem check: Shows nothing (blank page)
Check corpus PHP inclusion files: NB. as of version 3.2 we no longer use
stub files. So there is nothing to repair here.
Check database version: The system database is at version 3.2.27.
CQPweb's code is at version 3.2.27.
It is normal for the database version to be a
little behind the code. But if there is a major mismatch between the two, you may run into
trouble.
If in doubt, run the upgrade-databse script (see system
adminisatrator's manual for detail).
Check CQP back-end:
Beginning diagnostics on CQP child process connection. Using following configuration
variables: $path_to_cqp = ``/usr/local/bin/'' $cwb_registry =
``/mnt/vmdata/corptedig-glif/corpora/cqp/registry/'' Checking that directory
/usr/local/bin/
exists... yes it does! Checking that CQP program exists... yes it does! Checking that
CQP
program is executable by this user... yes it is! Checking that
/mnt/vmdata/corptedig-glif/corpora/cqp/registry/ exists... yes it does! Checking that
CWB
registry is readable by this user... yes it is! The connection to the CQP child process
was
successful.
/var/log/apache2/error.log only has two lines, and no new lines added on
quering the corpus
[Thu Apr 21 06:25:18.867944 2022] [mpm_prefork:notice] [pid 2443]
AH00163: Apache/2.4.29 (Ubuntu) configured -- resuming normal operations
[Thu Apr 21
06:25:18.868022 2022] [core:notice] [pid 2443] AH00094: Command line: '/usr/sbin/apache2
the access log shows my access:
10.60.182.187 - 0 - [21/Apr/2022:13:04:32 +0200] "GET
/cqpweb/jsc/wz_tooltip.js HTTP/1.1" 200 5843
"http://corptedig-glif.upf.edu/cqpweb/coca/" "Mozilla/5.0 (X11; Ubuntu; Linux
x86_64; rv:99.0) Gecko/20100101 Firefox/99.0" /cqpweb/jsc/wz_tooltip.js
10.60.182.187 - 0 - [21/Apr/2022:13:04:45 +0200] "GET
/cqpweb/coca/concordance.php?theData=king&qmode=sq_nocase&pp=50&del=begin&t=&del=end&uT=y
HTTP/1.1" 200 4714 "http://corptedig-glif.upf.edu/cqpweb/coca/"
"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:99.0) Gecko/20100101 Firefox/99.0"
/cqpweb/coca/concordance.php
?theData=king&qmode=sq_nocase&pp=50&del=begin&t=&del=end&uT=y
10.60.182.187 - 0 - [21/Apr/2022:13:04:48 +0200] "GET / HTTP/1.1" 200 1122
"-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:99.0) Gecko/20100101
Firefox/99.0" /index.html
I will start cqpweb update now.....
thanks
El Jue, 21 de Abril de 2022, 3:14, Hardie, Andrew escribió:
OK, ?The query ran successfully in 0 seconds? refers to an SQL query,
not a CQP query. So not relevant here.
The fact you aren?t seeing any messages printed about data being sent to
and from CQP suggests to me that CQP is not connecting at all. Otherwise you?d see
something.
Try doing a CQP diagnostic? (under system diagnostics, on admin control
panel). That might be informative. AppArmor is a possible culprit.
And also check your http server log for any error messages (e.g.
involving httpd being blocked from accessing the cqp executable?)
I checked by the way, and 3.2.27 is ages ago ? almost 5 years.
Wowza, time flies, I suggest upgrading.
best
Andrew.
From:
cwb-bounces at sslmit.unibo.it On Behalf Of "Andrés
ChandÃa"
Sent: 20 April 2022 16:52
To: Open source development of the Corpus WorkBench
Subject: Re: [CWB] Where to start looking for the problem?
Hi Andrew,
Thanks for your help, I have changed
$print_debug_messages = true;
but all I see besides all that I have reported
before is: "The query ran successfully in 0 seconds."
"BTW While
3.2.27 is old, it?s not that old relative to the latest in the branch"
Yes,
I have not been in charge of this server for a long time, actually the corpus I'm having the
problem with was not istalled by me, and the state of the server is as I have left it long
time ago.
At first I thought it could be an issue of unupdated things and I did
the updating of the SO, having some issues with "AppArmor+MySql" which I could
solve, but that didn't help in the corpus issue, by the way, I have checked the corpus I have
installed when I was in charge of this server and all of them work correctly...
So, as I see it, I think the best solution is to install this corpus again, what do you think
about?
El Mie, 20 de Abril de 2022, 16:47, Hardie,
Andrew escribió:
Hi Andrés,
Wow, what a pile of issues!
The key point is this one:
There is a corpus that I've been told it was working correctly, but all
of a sudden queries started to give back [UNREADABLE]
This can?t happen without cause. Something must have changed. The range
of other error messages suggests that the setup of the operating system has changed. Perhaps
it has been upgraded, or default settings restored. In any case, the issues would seem to be
with configuration of either the filesystem, or the MySQL daemon, or both.
So, my question is where and how should I start to try to find out the
cause of this problem?
Turn on showing debug messages in the config file. This should help.
Note that ?[UNREADABLE]? is caused by failure to parse concordance
output from CQP. So, seeing what is actually being passed back and forth will probably give
you a hint.
BTW While 3.2.27 is old, it?s not that old relative to the
latest in the branch.
best
Andrew.
From:
cwb-bounces at sslmit.unibo.it On Behalf Of "Andrés
ChandÃa"
Sent: 20 April 2022 14:59
To: Open source development of the Corpus WorkBench
Subject: [CWB] Where to start looking for the problem?
Hi there,
At a cqpweb installation (CQPweb v3.2.27)
There is a corpus that I've been told it was working correctly, but all
of a sudden queries started to give back [UNREADABLE]
Like:
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE][UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
So, my question is where and how should I start to try to find out the
cause of this problem?
Things I've done/notice:
If I click on the linked results and the switch to the alternative view
(pos), I get:
i ge mc fo ) rr , rr21 rr22 , pn1 vvd np1 np1 , cc np1 np1 vvd ii21 ii22
nn1 ii21 ii22 nnt1 cs pphs1 vdd xx vvi to vbi rl to vvi ppge at _appge - appge nn1 vvg dd1 nn1 .
rr pph1 vbdz xx rr at1 nn1 nnt1 .
ccb md - md_nnt1 nn2 vh0 vbn -
vh0 vbn jj .
cs ppis1 vbdr np1 , ppis1 vm xx vbi vvg_jj@ nn1 ii dd1 io dd2 nn2 .
If I go to the Admin Control Panel I see:
Corpus: coca | Indexing date: 2019-04-11 15:29:37 | Size Tokens: 0 |
Types: 1,274,893 | Texts: 0 | Disk space Indexes: 0.0 MB | Freq tables: 57.4 MB
Frequency list search show results correctly:
1 king 11,825
and all derived from king...
A word lookup will fail giving this output: A MySQL query did not run
successfully!
Original query: select count(concat(node,'_',tagnode)) as tokens,
count(distinct(concat(node,'_',tagnode))) as types from db_sort_h1fel9jyg4 /* from User: admin
| Function: require() | 2022-Apr-20 13:37:27 */
Error # 1054: Unknown column 'tagnode' in 'field list'
Generate CWB text-position records outputs: A MySQL query did not run
successfully!
Original query: insert into `___temp_cqp_text_positions_for_coca`
(text_id, cqp_begin, cqp_end) VALUES ('4122770', 0, 5307), .... etc. a lot of numbers...
Error # 1062: Duplicate entry '4166449' for key 'PRIMARY'
Update Word and file counts outputs "the connections has
expired", on retrying page keeps loading until is done
Recreate CWB Frequency table outputs: "the connections has
expired" on retrying I get: CQPweb could not create a directory for the frequency index.
Check filesystem permissions!
I've checked the directories and all of them are owned by www-data
Recreate Frequency tables outpus: "the connections has
expired" on retry finally outpus;
A MySQL query did not run successfully!
Original query: CREATE TABLE __tempfreq_coca ( freq int(11) unsigned default NULL, word
varchar(255) NOT NULL, lemma varchar(255) NOT NULL, pos varchar(255) NOT NULL, key (word), key
(lemma), key (pos) ) CHARACTER SET utf8 COLLATE utf8_general_ci /* from User: admin |
Function: corpus_make_freqtables() | 2022-Apr-20 13:53:57 */
Error # 1050: Table '__tempfreq_coca' already exists
I will appreciate any guidance, thanks a lot!!
_______________________
andrés chandÃa
[IMAGE
REMOVED]
Düngupeyem
| IECMap | ISECMap | NMT | Corlexim
Desarrollador de:
Parles.upf |
IWCH | Amind terapia
| Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el medio
ambiente!
_______________________
andrés
chandÃa
Düngupeyem
| IECMap | ISECMap | NMT | Corlexim
Desarrollador de:
Parles.upf |
IWCH | Amind terapia
| Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el medio
ambiente!
_______________________
andrés
chandÃa
Düngupeyem
| IECMap | ISECMap | NMT | Corlexim
Desarrollador de:
Parles.upf |
IWCH | Amind terapia
| Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el medio
ambiente!
_______________________
andrés chandÃa
Düngupeyem
| IECMap | ISECMap | NMT | Corlexim
Desarrollador de:
Parles.upf |
IWCH | Amind terapia
| Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el medio
ambiente!
_______________________
            andrés
chandÃa
Düngupeyem | IECMap | ISECMap | NMT | Corlexim
Desarrollador de:
Parles.upf | IWCH | Amind terapia | Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el
medio ambiente!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://liste.sslmit.unibo.it/pipermail/cwb/attachments/20220422/c4047a3c/attachment-0001.html>
More information about the CWB
mailing list