[CWB] Where to start looking for the problem?

"Andrés Chandía" andres at chandia.net
Fri Apr 22 16:20:06 CEST 2022 


CQPWEB updated to version 3.2.43


but now quering any corpus I get:



ERROR: CQP backend startup failed; the reported CQP version [] could not be parsed


Database version check:
   The system database is at version 3.2.40.
  CQPweb's code
is at version 3.2.43.
  It is normal for the database version to be a little behind the
code. But if there is a major mismatch between the two, you may run into trouble.
  If in
doubt, run the upgrade-databse script (see system adminisatrator's manual for detail). 

 Diagnosing connection to child process for CQP back-end 
 					 Beginning
diagnostics on CQP child process connection. 
 Using following configuration
variables:
     $path_to_cqp  = ``/usr/local/bin/''
     $cwb_registry =
``/mnt/vmdata/corptedig-glif/corpora/cqp/registry/''
  Checking that directory
/usr/local/bin/ exists...  yes it does!
  Checking that CQP program exists...  yes it
does!
  Checking that CQP program is readable by the user...  yes it is!
  Checking
that CQP program is executable by this user...  yes it is!
  Checking that
/mnt/vmdata/corptedig-glif/corpora/cqp/registry/ exists...  yes it does!
  Checking that
CWB registry is readable by this user...  yes it is!
  Now running process-open to get a
link to CQP ... ... complete. 
  Checking that the process we've set up to link to slave
cqp has the datatypes it ought to...  yes it has!
  Checking that we've got the right
pipes into and out of the CQP process...  all looking good!
  Checking that it's possible
to read lines of cqp output... 
     CHECK FAILED. Couldn't read a line from CQP.

Attempting to shut down test process...
    Test process closed with an non-SUCCESS
termination status (code number 127).
  CQP connection diagnostic complete.



No error messages on apache or mysql logs...


going back to old cqpweb interface I get:



A MySQL query did not run successfully!

 

 
Original query:   select * from system_messages order by timestamp
desc  	/* from User: admin | Function: display_system_messages() | 2022-Apr-22 14:18:16 */ 


 

 
Error # 1054: Unknown column 'timestamp' in 'order clause' 

 
PHP debugging backtrace
array(4) {   [1]=>   array(4) {     ["file"]=>     string(53)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/library.inc.php"     ["line"]=> 
   int(286)     ["function"]=>     string(20) "exiterror_mysqlquery"   
 ["args"]=>     array(3) {       [0]=>       int(1054)       [1]=>      
string(44) "Unknown column 'timestamp' in 'order clause'"       [2]=>      
string(139) "select * from system_messages order by timestamp desc  	/* from User: admin
| Function: display_system_messages() | 2022-Apr-22 14:18:16 */"     }   }   [2]=>  
array(4) {     ["file"]=>     string(54)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/html-lib.inc.php"     ["line"]=>
    int(532)     ["function"]=>     string(14) "do_mysql_query"    
["args"]=>     array(1) {       [0]=>       &string(139) "select *
from system_messages order by timestamp desc  	/* from User: admin | Function:
display_system_messages() | 2022-Apr-22 14:18:16 */"     }   }   [3]=>   array(4) {   
 ["file"]=>     string(54)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/mainhome.inc.php"     ["line"]=>
    int(265)     ["function"]=>     string(23)
"display_system_messages"     ["args"]=>     array(0) {     }   }  
[4]=>   array(4) {     ["file"]=>     string(43)
"/mnt/vmdata/corptedig-glif/cqpweb/index.php"     ["line"]=>     int(4)
    ["args"]=>     array(1) {       [0]=>       string(54)
"/mnt/vmdata/corptedig-glif/cqpweb/lib/mainhome.inc.php"     }    
["function"]=>     string(7) "require"   } } 



And
ERROR: CQP backend startup failed; the reported CQP version [] could not be parsed.


when wuering any corpus or doing any action on the interface


Thanks






El Jue, 21 de Abril de 2022, 18:35, Hardie, Andrew escribió:
 
 Recommendation: Redo the CQP diagnostic after upgrading. I think it is
more thorough in 3.2.43.

 

 best
 
 



Andrew.
 


 




From: cwb-bounces at sslmit.unibo.it  on behalf of
"Andrés Chandía" 
 Sent: Thursday, April 21,
2022 12:09:43 PM
 To: Open source development of the Corpus WorkBench

 Subject: Re: [CWB] Where to start looking for the problem?
 



Thanks again Andrew...

 
Generalised problem check: Shows nothing (blank page)

 
Check corpus PHP inclusion files:  NB. as of version 3.2 we no longer use stub files. So
there is nothing to repair here.

 
Check database version: The system database is at version 3.2.27. 
  CQPweb's code
is at version 3.2.27. 
  It is normal for the database version to be a little behind the
code. But if there is a major mismatch between the two, you may run into trouble. 
 If in
doubt, run the upgrade-databse script (see system adminisatrator's manual for
detail). 
 

 
Check CQP back-end:
Beginning diagnostics on CQP child process connection.  Using following configuration
variables:     $path_to_cqp = ``/usr/local/bin/''     $cwb_registry =
``/mnt/vmdata/corptedig-glif/corpora/cqp/registry/''  Checking that directory /usr/local/bin/
exists...  yes it does!  Checking that CQP program exists...  yes it does!  Checking that CQP
program is executable by this user...  yes it is!  Checking that
/mnt/vmdata/corptedig-glif/corpora/cqp/registry/ exists...  yes it does!  Checking that CWB
registry is readable by this user...  yes it is!  The connection to the CQP child process was
successful.


 
/var/log/apache2/error.log only has two lines, and no new lines added on quering the
corpus
[Thu Apr 21 06:25:18.867944 2022] [mpm_prefork:notice] [pid 2443] AH00163: Apache/2.4.29
(Ubuntu) configured -- resuming normal operations
 [Thu Apr 21 06:25:18.868022 2022]
[core:notice] [pid 2443] AH00094: Command line: '/usr/sbin/apache2


 
the access log shows my access:
10.60.182.187 - 0 - [21/Apr/2022:13:04:32 +0200] "GET /cqpweb/jsc/wz_tooltip.js
HTTP/1.1" 200 5843 "http://corptedig-glif.upf.edu/cqpweb/coca/"
"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:99.0) Gecko/20100101 Firefox/99.0"
/cqpweb/jsc/wz_tooltip.js 
 10.60.182.187 - 0 - [21/Apr/2022:13:04:45 +0200] "GET
/cqpweb/coca/concordance.php?theData=king&qmode=sq_nocase&pp=50&del=begin&t=&del=end&uT=y
HTTP/1.1" 200 4714 "http://corptedig-glif.upf.edu/cqpweb/coca/"
"Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:99.0)  Gecko/20100101 Firefox/99.0"
/cqpweb/coca/concordance.php
?theData=king&qmode=sq_nocase&pp=50&del=begin&t=&del=end&uT=y

10.60.182.187 - 0 - [21/Apr/2022:13:04:48 +0200] "GET / HTTP/1.1" 200 1122
"-" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:99.0) Gecko/20100101
Firefox/99.0" /index.html

 
I will start cqpweb update now.....

 
thanks 
 

 

 

 <style type="text/css"> -> </style>


OK, ?The query ran
successfully in 0 seconds? refers to an SQL
query,  not a CQP query. So not relevant here.

The fact you aren?t seeing
any messages printed about data being sent to and from CQP suggests to me that CQP is not
connecting at all. Otherwise you?d see something.

Try doing a CQP
diagnostic? (under system diagnostics, on admin control panel). That might be informative.
AppArmor is a possible culprit.

And also check your http
server log for any error messages (e.g. involving httpd being blocked from accessing the cqp
executable?)

I checked by the way, and
3.2.27 is ages ago ? almost 5 years. Wowza, time flies, I suggest
upgrading.

best

Andrew.



From:
cwb-bounces at sslmit.unibo.it On Behalf Of "Andrés
Chandía"
 Sent: 20 April 2022 16:52

To: Open source development of the Corpus WorkBench 

Subject: Re: [CWB] Where to start looking for the problem?


 

Hi Andrew,
 
 Thanks for your help, I have changed
$print_debug_messages = true;
 
 but all I see besides all that I have reported
before is: "The query ran successfully in 0 seconds."
 
 "BTW While
3.2.27 is old, it?s not that old relative to the latest in the branch"
 
 Yes,
I have not been in charge of this server for a long time, actually the corpus I'm having the
problem with was not istalled by me, and the state of the server is as I have left it long
time ago.
 
 At first I thought it could be an issue of unupdated things and I did
the updating of the SO, having some issues with "AppArmor+MySql" which I could
solve, but that didn't help in the corpus issue, by the way, I have checked the corpus I have
installed when  I was in charge of this server and all of them work correctly...
 

So, as I see it, I think the best solution is to install this corpus again, what do you think
about? 

 


 


 


 

El Mie, 20 de Abril de 2022, 16:47, Hardie, Andrew escribió:
 
 


Hi Andrés,

Wow, what a pile
of issues!
The key point is
this one: 
There is a corpus that I've been told it was working
correctly, but all of a sudden queries started to give back [UNREADABLE]
This can?t happen
without cause. Something must have changed. The range of other error messages suggests that
the setup of the operating system has  changed. Perhaps it has been upgraded, or default
settings restored. In any case, the issues would seem to be with configuration of either the
filesystem, or the MySQL daemon, or both.
So, my question is where and how should I start to try to find
out the cause of this problem?
Turn on showing
debug messages in the config file. This should help. 
Note that
?[UNREADABLE]? is caused by failure to parse concordance output from CQP. So, seeing what is
actually being passed back and forth will  probably give you a hint. 
BTW While 3.2.27
is old, it?s not that old relative to the latest in
the branch. 
best
Andrew.


From:
cwb-bounces at sslmit.unibo.it On Behalf Of
"Andrés Chandía"
 Sent: 20 April 2022 14:59
 To: Open source development of the Corpus WorkBench 
 Subject: [CWB] Where to start looking
for the problem?




Hi there,


At a cqpweb installation (CQPweb v3.2.27)


There is a corpus that I've been told it was working
correctly, but all of a sudden queries started to give back [UNREADABLE]


Like:


[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE][UNREADABLE] [UNREADABLE]  [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]
[UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE] [UNREADABLE]



So, my question is where and how should I start to try to find
out the cause of this problem?


Things I've done/notice:


If I click on the linked results and the switch to the
alternative view (pos), I get:


i ge mc fo ) rr , rr21 rr22 , pn1 vvd np1 np1 , cc np1 np1 vvd
ii21 ii22 nn1 ii21 ii22 nnt1 cs pphs1 vdd xx vvi to vbi rl to vvi ppge at _appge - appge nn1 vvg
dd1 nn1 . 
 
 rr pph1 vbdz xx rr at1 nn1 nnt1 . 
 
 ccb md - md_nnt1 nn2
vh0 vbn - vh0 vbn jj . 
 
 cs ppis1 vbdr np1 , ppis1 vm xx vbi vvg_jj@ nn1 ii dd1 io
dd2 nn2 . 


If I go to the Admin Control Panel I see:


Corpus: coca | Indexing date: 2019-04-11 15:29:37 | Size
Tokens: 0 | Types: 1,274,893 | Texts: 0 | Disk space Indexes: 0.0 MB | Freq tables: 57.4
MB


Frequency list search show results correctly: 


1 king  11,825 


and all derived from king...


A word lookup will fail giving this output: A MySQL query did
not run successfully!



Original query: select count(concat(node,'_',tagnode)) as tokens,
count(distinct(concat(node,'_',tagnode))) as types from db_sort_h1fel9jyg4 /* from User: admin
| Function: require() | 2022-Apr-20 13:37:27 */ 

Error # 1054: Unknown column 'tagnode' in 'field list' 

Generate CWB text-position records outputs: A MySQL query did
not run successfully!
 Original query: insert into `___temp_cqp_text_positions_for_coca`
(text_id, cqp_begin, cqp_end) VALUES ('4122770', 0, 5307), .... etc. a lot of numbers...

Error # 1062: Duplicate entry '4166449' for key 'PRIMARY' 

Update Word and file counts outputs "the connections has
expired", on retrying page keeps loading until is done


Recreate CWB Frequency table outputs: "the connections
has expired" on retrying I get: CQPweb could not create a directory for the frequency
index. Check filesystem permissions!


I've checked the directories and all of them are owned by
www-data


Recreate Frequency tables outpus: "the connections has
expired" on retry finally outpus;



A MySQL query did not run successfully!

Original query: CREATE TABLE __tempfreq_coca ( freq int(11) unsigned default NULL, word
varchar(255) NOT NULL, lemma varchar(255) NOT NULL, pos varchar(255) NOT NULL, key (word), key
(lemma), key (pos) ) CHARACTER SET utf8 COLLATE utf8_general_ci /* from  User: admin |
Function: corpus_make_freqtables() | 2022-Apr-20 13:53:57 */ 

Error # 1050: Table '__tempfreq_coca' already exists 


I will appreciate any guidance, thanks a lot!!

_______________________
 andrés chandía
 [IMAGE 
REMOVED]
 Düngupeyem
 |  IECMap |  ISECMap |  NMT |  Corlexim


Desarrollador de:
 Parles.upf  |
 IWCH |  Amind terapia
|  Nocando |  IAC |  CddZ |  ISAC |  CatCg

P  No imprima innecesariamente. ¡Cuide el medio
ambiente!




 
 
 _______________________
 andrés
chandía
 
 Düngupeyem
 |  IECMap |  ISECMap |  NMT |  Corlexim


Desarrollador de:
 Parles.upf  |
 IWCH |  Amind terapia
|  Nocando |  IAC |  CddZ |  ISAC |  CatCg

P  No imprima innecesariamente. ¡Cuide el medio
ambiente!




 
 
 _______________________
             andrés chandía
   
 Düngupeyem
 |  IECMap |  ISECMap |  NMT |  Corlexim


Desarrollador de:
 Parles.upf  |
 IWCH |  Amind terapia
|  Nocando |  IAC |  CddZ |  ISAC |  CatCg

P  No imprima innecesariamente. ¡Cuide el
medio ambiente!


 


_______________________

            andrés
chandía
 
Düngupeyem | IECMap | ISECMap | NMT | Corlexim

Desarrollador de:
Parles.upf | IWCH | Amind terapia | Nocando | IAC | CddZ | ISAC | CatCg
P No imprima innecesariamente. ¡Cuide el
medio ambiente!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://liste.sslmit.unibo.it/pipermail/cwb/attachments/20220422/432599cd/attachment-0001.html>

More information about the CWB mailing list