[CWB] Error creating Frequency tables

[Hardie, Andrew]

I guess it means that there are multiple word types beginning in '' llllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll '' that overflow the length of the field, resulting in the last part of the word type (which distinguishes them from one another, being lost in the database?

EG, if you have,


llllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll11a

llllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll11b

as different words in the index, they will look the same to the database when it chops off the end due to overflow, which would mean having the same word type on the frequency list twice, which isn't allowed.

The solution would be to get rid of the weird tokens...

best

Andrew.

-----Original Message-----
From: cwb-bounces at sslmit.unibo.it [mailto:cwb-bounces at sslmit.unibo.it] On Behalf Of Eva Bretschneider
Sent: 13 March 2018 09:26
To: cwb at sslmit.unibo.it
Subject: [CWB] Error creating Frequency tables


Dear all,

I have a question regarding the creation of freqency-lists.
I use CQPwebinabox on a VM v3.2.17. When I create frequency lists  
manually everything works fine until the Frequency tables, then I get  
the following error.

I know, there have been some similar questions and problems in the  
past but somehow they don't seem to apply to my situation. Do you have  
any help/advice?

Thanks a lot for your help!
Eva


Error:

CQPweb encountered an error and could not continue.
A mySQL query did not run successfully!


Original query: INSERT INTO freq_corpus_ling_word select sum(freq) as  
f, word as item from temporary_freq_corpus_ling group by word /* from  
User: user | Function: corpus_make_freqtables() | 2018-03-13 09:08:02 */

Error # 1062: Duplicate entry  
'llllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll' for  
key 'PRIMARY'


PHP debugging backtrace

array(5) {
   [1]=>
   array(4) {
     ["file"]=>
     string(40) "/var/www/html/cqpweb/lib/library.inc.php"
     ["line"]=>
     int(262)
     ["function"]=>
     string(20) "exiterror_mysqlquery"
     ["args"]=>
     array(3) {
       [0]=>
       &int(1062)
       [1]=>
       &string(100) "Duplicate entry  
'llllllllllllllllllllllllllllllllllllllllllllllllllllllllllllllll' for  
key 'PRIMARY'"
       [2]=>
       &string(218) "
			INSERT INTO freq_corpus_ling_word
				select sum(freq) as f, word as item
					from temporary_freq_corpus_ling
					group by word
	/* from User: user | Function: corpus_make_freqtables() | 2018-03-13  
09:08:02 */"
     }
   }
   [2]=>
   array(4) {
     ["file"]=>
     string(42) "/var/www/html/cqpweb/lib/freqtable.inc.php"
     ["line"]=>
     int(150)
     ["function"]=>
     string(14) "do_mysql_query"
     ["args"]=>
     array(1) {
       [0]=>
       &string(135) "
			INSERT INTO freq_corpus_ling_word
				select sum(freq) as f, word as item
					from temporary_freq_corpus_ling
					group by word"
     }
   }
   [3]=>
   array(2) {
     ["function"]=>
     string(22) "corpus_make_freqtables"
     ["args"]=>
     array(1) {
       [0]=>
       &string(4) "ling"
     }
   }
   [4]=>
   array(4) {
     ["file"]=>
     string(40) "/var/www/html/cqpweb/lib/execute.inc.php"
     ["line"]=>
     int(159)
     ["function"]=>
     string(20) "call_user_func_array"
     ["args"]=>
     array(2) {
       [0]=>
       &string(22) "corpus_make_freqtables"
       [1]=>
       &array(1) {
         [0]=>
         string(4) "ling"
       }
     }
   }
   [5]=>
   array(4) {
     ["file"]=>
     string(36) "/var/www/html/cqpweb/exe/execute.php"
     ["line"]=>
     int(1)
     ["args"]=>
     array(1) {
       [0]=>
       string(40) "/var/www/html/cqpweb/lib/execute.inc.php"
     }
     ["function"]=>
     string(7) "require"
   }
}


_______________________________________________
CWB mailing list
CWB at sslmit.unibo.it
http://liste.sslmit.unibo.it/mailman/listinfo/cwb