<div dir="ltr"><div>Hello!</div><div><br></div><div>Cannot it be that you don't have enough RAM? Did you monitor RAM usage during that process with top, for example?</div><div><br></div><div>With best wishes,</div><div>Mansur<br></div></div><br><div class="gmail_quote"><div dir="ltr">Am Mi., 28. Nov. 2018 um 21:25 Uhr schrieb Stefan Fischer <<a href="mailto:stefan.fischer@uni-saarland.de">stefan.fischer@uni-saarland.de</a>>:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello everyone,<br>
<br>
I would like to import a corpus (300M words) into CQPweb. The corpus is already indexed in CWB and the import into CQPweb worked well. As the corpus is rather large, I ran "php offline-freqlists.php my_corpus" in the terminal. Unfortunately, the script fails after several hours and I get the following error message:<br>
<br>
----<br>
<br>
cwb-scan-corpus error!<br>
Killed<br>
<br>
<br>
<br>
PHP debugging backtrace<br>
=======================<br>
array(2) {<br>
[1]=><br>
array(4) {<br>
["file"]=><br>
string(42) "/var/www/html/cqpweb/lib/freqtable.inc.php"<br>
["line"]=><br>
int(99)<br>
["function"]=><br>
string(17) "exiterror_general"<br>
["args"]=><br>
array(1) {<br>
[0]=><br>
&string(29) "cwb-scan-corpus error!<br>
Killed"<br>
}<br>
}<br>
[2]=><br>
array(4) {<br>
["file"]=><br>
string(46) "/var/www/html/cqpweb/bin/offline-freqlists.php"<br>
["line"]=><br>
int(136)<br>
["function"]=><br>
string(22) "corpus_make_freqtables"<br>
["args"]=><br>
array(1) {<br>
[0]=><br>
&string(10) "test_corpus"<br>
}<br>
}<br>
}<br>
<br>
----<br>
<br>
I have already imported corpora larger than this one. So I guess corpus size is not the issue. What else could cause a failure of cwb-scan-corpus?<br>
<br>
Best,<br>
Stefan<br>
_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" rel="noreferrer" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><br>
</blockquote></div>