<div dir="ltr">Hi Andrew,<br><div><div class="gmail_extra"><br><div class="gmail_quote">2017-07-25 17:37 GMT+02:00 Hardie, Andrew <span dir="ltr"><<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-GB">
<div class="gmail-m_3379620788040489354WordSection1">
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Did you restart Apache after changing the php.ini file?
</span></p></div></div></blockquote><div>Yes <br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-GB"><div class="gmail-m_3379620788040489354WordSection1"><p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Apache only loads php.ini on startup.</span></p></div></div></blockquote><div>I also check the change with phpinfo() .<br><br></div><div>Currently the limit is placed 4096M and the error message is:<br><br>[Wed Jul 26 09:33:57.230338 2017] [:error] [pid 9248] [client <a href="http://10.80.10.56:63665">10.80.10.56:63665</a>] PHP Fatal error: Allowed memory size of 4294967296 bytes exhausted (tried to allocate 1073741832 bytes) in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 644, referer: <a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y">http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y</a><br><br></div><div>Does it make sense?<br></div><div>Should I again the memory_limit value?<br></div><div>My corpus size is:<br>-rw-r--r-- 1 root staff 666666964 jul 20 12:37 /var/local/CQPweb/upload/ca_allDocs.cqp<br></div><div><br></div><div>Best,<br><br></div><div>Jorge<br><br><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-GB"><div class="gmail-m_3379620788040489354WordSection1"><p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">best<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Andrew.<u></u><u></u></span></p>
<p class="MsoNormal"><a name="m_3379620788040489354__MailEndCompose"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"><u></u> <u></u></span></a></p>
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> <a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.<wbr>unibo.it</a>]
<b>On Behalf Of </b>VIVALDI PALATRESI, JORGE<br>
<b>Sent:</b> 25 July 2017 12:47<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> Re: [CWB] Unable to index a corpus<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Hi Andrew<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">I changed permissions in the HTML document tree and change php.ini as suggested and try to reinstall my corpus. Unfortunately, it still fails issuing again the message:<br>
<br>
[Tue Jul 25 13:27:23.297261 2017] [:error] [pid 28750] [client <a href="http://10.80.10.56:60272" target="_blank">
10.80.10.56:60272</a>] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorpora/lib/<wbr>admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">
http://corpora-tcl-iula.s.upf.<wbr>edu/UPFcorpora/adm/index.php?<wbr>thisF=installCorpus&uT=y</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">I tested several sizes of the <span style="font-size:11pt;font-family:"Calibri","sans-serif"" lang="EN-US">
memory_limit in the php.ini file but none seems to be correct. Currently it is set to 1024M (I also tested 2024M).
<br>
Is this value reasonable? <br>
The corpus that I am using for testing contains something less than 30 M tokens.</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Any suggestion is very welcomed.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Thank you in advance,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt"><br>
Jorge<br>
<span style="font-size:11pt;font-family:"Calibri","sans-serif"" lang="EN-US"><br>
<br>
<br>
<br>
</span><u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">2017-07-24 19:04 GMT+02:00 Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>>:<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Hi Jorge,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="gmail-m_3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph">
<span style="font-size:10pt;font-family:Symbol;color:rgb(31,73,125)">·</span><span style="font-size:7pt;color:rgb(31,73,125)">
</span>PHP Warning: chmod(): Operation not permitted in /var/www/html/UPFcorpora/lib/<wbr>admin-install.inc.php on line 601, referer: http://<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">corpora-tcl-iula.s.upf.<wbr>edu/UPFcorpora/adm/index.php?<wbr>thisF=installCorpus&uT=y</a><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">This arises from a permissions issue as you suspect, but the issue arises from your HTML document
tree – not your data spaces. You need to make sure that the http daemon has permissions to create files within the main “cqpweb” web folder. (i.e. Alongside lib, exe and friends)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="gmail-m_3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph" style="margin-bottom:12pt">
<span style="font-size:10pt;font-family:Symbol;color:rgb(31,73,125)">·</span><span style="font-size:7pt;color:rgb(31,73,125)">
</span>PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorpora/lib/<wbr>admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind" target="_blank">http://corpora-tcl-iula.s.upf.<wbr>edu/UPFcorpora/adm/ind</a>ex.php?<wbr>thisF=installCorpus&uT=y<u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">128 MB of RAM is
<b>very</b> stingy for CQPweb if you are working with large corpora. I suggest increasing the limit in php.ini.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Fixing this will allow you to see if there is another error message at that point – I suspect there
is but that the memory error is blocking you from seeing what it is.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">best</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)">Andrew.</span><u></u><u></u></p>
<p class="MsoNormal"><a name="m_3379620788040489354_m_-1085850983587304933_m_-64215819123547"><span style="font-size:10pt;font-family:"Verdana","sans-serif";color:rgb(31,73,125)"> </span></a><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:10pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10pt;font-family:"Tahoma","sans-serif"" lang="EN-US">
<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.<wbr>unibo.it</a>]
<b>On Behalf Of </b>VIVALDI PALATRESI, JORGE<br>
<b>Sent:</b> 24 July 2017 10:01<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> Re: [CWB] Unable to index a corpus</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">Andrew,<u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">2017-07-23 0:56 GMT+02:00 Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>>:<u></u><u></u></p>
<p class="MsoNormal">The most likely cause here is that CQP is not on the path *used by the http daemon* (which, at least when the daemon is Apache, can be and often is different to the usual shell
path).<br>
<br>
Have you tried explicitly setting the $path_to_cwb config variable?<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">The problem seems to be solved setting up this config variable.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Unfortunately a new problem arise. The web client screen still blank the now the message in the error.los is:<br>
<br>
[Mon Jul 24 10:44:35.349201 2017] [:error] [pid 18979] [client <a href="http://10.80.10.56:50557" target="_blank">
10.80.10.56:50557</a>] PHP Warning: chmod(): Operation not permitted in /var/www/html/UPFcorpora/lib/<wbr>admin-install.inc.php on line 601, referer: htt p://<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">corpora-tcl-iula.s.upf.<wbr>edu/UPFcorpora/adm/index.php?<wbr>thisF=installCorpus&uT=y</a><br>
[Mon Jul 24 10:44:41.850762 2017] [:error] [pid 18979] [client <a href="http://10.80.10.56:50557" target="_blank">
10.80.10.56:50557</a>] PHP Fatal error: Allo wed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorp ora/lib/admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind" target="_blank">http://corpora-tcl-iula.s.upf.<wbr>edu/UPFcorpora/adm/ind</a> ex.php?thisF=installCorpus&uT=<wbr>y<br>
<br>
It seems that the problem now regards to CQPweb disk locations/permissions. My location and permission are identical to previous working installation (using CQPweb 3.1.12 and CWB 3.1) and are the following:<br>
<br>
jvivaldi@corpora-tcl-iula:~$ ls -l /var/local/CQPweb/<br>
total 16<br>
drwxrwsrwx 3 www-data www-data 4096 jul 24 10:44 index<br>
drwxrwsrwx 2 www-data www-data 4096 jul 24 10:47 registry<br>
drwxrwsrwx 2 www-data www-data 4096 jul 17 10:58 temp<br>
drwxrwsrwx 2 www-data www-data 4096 jul 20 12:37 upload<br>
jvivaldi@corpora-tcl-iula:~$<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">I am the owner of the root directory (/var/local/CQPweb/).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Are these permissions correct?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<p class="MsoNormal"><br>
You can also try going to the admin control panel and then to "system diagnostics" and then " Run a system check on the CQP back-end process connection". This function does not yet check everything that can go wrong but it does check some of the major things.<u></u><u></u></p>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">Yes. I ran this check and it is ok.<br>
<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Any suggestion will be welcomed<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">Thank you in advance<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12pt">Jorge<u></u><u></u></p>
</div>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;padding:0cm 0cm 0cm 6pt;margin:5pt 0cm 5pt 4.8pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<p class="MsoNormal"><br>
best<br>
<br>
Andrew.<br>
<br>
-----Original Message-----<br>
From: <a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.<wbr>unibo.it</a>] On Behalf Of Stefan Evert<br>
Sent: 21 July 2017 12:04<br>
To: VIVALDI PALATRESI, JORGE<br>
Cc: CWBdev Mailing List<br>
Subject: Re: [CWB] Unable to index a corpus<br>
<br>
<br>
> On 21 Jul 2017, at 12:10, VIVALDI PALATRESI, JORGE <<a href="mailto:jorge.vivaldi@upf.edu" target="_blank">jorge.vivaldi@upf.edu</a>> wrote:<br>
><br>
> I revert CQPweb as suggested but now the message in the browser is just:<br>
> ERROR: CQP backend startup failed<br>
> Obviously, cqp and related programs are all on the path.<br>
> Any suggestion?<br>
<br>
No idea, this goes far beyond my knowledge of CQPweb, so we'll have to wait for Andrew's expertise.<br>
<br>
Did the revert work cleanly or do you have local modifications that might cause the error?<br>
<br>
Best,<br>
Stefan<br>
<br>
<br>
______________________________<wbr>_________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/<wbr>mailman/listinfo/cwb</a><br>
______________________________<wbr>_________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/<wbr>mailman/listinfo/cwb</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Jorge Vivaldi Palatresi<br>
Institut Universitari de Lingüística Aplicada<br>
Universitat Pompeu Fabra<br>
C/ Roc Boronat, 138<br>
08018 Barcelona<br>
Espanya<br>
<br>
<a href="tel:+34%20935%2042%2023%2032" target="_blank">+34 93 542 2332</a><br>
<a href="https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm" target="_blank">https://www.upf.edu/pdi/iula/<wbr>jorge.vivaldi/index_esp.htm</a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12pt"><br>
______________________________<wbr>_________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/<wbr>mailman/listinfo/cwb</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Jorge Vivaldi Palatresi<br>
Institut Universitari de Lingüística Aplicada<br>
Universitat Pompeu Fabra<br>
C/ Roc Boronat, 138<br>
08018 Barcelona<br>
Espanya<br>
<br>
<a href="tel:+34%20935%2042%2023%2032" target="_blank">+34 93 542 2332</a><br>
<a href="https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm" target="_blank">https://www.upf.edu/pdi/iula/<wbr>jorge.vivaldi/index_esp.htm</a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>______________________________<wbr>_________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" rel="noreferrer" target="_blank">http://liste.sslmit.unibo.it/<wbr>mailman/listinfo/cwb</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>Jorge Vivaldi Palatresi<br>Institut Universitari de Lingüística
Aplicada<br>Universitat Pompeu Fabra<br>C/ Roc Boronat, 138<br>08018
Barcelona<br>Espanya<br><br>+34 93 542 2332<br><br></div></div></div></div></div></div></div></div></div></div></div>
</div></div></div>