<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
p.gmail-m3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph, li.gmail-m3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph, div.gmail-m3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph
{mso-style-name:gmail-m_3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-GB;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Verdana","sans-serif";
color:#1F497D;}
span.si
{mso-style-name:si;}
span.s2
{mso-style-name:s2;}
span.nb
{mso-style-name:nb;}
span.p
{mso-style-name:p;}
span.nv
{mso-style-name:nv;}
span.cm
{mso-style-name:cm;}
.MsoChpDefault
{mso-style-type:export-only;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">As I noted before, the problem is actually error messages. Line 644 simply collects error messages – so an out-of-memory error here indicates you have generated
> 4GB of error messages.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">I suggested increasing the memory previously because it would let you see the problem – but actually, with 4GB of error messages, I’d suggest that doing that
is not likely to help much,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">So what I would suggest instead is hacking the code to find out the error message.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Open admin-lib.inbc.php<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Go to line 644<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Find the line nearby that says
</span><span class="si"><b><span style="font-size:10.0pt;font-family:"Courier New";color:#BB6688;border:none windowtext 1.0pt;padding:0cm">$output_lines_from_cwb</span></b></span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">
= array(</span></span><span class="si"><b><span style="font-size:10.0pt;font-family:"Courier New";color:#BB6688;border:none windowtext 1.0pt;padding:0cm">$encode_command</span></b></span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">);</span></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><a name="_MailEndCompose"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></a></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">AFTER THAT LINE, but before the line that says
</span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">exec(</span></span><span class="si"><b><span style="font-size:10.0pt;font-family:"Courier New";color:#BB6688;border:none windowtext 1.0pt;padding:0cm">$encode_command</span></b></span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">,
</span></span><span class="si"><b><span style="font-size:10.0pt;font-family:"Courier New";color:#BB6688;border:none windowtext 1.0pt;padding:0cm">$output_lines_from_cwb</span></b></span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">,
</span></span><span class="si"><b><span style="font-size:10.0pt;font-family:"Courier New";color:#BB6688;border:none windowtext 1.0pt;padding:0cm">$exit_status_from_cwb</span></b></span><span class="s2"><span style="font-size:10.0pt;font-family:"Courier New";color:#BA2121;border:none windowtext 1.0pt;padding:0cm">);
</span></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">add the following:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-indent:36.0pt"><b><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">if (count($output_lines_from_cwb) > 1000) {show_var($output_lines_from_cwb); exiterror("abort"); }<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">What this line does is make things abort if it detects too many error messages.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">If you then get a readable error message, that might give you a hint what the real problem is. If not, try again moving the location o fthe hack line down the
file, before the following lines:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">before
</span><span class="nb"><span style="font-size:10.0pt;font-family:"Courier New";color:green;border:none windowtext 1.0pt;padding:0cm">exec</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">(</span></span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$makeall_command</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$output_lines_from_cwb</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$exit_status_from_cwb</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">);</span></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">before
</span><span class="nb"><span style="font-size:10.0pt;font-family:"Courier New";color:green;border:none windowtext 1.0pt;padding:0cm">exec</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">(</span></span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$compress_command</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$compression_output</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$exit_status_from_cwb</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">);</span></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">before the second example fo
</span><span class="nb"><span style="font-size:10.0pt;font-family:"Courier New";color:green;border:none windowtext 1.0pt;padding:0cm">exec</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">(</span></span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$makeall_command</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$output_lines_from_cwb</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">,</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="nv"><span style="font-size:10.0pt;font-family:"Courier New";color:#19177C;border:none windowtext 1.0pt;padding:0cm">$exit_status_from_cwb</span></span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">);</span></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">before
</span><span class="p"><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;border:none windowtext 1.0pt;padding:0cm">}</span></span><span style="font-size:10.0pt;font-family:"Courier New";color:#555555;background:#FFFF99">
</span><span class="cm"><i><span style="font-size:10.0pt;font-family:"Courier New";color:#408080;border:none windowtext 1.0pt;padding:0cm">/* end else (from if cwb index already exists) */</span></i></span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Hopefully, as I say, doing this will get you a gimpse of the first 1,000 lines of erro, which may tell you what the underlying problem is.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Hope this helps<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">best<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Andrew.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> cwb-bounces@sslmit.unibo.it [mailto:cwb-bounces@sslmit.unibo.it]
<b>On Behalf Of </b>VIVALDI PALATRESI, JORGE<br>
<b>Sent:</b> 26 July 2017 08:44<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> Re: [CWB] Unable to index a corpus<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Hi Andrew,<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">2017-07-25 17:37 GMT+02:00 Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>>:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Did you restart Apache after changing the php.ini file?
</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal">Yes <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Apache only loads php.ini on startup.</span><o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I also check the change with phpinfo() .<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Currently the limit is placed 4096M and the error message is:<br>
<br>
[Wed Jul 26 09:33:57.230338 2017] [:error] [pid 9248] [client <a href="http://10.80.10.56:63665">
10.80.10.56:63665</a>] PHP Fatal error: Allowed memory size of 4294967296 bytes exhausted (tried to allocate 1073741832 bytes) in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y">
http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Does it make sense?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Should I again the memory_limit value?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">My corpus size is:<br>
-rw-r--r-- 1 root staff 666666964 jul 20 12:37 /var/local/CQPweb/upload/ca_allDocs.cqp<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Best,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Jorge<br>
<br>
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">best</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Andrew.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a name="m_3379620788040489354__MailEndCompose"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span></a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">
<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a>]
<b>On Behalf Of </b>VIVALDI PALATRESI, JORGE<br>
<b>Sent:</b> 25 July 2017 12:47<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> Re: [CWB] Unable to index a corpus</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Andrew<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">I changed permissions in the HTML document tree and change php.ini as suggested and try to reinstall my corpus. Unfortunately, it still fails issuing again the message:<br>
<br>
[Tue Jul 25 13:27:23.297261 2017] [:error] [pid 28750] [client <a href="http://10.80.10.56:60272" target="_blank">
10.80.10.56:60272</a>] PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">
http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">I tested several sizes of the
<span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif"">memory_limit in the php.ini file but none seems to be correct. Currently it is set to 1024M (I also tested 2024M).
<br>
Is this value reasonable? <br>
The corpus that I am using for testing contains something less than 30 M tokens.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Any suggestion is very welcomed.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thank you in advance,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><br>
Jorge<br>
<span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif""><br>
<br>
<br>
</span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">2017-07-24 19:04 GMT+02:00 Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>>:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Hi Jorge,</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="gmail-m3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph">
<span style="font-size:10.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D">
</span>PHP Warning: chmod(): Operation not permitted in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 601, referer: http://<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y</a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">This arises from a permissions issue as you suspect, but the issue arises from your HTML document
tree – not your data spaces. You need to make sure that the http daemon has permissions to create files within the main “cqpweb” web folder. (i.e. Alongside lib, exe and friends)</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="gmail-m3379620788040489354m-1085850983587304933gmail-m-6421581912354732827m-4753821230604603695gmail-m7801814721378929537msolistparagraph" style="margin-bottom:12.0pt">
<span style="font-size:10.0pt;font-family:Symbol;color:#1F497D">·</span><span style="font-size:7.0pt;color:#1F497D">
</span>PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind" target="_blank">http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind</a>ex.php?thisF=installCorpus&uT=y<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">128 MB of RAM is
<b>very</b> stingy for CQPweb if you are working with large corpora. I suggest increasing the limit in php.ini.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Fixing this will allow you to see if there is another error message at that point – I suspect there
is but that the memory error is blocking you from seeing what it is.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">best</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D">Andrew.</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><a name="m_3379620788040489354_m_-108585098358730"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:#1F497D"> </span></a><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">
<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a>]
<b>On Behalf Of </b>VIVALDI PALATRESI, JORGE<br>
<b>Sent:</b> 24 July 2017 10:01<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> Re: [CWB] Unable to index a corpus</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Andrew,<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">2017-07-23 0:56 GMT+02:00 Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>>:<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The most likely cause here is that CQP is not on the path *used by the http daemon* (which, at least when the daemon is Apache, can be and often is different to the usual shell
path).<br>
<br>
Have you tried explicitly setting the $path_to_cwb config variable?<o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The problem seems to be solved setting up this config variable.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Unfortunately a new problem arise. The web client screen still blank the now the message in the error.los is:<br>
<br>
[Mon Jul 24 10:44:35.349201 2017] [:error] [pid 18979] [client <a href="http://10.80.10.56:50557" target="_blank">
10.80.10.56:50557</a>] PHP Warning: chmod(): Operation not permitted in /var/www/html/UPFcorpora/lib/admin-install.inc.php on line 601, referer: htt p://<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y" target="_blank">corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/index.php?thisF=installCorpus&uT=y</a><br>
[Mon Jul 24 10:44:41.850762 2017] [:error] [pid 18979] [client <a href="http://10.80.10.56:50557" target="_blank">
10.80.10.56:50557</a>] PHP Fatal error: Allo wed memory size of 134217728 bytes exhausted (tried to allocate 33554440 bytes) in /var/www/html/UPFcorp ora/lib/admin-install.inc.php on line 644, referer:
<a href="http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind" target="_blank">http://corpora-tcl-iula.s.upf.edu/UPFcorpora/adm/ind</a> ex.php?thisF=installCorpus&uT=y<br>
<br>
It seems that the problem now regards to CQPweb disk locations/permissions. My location and permission are identical to previous working installation (using CQPweb 3.1.12 and CWB 3.1) and are the following:<br>
<br>
jvivaldi@corpora-tcl-iula:~$ ls -l /var/local/CQPweb/<br>
total 16<br>
drwxrwsrwx 3 www-data www-data 4096 jul 24 10:44 index<br>
drwxrwsrwx 2 www-data www-data 4096 jul 24 10:47 registry<br>
drwxrwsrwx 2 www-data www-data 4096 jul 17 10:58 temp<br>
drwxrwsrwx 2 www-data www-data 4096 jul 20 12:37 upload<br>
jvivaldi@corpora-tcl-iula:~$<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I am the owner of the root directory (/var/local/CQPweb/).<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Are these permissions correct?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
You can also try going to the admin control panel and then to "system diagnostics" and then " Run a system check on the CQP back-end process connection". This function does not yet check everything that can go wrong but it does check some of the major things.<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Yes. I ran this check and it is ok.<br>
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Any suggestion will be welcomed<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Thank you in advance<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Jorge<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid windowtext 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
best<br>
<br>
Andrew.<br>
<br>
-----Original Message-----<br>
From: <a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@sslmit.unibo.it" target="_blank">cwb-bounces@sslmit.unibo.it</a>] On Behalf Of Stefan Evert<br>
Sent: 21 July 2017 12:04<br>
To: VIVALDI PALATRESI, JORGE<br>
Cc: CWBdev Mailing List<br>
Subject: Re: [CWB] Unable to index a corpus<br>
<br>
<br>
> On 21 Jul 2017, at 12:10, VIVALDI PALATRESI, JORGE <<a href="mailto:jorge.vivaldi@upf.edu" target="_blank">jorge.vivaldi@upf.edu</a>> wrote:<br>
><br>
> I revert CQPweb as suggested but now the message in the browser is just:<br>
> ERROR: CQP backend startup failed<br>
> Obviously, cqp and related programs are all on the path.<br>
> Any suggestion?<br>
<br>
No idea, this goes far beyond my knowledge of CQPweb, so we'll have to wait for Andrew's expertise.<br>
<br>
Did the revert work cleanly or do you have local modifications that might cause the error?<br>
<br>
Best,<br>
Stefan<br>
<br>
<br>
_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><br>
_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Jorge Vivaldi Palatresi<br>
Institut Universitari de Lingüística Aplicada<br>
Universitat Pompeu Fabra<br>
C/ Roc Boronat, 138<br>
08018 Barcelona<br>
Espanya<br>
<br>
<a href="tel:+34%20935%2042%2023%2032" target="_blank">+34 93 542 2332</a><br>
<a href="https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm" target="_blank">https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm</a><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt"><br>
_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it" target="_blank">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Jorge Vivaldi Palatresi<br>
Institut Universitari de Lingüística Aplicada<br>
Universitat Pompeu Fabra<br>
C/ Roc Boronat, 138<br>
08018 Barcelona<br>
Espanya<br>
<br>
<a href="tel:+34%20935%2042%2023%2032" target="_blank">+34 93 542 2332</a><br>
<a href="https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm" target="_blank">https://www.upf.edu/pdi/iula/jorge.vivaldi/index_esp.htm</a><o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@sslmit.unibo.it">CWB@sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<br>
-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Jorge Vivaldi Palatresi<br>
Institut Universitari de Lingüística Aplicada<br>
Universitat Pompeu Fabra<br>
C/ Roc Boronat, 138<br>
08018 Barcelona<br>
Espanya<br>
<br>
+34 93 542 2332<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>