<div dir="ltr"><div class="gmail_quote"><div dir="ltr"><div class="gmail_extra"><span class=""><div class="gmail_quote">On Sun, Jul 24, 2016 at 10:19 AM, Hardie, Andrew <span dir="ltr"><<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>></span> wrote:</div></span><div class="gmail_quote"><span class=""><br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div lang="EN-GB" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">CQPweb requires all corpora to have at least one <text> element, and every text element has to have an id i.e. everything within the corpus has to be contained
within a sequence of one or more<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"><text id=”somethinghere”><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">…<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"></text></span></p></div></div></blockquote><div><br></div></span><div>Thanks, Andrew. It turns out the problem was that I had been using the name "id" instead of "text" for the element. Now that I've changed that, I was able to successfully create the corpus in CQPweb.</div><div><br></div><div>My source files have quite a bit of metadata, which I've encoded as follows:</div><div><br></div><div><font face="monospace, monospace"><<font color="#ff0000">text</font> <font color="#38761d">id</font>="CCN-F2-02_D_StB.ortografica.txt" <font color="#38761d">corpus</font>="test" <font color="#38761d">tagger</font>="freeling-xml" <font color="#38761d">language</font>="spanish" <font color="#38761d">location</font>="concepcion" <font color="#38761d">sex</font>="f"><br></font></div><div><font face="monospace, monospace">...</font></div><div><font face="monospace, monospace"></text></font></div><br>I'm now at the CQPweb "Design and insert a text-metadata table for the corpus" page, but it tells me that "No XML annotations found for this corpus". Is there something wrong with how I did the encoding above? I can use all of these XML elements in cqp searches directly, but here they aren't recognized.</div><div class="gmail_quote"><br></div><div class="gmail_quote">(I've checked chapter 6 of the manual, to no avail).</div><div class="gmail_quote"><br></div><div class="gmail_quote">Best wishes,</div><div class="gmail_quote">Scott<div><div class="h5"><br><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div lang="EN-GB" link="blue" vlink="purple"><p class="MsoNormal"><b><span lang="EN-US" style="font-size:10pt;font-family:Tahoma,sans-serif">From:</span></b><span lang="EN-US" style="font-size:10pt;font-family:Tahoma,sans-serif"> <a href="mailto:cwb-bounces@liste.sslmit.unibo.it" target="_blank">cwb-bounces@liste.sslmit.unibo.it</a> [mailto:<a href="mailto:cwb-bounces@liste.sslmit.unibo.it" target="_blank">cwb-bounces@liste.sslmit.unibo.it</a>]
<b>On Behalf Of </b>Scott Sadowsky</span><br></p></div></blockquote></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div><div class="h5"><div lang="EN-GB" link="blue" vlink="purple"><div><p class="MsoNormal"><span lang="EN-US" style="font-size:10pt;font-family:Tahoma,sans-serif">
<b>Sent:</b> 24 July 2016 14:10<br>
<b>To:</b> Open source development of the Corpus WorkBench; CWBdev Mailing List<br>
<b>Subject:</b> Re: [CWB] WebInABox: Can't import existing corpora from host<u></u><u></u></span></p><div><div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">On Sat, Jul 23, 2016 at 3:19 PM, Hardie, Andrew <<a href="mailto:a.hardie@lancaster.ac.uk" target="_blank">a.hardie@lancaster.ac.uk</a>> wrote:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Hi Andrew,<u></u><u></u></p>
</div>
<div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">Might it be a permissions issue? Depending on how you mounted it, the Vbox shared folder containing
the index data may not be accessible to the http daemon. Check with ls –l.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">Please check this, if it’s not this, then please post the HOME line of the registry in your reply,
and I’ll use that to check the code </span><u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks, Andrew. It was indeed a permissions issue. In order to troubleshoot this (as symlinks can be tricky), I copied the index files and registry into the CQPWiaB VM and placed them into the same directories as the BNC sampler and Mandarin
corpora. The problems persisted, so I changed permissions and ownership as follows (replace <span style="font-size:7.5pt;font-family:"Courier New"">test_flxml_corpus</span> with the name of your corpus):<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">cd /var/cqpweb/index<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chown www-data:www-data <span style="font-size:10pt;font-family:"Courier New"">test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chmod 755 <span style="font-size:10pt;font-family:"Courier New"">test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">cd <span style="font-size:10pt;font-family:"Courier New"">test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chown www-data:www-data *<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chmod 644 *<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">cd ../../registry/<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chown www-data:www-data <span style="font-size:10pt;font-family:"Courier New"">test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">sudo chmod 664 <span style="font-size:10pt;font-family:"Courier New"">test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">So now I can attempt to import the corpus, but I run into a new error: "Pre-indexed corpora require s-attributes text and text_id!!". I've searched the manual included in CQPWiaB but there's no mention of "text_id". What am I doing wrong?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Below is the content of my registry file, in case that helps.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Scott<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">## registry entry for corpus TEST_FLXML_CORPUS</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">## </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># long descriptive name for the corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">NAME "Test corpus using FreeLing XML tagger"</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># corpus ID (must be lowercase in registry!)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ID test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># path to binary data files</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">HOME /var/cqpweb/index/test_flxml_corpus</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># optional info file (displayed by "info;" command in CQP)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">INFO /var/cqpweb/index/test_flxml_corpus/.info</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># corpus properties provide additional information about the corpus:</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##:: charset = "utf8" # character encoding of corpus data</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##:: language = "es-CL" # insert ISO code for language (de, en, fr, ...)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">## p-attributes (token annotations)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE word</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE lemma</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE tag</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE ctag</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE pos</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">ATTRIBUTE type</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">## s-attributes (structural markup)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">##</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># <s> ... </s></span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># (no recursive embedding allowed)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE s</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># <id corpus=".." tagger=".." file=".." label=".." channel=".." audience=".." purpose=".." genre=".." field=".." area=".." source=".."> ... </id></span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># (no recursive embedding allowed)</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_corpus # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_tagger # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_file # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_label # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_channel # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_audience # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_purpose # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_genre # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_field # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_area # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New"">STRUCTURE id_source # [annotations]</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Courier New""># Yours sincerely, the Encode tool.</span><u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10pt;font-family:Tahoma,sans-serif">From:</span></b><span lang="EN-US" style="font-size:10pt;font-family:Tahoma,sans-serif">
<a href="mailto:cwb-bounces@liste.sslmit.unibo.it" target="_blank">cwb-bounces@liste.sslmit.unibo.it</a> [<a href="mailto:cwb-bounces@liste.sslmit.unibo.it" target="_blank">mailto:cwb-bounces@liste.sslmit.unibo.it</a>]
<b>On Behalf Of </b>Scott Sadowsky<br>
<b>Sent:</b> 23 July 2016 20:07<br>
<b>To:</b> Open source development of the Corpus WorkBench<br>
<b>Subject:</b> [CWB] WebInABox: Can't import existing corpora from host</span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Hi all!</span><u></u><u></u></p>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">I'm using the brilliant CQP Web in a Box to try and install an already-indexed corpus. This corpus is located on my host machine, and I'm using VirtualBox's
virtual folders to access it from within CQPWiaB. I've made a local copy of the registry file, placed it inside VirtualBox, and edited it to reflect the difference in paths between the host machine and the virtual machine, and everything seems to be where
it should be (or point to where it should point). But when I go to CQPWiaB's "Install a corpus you have already indexed in CWB", enter the corpus's name and try to install it, I get one of two errors:</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">1. If I choose the option to look for the registry file in CQPweb's usual directory (which is where I've placed the modified registry file), it says:
"A data-directory path could not be found in the registry file for the CWB corpus you specified. Either the data-directory is unspecified, or it is specified with a relative path (an absolute path is needed)".</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">I'm using an absolute path in the registry file (/var/cqpweb/index/test_flxml_corpus), and all the files appear there in my file manager.</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">2. If I choose the option to specify the location of the registry and enter the exact same directory that CQPweb uses as its default, but manually,
I get this error: "A corpus by that name already exists in the CQPweb registry!".</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">I also get error 2 if I put in "/dev/null/" or garbage text ("asdfasdfas").</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Any idea what's going on?</span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"> </span><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Thanks,<br>
Scott</span><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div></div></div>
</div>
<br></div></div>_______________________________________________<br>
CWB mailing list<br>
<a href="mailto:CWB@liste.sslmit.unibo.it" target="_blank">CWB@liste.sslmit.unibo.it</a><br>
<a href="http://liste.sslmit.unibo.it/mailman/listinfo/cwb" rel="noreferrer" target="_blank">http://liste.sslmit.unibo.it/mailman/listinfo/cwb</a><br>
</blockquote><div> </div></div><br clear="all"><div><br></div>
</div></div>
</div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div style="font-size:12.7272720336914px">Dr. Scott Sadowsky<br>Profesor Asistente de Lingüística</div><div dir="ltr" style="font-size:12.7272720336914px">Pontificia Universidad Católica de Chile<br></div><div dir="ltr" style="font-size:12.7272720336914px"><br></div><div dir="ltr" style="font-size:12.7272720336914px">ssadowsky gmail com</div><div dir="ltr" style="font-size:12.7272720336914px">scsadowsky uc cl<br><a href="http://sadowsky.cl/" target="_blank">http://sadowsky.cl/</a></div><div dir="ltr" style="font-size:12.7272720336914px"> </div></div></div></div></div></div></div></div></div></div></div>
</div>