<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<p>Perhaps another thing worth considering is that nikita, as a
spring-app, is multi-threaded. I think the default number of
threads in 10 so if you parallelized the import code you might see
an an increase in performance. It would also expose clearly if the
database is a bottleneck.</p>
<p>Also, remember to not use the H2 database for this as you will
likely see performance issues using an in-memory database.</p>
<p> - Thomas<br>
</p>
<div class="moz-cite-prefix">On 8/23/21 3:55 PM, Gareth Western
wrote:<br>
</div>
<blockquote type="cite" cite="mid:2EF16DD0-C670-4516-AFE4-E5694C4319F6@arkivverket.no">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style>@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}div.WordSection1
{page:WordSection1;}</style>
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">I’m making some progress
with testing the import of this large uttrekk. The next
issue I’d like to look at is performance. Serial upload is
too slow when the archive contains hundreds of thousands of
documents. A quick analysis of the structure indicates that
there are approximately 400,000 documents and 100,000
folders (mappe). Would it be safe to do at this level? Or
should I try at a higher level first (e.g. klasse, of which
there are approximately 4000)?<o:p></o:p></span></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
nikita-noark mailing list
<a class="moz-txt-link-abbreviated" href="mailto:nikita-noark@nuug.no">nikita-noark@nuug.no</a>
<a class="moz-txt-link-freetext" href="https://lists.nuug.no/mailman/listinfo/nikita-noark">https://lists.nuug.no/mailman/listinfo/nikita-noark</a>
</pre>
</blockquote>
</body>
</html>