XML Performance question

[Lippmann, Jens]

Following the XML for the last couple month, I am surprised how little
attention is paid to performance. My  optimistic personality leads me to the
conclusion that performance is not an issue. :) 
 
However, I would be very interested on an expert's guess on the following
problem:
 
Assume the following XML document:
 
<PORTFOLIO>
   <ACCOUNT MANAGER="Joe Smith" ID="000001">
      <AUDIT DATE="03/31/1999">
         <SECURITYDESC>
            <SECURITY>
               <CUSIP>0815</CUSIP>
               <PRICE CURRENCY="US">4289.23</PRICE>
               <TRADEDSHARES>4289.23</TRADEDSHARES>
            </SECURITY>
         </SECURITYDESC>
      </AUDIT>
   </ACCOUNT>
</PORTFOLIO>
 

Each document will contain about 10^4 <SECURITY> elements each will contain
between 10 - 10^2 child tags, and I have to handle about 10^2 documents a
day, i.e. we're dealing with 10^7 to 10^8 tags. So far, the benchmarks I've
got are pretty devastating.  I have to visit every sub-element
of  <SECURITY> at least once during the number crunching and I cannot keep
everything in memory. I am considering one of the XML repositories to help
me with the job.
 
Any comment would be much appreciated.
 
Jens

xml-dev: A list for W3C XML Developers. To post, mailto:xml-dev at ic.ac.uk
Archived as: http://www.lists.ic.ac.uk/hypermail/xml-dev/ and on CD-ROM/ISBN 981-02-3594-1
To (un)subscribe, mailto:majordomo at ic.ac.uk the following message;
(un)subscribe xml-dev
To subscribe to the digests, mailto:majordomo at ic.ac.uk the following message;
subscribe xml-dev-digest
List coordinator, Henry Rzepa (mailto:rzepa at ic.ac.uk)