Sorting Large XML files

[Trev]

Hey all,

Im curious to know what solutions/technologies there are for transforming/sorting large sized xml files(20-100MB)?

Taking into account that a multithreaded environment is required for each transformation and the limitations of the DOM.

I have a "adhoc" solution but it by no means uses any wheels (if you know what i mean).

Thanks for any input.

[khp]

Post your code and I'll try to have a look at it. But ofcourse, sorting a 100MB file will alway be very resource intensive.

I'am curious how much RAM does the thing use ?.

[rfmobile]

Take a look at using an XML hive database. Unless you really, really need to reparse all of your XML repreatedly, you will be better off using an XML native database. The underlying DB can create "views" of the data much like an SQL database.

There's several out there - commercial and free.

-rick