Sparse cross-products of metadata in scientific simulation management

Simple item page
dc.contributor.authorJames, H.A.
dc.contributor.authorHawick, K.A.
dc.date.accessioned2013-05-15T02:59:58Z
dc.date.available2013-05-15T02:59:58Z
dc.date.issued2005
dc.description.abstractManaging scientific data is by no means a trivial task even in a single site environment with a small number of researchers involved. We discuss some issues concerned with posing well-specified experiments in terms of parameters or instrument settings and the metadata framework that arises from doing so. We are particularly interested in parallel computer simulation experiments, where very large quantities of warehouse-able data are involved. We consider SQL databases and other framework technologies for manipulating experimental data. Our framework manages the the outputs from parallel runs that arise from large cross-products of parameter combinations. Considerable useful experiment planning and analysis can be done with the sparse metadata without fully expanding the parameter cross-products. Extra value can be obtained from simulation output that can subsequently be data-mined. We have particular interests in running large scale Monte-Carlo physics model simulations. Finding ourselves overwhelmed by the problems of managing data and compute ¿resources, we have built a prototype tool using Java and MySQL that addresses these issues. We use this example to discuss type-space management and other fundamental ideas for implementing a laboratory information management system.en
dc.identifier.citationJames, H.A., Hawick, K.A. (2005), Sparse cross-products of metadata in scientific simulation management, Research Letters in the Information and Mathematical Sciences, 7, 89-115en
dc.identifier.issn1175-2777
dc.identifier.urihttp://hdl.handle.net/10179/4451
dc.language.isoenen
dc.publisherMassey Universityen
dc.subjectMetadataen
dc.subjectScientific dataen
dc.subjectData miningen
dc.subjectData managementen
dc.titleSparse cross-products of metadata in scientific simulation managementen
dc.typeArticleen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Sparse_Cross-Products_of_Metadata_in_Scientific_Simulation_Management.pdf
Size:
4.98 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Research Letters in the Information and Mathematical Sciences