Article View: sci.math.num-analysis
Article #941Re: LU decomposition on very large matrix.
From: Henry J. Cobb
Date: Sat, 02 Jan 1993 19:48
Date: Sat, 02 Jan 1993 19:48
37 lines
2092 bytes
2092 bytes
I'd first like to thank everybody for their input on this, there didn't seem to be much of a consensus on this, so we're goning to handle it like this: First a quick note: we're using a RS/6000 and we expect the matrix to be around 500+ MB. Our game plan is to mmap a file, map the matrix to that address space and fork off processes to handle chunks of it using MP style code. Our hope is that while some of the processes are blocked, waiting for the parts of the matrix that they've touched to be paged in, other processes will be able to continue crunching on pages that are curently in core. We can (and will) take over the machine to run this, but are wondering what the ratio should be between: Demand: The combined working set of the running processes. ( = Size of each block * number of blocks active at a time for a process * total number of processes) and Supply: Total system physical memory. (64 MB minus some amount for the OS and per process overhead). It seems as though Demand should be about equal to Supply, but we'd like to hear of any studies on this. It might prove to be useful to overcommit a little (for some sort of read-ahead?) or undercommit by some factor (to provide "extra caching"). At the moment we're tempted to just provide args for block-size and number of processes and test it out that way. -- Henry J. Cobb hcobb@fly2.berkeley.edu SFB Tyrant "A const pointer is a steady reference, while a pointer to const is a pledge not to tinker."
Technical Details
Message-ID:
<HCOBB.93Jan2194859@fly2.berkeley.edu>Path:
arc1-ca.pugleaf.net!sparky!uunet!usc!howland.reston.ans.net!paladin.american.edu!gatech!usenet.ins.cwru.edu!agate!agate!hcobbReferences:
<HCOBB.92Dec23143856@fly2.berkeley.edu>Show Full Headers
Complete Article Headers
Path: arc1-ca.pugleaf.net!sparky!uunet!usc!howland.reston.ans.net!paladin.american.edu!gatech!usenet.ins.cwru.edu!agate!agate!hcobb From: hcobb@fly2.berkeley.edu (Henry J. Cobb) Newsgroups: sci.math.num-analysis Subject: Re: LU decomposition on very large matrix. Date: 2 Jan 93 19:48:59 Organization: /rubin/hcobb/.organization Lines: 37 Distribution: inet Message-ID: <HCOBB.93Jan2194859@fly2.berkeley.edu> References: <HCOBB.92Dec23143856@fly2.berkeley.edu> NNTP-Posting-Host: fly2.berkeley.edu In-reply-to: hcobb@fly2.berkeley.edu's message of 23 Dec 92 14:38:56