🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: bionet.software.srs
Article #190

Re: LINUX and >2 Gbyte files

#190
From: Tim Cutts
Date: Fri, 20 Oct 2000 00:00
34 lines
2438 bytes
In article <8sklos$rb4$1@snic.vub.ac.be>,
Guy Bottu  <gbottu@bigben.vub.ac.be> wrote:
>	Dear colleages,
>
>We are busy installing an SRS 6 server on a PC with Linux. We hit on a
>problem : with the last release of EMBL the size of some indexes grew
>beyond the limit of 2 Gbyte (not supported by a conventional file system
>on 32 bit machine). More in particular, it are the FeatureDescription
>and the Authors indexes who became too big, although I suspect that
>Authors is abnormally large because of some bug.
>
>Therefore this question : Has anyone already succeeded in making SRS 6
>work on a PC under LINUX with index files bigger than the limit ?

Well, you could split your data into smaller sub-databases, and then
modify your queries to search them together.  That would work right now.

Work is in progress to support larger file sizes on Linux, but I think
most of it needs to wait for the 2.4.0 kernel, which includes a number
of new filesystems, such as ext3.  I don't know whether ext3 is 64-bit,
but I have a feeling it might be.

You might also consider looking into SGI's xfs filesystem, which they
have donated to the Open Source community.  This may well support 64-bit
files (after all, it does on IRIX, but then the MIPS processors on IRIX
boxes are 64-bit).  I believe there are patches available to add the xfs
filesystem to the Linux 2.2.x kernel series.

You need to be confident about patching and compiling development
kernels to try this route though...

Good luck!

Tim.
Technical Details
Message-ID: <G0A*gK8Eo@news.chiark.greenend.org.uk>
Path: arc1-ca.pugleaf.net!unknown!not-for-mail
References: <8sklos$rb4$1@snic.vub.ac.be>

Show Full Headers
Complete Article Headers
X-Google-Language: ENGLISH,ASCII-7-bit
X-Google-Thread: fa6ec,7aac5fcae7493667
X-Google-Attributes: gidfa6ec,public
From: Tim Cutts <timc@chiark.greenend.org.uk>
Subject: Re: LINUX and >2 Gbyte files
Date: 2000/10/20
Message-ID: <G0A*gK8Eo@news.chiark.greenend.org.uk>
X-Deja-AN: 683802622
Approved: BIOSCI Approval Key <biosci-approval-key@net.bio.net>
References: <8sklos$rb4$1@snic.vub.ac.be>
X-Complaints-To: news@net.bio.net
X-Trace: niobium.hgmp.mrc.ac.uk 972051104 13410 193.62.192.80 (20 Oct 2000 14:11:44 GMT)
Organization: Linux Unlimited
X-Auth: PGPMoose V1.1 PGP bionet.software.srs iQCVAwUAOfBSlaCIqsWvyF5FAQGLjwP/ZhrjiSR71z2J6HHh3HkVEURWov6GQGjf UcbkyLwJ2nvoswWM5+ljNoIdxmxXgQz4nf0INC27U8f0wkLI8JMJVcxNsih3UCXZ kTDvLgt39bpI+0oM0wTg0CVYD1ns3EkLhAEH8A2tG2lt78aCC9hKMwf+29r8v8+E t4fQPblkUxc= =FR+1
NNTP-Posting-Date: 20 Oct 2000 14:11:44 GMT
Newsgroups: bionet.software.srs