🚀 go-pugleaf

RetroBBS NetNews Server

Inspired by RockSolid Light RIP Retro Guy

Article View: fa.netbsd.tech.kern
Article #68

Re: pbulk using tmpfs

#68
From: Thomas Klausner
Date: Sat, 20 Apr 2013 22:18
48 lines
4501 bytes
On Sat, Apr 20, 2013 at 11:47:59PM +0200, iMil wrote:
> I'm running bulk builds for various archs using pbulk for quite
> some time now, and one of the domUs used for this is hosted by
> a server with a LSI MPT Fusion Raid controller. In short, that
> controller sucks, poor write performances, it is a well known
> fact. In order to speed up builds, I would like to know if I
> could benefit from tmpfs by mounting the WRKOBJDIR as a tmpfs
> directory.
> 
> In particular, while most packages will fit into a couple of
> megabytes, some of them (firefox, libreoffice, openoffice,
> koffice and such) take a couple of gigabytes to get built.
> 
> My question is: how will tmpfs behave? If I mount the WRKOBJDIR
> without any argument, it will "use", if I understand correctly
> the manpage, all of the available memory. Does this mean I will
> end up in a situation were the system memory will be filled by
> the build or is there some kind of smart mechanism within tmpfs
> which will "overflow" somewhere?

I have this setup (mostly created with mksandbox):
tmpfs on /home/wiz/sandbox type tmpfs (local)
/bin on /home/wiz/sandbox/bin type null (read-only, local)
/sbin on /home/wiz/sandbox/sbin type null (read-only, local)
/lib on /home/wiz/sandbox/lib type null (read-only, local)
/libexec on /home/wiz/sandbox/libexec type null (read-only, local)
/usr/X11R7 on /home/wiz/sandbox/usr/X11R7 type null (read-only, local)
/usr/bin on /home/wiz/sandbox/usr/bin type null (read-only, local)
/usr/games on /home/wiz/sandbox/usr/games type null (read-only, local)
/usr/include on /home/wiz/sandbox/usr/include type null (read-only, local)
/usr/lib on /home/wiz/sandbox/usr/lib type null (read-only, local)
/usr/libdata on /home/wiz/sandbox/usr/libdata type null (read-only, local)
/usr/libexec on /home/wiz/sandbox/usr/libexec type null (read-only, local)
/usr/share on /home/wiz/sandbox/usr/share type null (read-only, local)
/usr/sbin on /home/wiz/sandbox/usr/sbin type null (read-only, local)
/var/mail on /home/wiz/sandbox/var/mail type null (read-only, local)
/archive/foreign/src on /home/wiz/sandbox/usr/src type null (read-only, local)
/archive/foreign/pkgsrc on /home/wiz/sandbox/usr/pkgsrc type null (local)
/archive/foreign/xsrc on /home/wiz/sandbox/usr/xsrc type null (read-only, local)
/archive/packages/6.99.19 on /home/wiz/sandbox/packages type null (local)
/archive/distfiles on /home/wiz/sandbox/distfiles type null (local)

and have been building all my packages this way for years now, using
pbulk. Sometimes I trigger some tmpfs panics (see e.g. kern/42484,
kern/47480, kern/47739) but otherwise it works very well, is fast and
usually stable. The machine I used this on regularly had 12GB RAM
though (now even more), so I'm not RAM-limited.
 Thomas
Technical Details
Message-ID: <fa.xyFhuEk8Gh3J0Dn5I3n0+lj7FLM@ifi.uio.no>
Path: arc1-ca.pugleaf.net!hg5ni4813wib.1!nntp.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!nntp.uio.no!.POSTED!not-for-mail
References: <fa.cW6W/MVReNTw4z6/4YxsFLr/9G0@ifi.uio.no> <fa.e83HgwaM2kaCuuUpS6tVoQ1+1Kk@ifi.uio.no>

Show Full Headers
Complete Article Headers
X-Google-Thread: 10c6f4,786e9905c90c1180
X-Google-NewGroupId: yes
X-Google-Attributes: gidb7e13b6095,domainid0,public,usenet
X-Google-Language: ENGLISH,ASCII-7-bit
X-Received: by 10.180.188.52 with SMTP id fx20mr9522550wic.3.1366496286198;
        Sat, 20 Apr 2013 15:18:06 -0700 (PDT)
Path: arc1-ca.pugleaf.net!hg5ni4813wib.1!nntp.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!nntp.uio.no!.POSTED!not-for-mail
From: Thomas Klausner <wiz@NetBSD.org>
Newsgroups: fa.netbsd.tech.kern
Subject: Re: pbulk using tmpfs
Date: Sat, 20 Apr 2013 22:18:06 UTC
Organization: Internet mailing list
Lines: 48
Sender: tech-kern-owner@NetBSD.org
Message-ID: <fa.xyFhuEk8Gh3J0Dn5I3n0+lj7FLM@ifi.uio.no>
References: <fa.cW6W/MVReNTw4z6/4YxsFLr/9G0@ifi.uio.no> <fa.e83HgwaM2kaCuuUpS6tVoQ1+1Kk@ifi.uio.no>
NNTP-Posting-Host: mail-jess.uio.no
Mime-Version: 1.0
X-Trace: readme.uio.no 1366496286 16770 129.240.7.9 (20 Apr 2013 22:18:06 GMT)
X-Complaints-To: abuse@uio.no
NNTP-Posting-Date: Sat, 20 Apr 2013 22:18:06 +0000 (UTC)
Cc: tech-kern@NetBSD.org, tech-pkg@NetBSD.org
To: iMil <imil@home.imil.net>
Delivered-To: tech-kern@NetBSD.org
X-Virus-Scanned: amavisd-new at NetBSD.org
Mail-Followup-To: iMil <imil@home.imil.net>, tech-kern@NetBSD.org,
 tech-pkg@NetBSD.org
In-Reply-To: <alpine.NEB.2.00.1304202332220.19430@korriban.imil.net>
List-Id: tech-kern.NetBSD.org
Original-Date: Sun, 21 Apr 2013 00:17:43 +0200
Original-Message-Id: <20130420221743.GA803@danbala.tuwien.ac.at>
Original-References: <sfid-H20130420-234816-+019.30-1@spamfilter.osbf.lua>
 <alpine.NEB.2.00.1304202332220.19430@korriban.imil.net>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline