Article View: fa.netbsd.tech.kern
Article #68Re: pbulk using tmpfs
From: Thomas Klausner
Date: Sat, 20 Apr 2013 22:18
Date: Sat, 20 Apr 2013 22:18
48 lines
4501 bytes
4501 bytes
On Sat, Apr 20, 2013 at 11:47:59PM +0200, iMil wrote: > I'm running bulk builds for various archs using pbulk for quite > some time now, and one of the domUs used for this is hosted by > a server with a LSI MPT Fusion Raid controller. In short, that > controller sucks, poor write performances, it is a well known > fact. In order to speed up builds, I would like to know if I > could benefit from tmpfs by mounting the WRKOBJDIR as a tmpfs > directory. > > In particular, while most packages will fit into a couple of > megabytes, some of them (firefox, libreoffice, openoffice, > koffice and such) take a couple of gigabytes to get built. > > My question is: how will tmpfs behave? If I mount the WRKOBJDIR > without any argument, it will "use", if I understand correctly > the manpage, all of the available memory. Does this mean I will > end up in a situation were the system memory will be filled by > the build or is there some kind of smart mechanism within tmpfs > which will "overflow" somewhere? I have this setup (mostly created with mksandbox): tmpfs on /home/wiz/sandbox type tmpfs (local) /bin on /home/wiz/sandbox/bin type null (read-only, local) /sbin on /home/wiz/sandbox/sbin type null (read-only, local) /lib on /home/wiz/sandbox/lib type null (read-only, local) /libexec on /home/wiz/sandbox/libexec type null (read-only, local) /usr/X11R7 on /home/wiz/sandbox/usr/X11R7 type null (read-only, local) /usr/bin on /home/wiz/sandbox/usr/bin type null (read-only, local) /usr/games on /home/wiz/sandbox/usr/games type null (read-only, local) /usr/include on /home/wiz/sandbox/usr/include type null (read-only, local) /usr/lib on /home/wiz/sandbox/usr/lib type null (read-only, local) /usr/libdata on /home/wiz/sandbox/usr/libdata type null (read-only, local) /usr/libexec on /home/wiz/sandbox/usr/libexec type null (read-only, local) /usr/share on /home/wiz/sandbox/usr/share type null (read-only, local) /usr/sbin on /home/wiz/sandbox/usr/sbin type null (read-only, local) /var/mail on /home/wiz/sandbox/var/mail type null (read-only, local) /archive/foreign/src on /home/wiz/sandbox/usr/src type null (read-only, local) /archive/foreign/pkgsrc on /home/wiz/sandbox/usr/pkgsrc type null (local) /archive/foreign/xsrc on /home/wiz/sandbox/usr/xsrc type null (read-only, local) /archive/packages/6.99.19 on /home/wiz/sandbox/packages type null (local) /archive/distfiles on /home/wiz/sandbox/distfiles type null (local) and have been building all my packages this way for years now, using pbulk. Sometimes I trigger some tmpfs panics (see e.g. kern/42484, kern/47480, kern/47739) but otherwise it works very well, is fast and usually stable. The machine I used this on regularly had 12GB RAM though (now even more), so I'm not RAM-limited. Thomas
Technical Details
Message-ID:
<fa.xyFhuEk8Gh3J0Dn5I3n0+lj7FLM@ifi.uio.no>Path:
arc1-ca.pugleaf.net!hg5ni4813wib.1!nntp.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!nntp.uio.no!.POSTED!not-for-mailReferences:
<fa.cW6W/MVReNTw4z6/4YxsFLr/9G0@ifi.uio.no> <fa.e83HgwaM2kaCuuUpS6tVoQ1+1Kk@ifi.uio.no>Show Full Headers
Complete Article Headers
X-Google-Thread: 10c6f4,786e9905c90c1180
X-Google-NewGroupId: yes
X-Google-Attributes: gidb7e13b6095,domainid0,public,usenet
X-Google-Language: ENGLISH,ASCII-7-bit
X-Received: by 10.180.188.52 with SMTP id fx20mr9522550wic.3.1366496286198;
Sat, 20 Apr 2013 15:18:06 -0700 (PDT)
Path: arc1-ca.pugleaf.net!hg5ni4813wib.1!nntp.google.com!goblin2!goblin1!goblin.stu.neva.ru!uio.no!nntp.uio.no!.POSTED!not-for-mail
From: Thomas Klausner <wiz@NetBSD.org>
Newsgroups: fa.netbsd.tech.kern
Subject: Re: pbulk using tmpfs
Date: Sat, 20 Apr 2013 22:18:06 UTC
Organization: Internet mailing list
Lines: 48
Sender: tech-kern-owner@NetBSD.org
Message-ID: <fa.xyFhuEk8Gh3J0Dn5I3n0+lj7FLM@ifi.uio.no>
References: <fa.cW6W/MVReNTw4z6/4YxsFLr/9G0@ifi.uio.no> <fa.e83HgwaM2kaCuuUpS6tVoQ1+1Kk@ifi.uio.no>
NNTP-Posting-Host: mail-jess.uio.no
Mime-Version: 1.0
X-Trace: readme.uio.no 1366496286 16770 129.240.7.9 (20 Apr 2013 22:18:06 GMT)
X-Complaints-To: abuse@uio.no
NNTP-Posting-Date: Sat, 20 Apr 2013 22:18:06 +0000 (UTC)
Cc: tech-kern@NetBSD.org, tech-pkg@NetBSD.org
To: iMil <imil@home.imil.net>
Delivered-To: tech-kern@NetBSD.org
X-Virus-Scanned: amavisd-new at NetBSD.org
Mail-Followup-To: iMil <imil@home.imil.net>, tech-kern@NetBSD.org,
tech-pkg@NetBSD.org
In-Reply-To: <alpine.NEB.2.00.1304202332220.19430@korriban.imil.net>
List-Id: tech-kern.NetBSD.org
Original-Date: Sun, 21 Apr 2013 00:17:43 +0200
Original-Message-Id: <20130420221743.GA803@danbala.tuwien.ac.at>
Original-References: <sfid-H20130420-234816-+019.30-1@spamfilter.osbf.lua>
<alpine.NEB.2.00.1304202332220.19430@korriban.imil.net>
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline