Article View: gnu.announce
Article #596GNU Parallel 20110205 (the FOSDEM release) released
From: Ole Tange
Date: Mon, 07 Feb 2011 22:23
Date: Mon, 07 Feb 2011 22:23
93 lines
6273 bytes
6273 bytes
GNU Parallel 20110205 (the FOSDEM release) has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ This is a major release as the --pipe option introduces a new way to work. GNU Parallel has so far been similar to xargs, with --pipe it becomes somewhat similar to tee. To learn about --pipe see the example section for uses of --pipe. But rest assured: No old functionality is changed. If you want GNU Parallel to be part of your favourite distribution contact the people maintaining the distribution (complaining on Twitter is not enough). New in this release: * --pipe splits piped data into blocks. Each block is piped to a program for processing. The piping and the programs will be run in parallel. Useful if the data you want to process is data for a program and not arguments. * --blocksize sets the blocksize in bytes for --pipe. The blocksize is approximate. It can deviate as much as the size of one record. Default is 1M. * --recstart sets the string matching the start of a record. Default is "". * --recend sets the string matching the end of a record. Default is '\n'. To specify none use --recend "". If both --recstart and --recend are set, the end of a record must be followed immediately by a start of a record. This is useful if either recend or recstart can occur in the middle of a record. * --remove-rec-sep removes the string matched by --recstart and --recend. * --regexp will make GNU Parallel treat --recstart and --recend as regular expressions. * --output-as-files will put the output of the programs into files and instead of giving the output GNU Parallel will output the name of these files. * -N if used with --pipe sets the number of records to read. * New video showing --pipe at http://www.youtube.com/watch?v=1ntxT-47VPA * GNU Parallel was presented at FOSDEM. * Article in USENIX Magazine ;login: (print) http://www.usenix.org/publications/login/2011-02/ * GNU Parallel is now on ohloh.net. Thanks to Wim Muskee. https://www.ohloh.net/p/gnu-parallel * Advanced recursive example. Thanks to Ruarí Ødegaard. http://my.opera.com/ruario/blog/2011/01/24/editing-debian-packages-more-fun-with-gnu * Small example on using GNU Parallel through 0install (German). http://forum.ubuntuusers.de/topic/gnu-parallel-mit-zero-install-kurzinfo-kein-wi/ * Bug fixes and man page updates. = About GNU Parallel = GNU Parallel is a shell tool for executing jobs in parallel using one or more computers. A job is can be a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. A job can also be a command that reads from a pipe. GNU Parallel can then split the input and pipe it into commands in parallel. If you use xargs and tee today you will find GNU Parallel very easy to use as GNU Parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU Parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. GNU Parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU Parallel as input for other programs. You can find more about GNU Parallel at: http://www.gnu.org/software/parallel/ Watch the intro video on http://www.youtube.com/watch?v=OpaiGYxkSuQ or at http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/
Technical Details
Message-ID:
<mailman.4.1297135816.531.info-gnu@gnu.org>Path:
arc1-ca.pugleaf.net!g2news1.google.com!news2.google.com!news.glorb.com!news2.glorb.com!usenet.stanford.edu!not-for-mailShow Full Headers
Complete Article Headers
X-Google-Thread: fba7b,e41aff9e9b080dbb,start X-Google-NewGroupId: yes X-Google-Attributes: gid4622fc145,domainid0,public,usenet X-Google-Language: ENGLISH,ASCII Path: arc1-ca.pugleaf.net!g2news1.google.com!news2.google.com!news.glorb.com!news2.glorb.com!usenet.stanford.edu!not-for-mail From: Ole Tange <tange@gnu.org> Newsgroups: gnu.announce Subject: GNU Parallel 20110205 (the FOSDEM release) released Date: Mon, 7 Feb 2011 23:23:21 +0100 Lines: 94 Sender: ole.tange@gmail.com Approved: info-gnu@gnu.org Message-ID: <mailman.4.1297135816.531.info-gnu@gnu.org> NNTP-Posting-Host: lists.gnu.org Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Trace: usenet.stanford.edu 1297135817 8771 199.232.76.165 (8 Feb 2011 03:30:17 GMT) X-Complaints-To: action@cs.stanford.edu To: parallel@gnu.org, bug-parallel@gnu.org, info-gnu@gnu.org, bug-directory@gnu.org Envelope-to: info-gnu@gnu.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:from:date :x-google-sender-auth:message-id:subject:to:content-type :content-transfer-encoding; bh=bOi+8dfxHyFVWqQqCn99AaCWgZE4obUOLYVpfdzFesE=; b=ko6gv2oxiR5N35DhoCyQzRLyDaEA10TinxGLQBjm54kxWTSeipj5lyitsA5i2stA30 tShIpMhtOOctrldAqcWKN2Ep+B+a62WM/IHx7JUohXMn2SEI/JtscYZA+F0W67ZXbOhO hJk8Y25d1pVL9oX4ifiDE89Kez5OlRmbegH0o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:from:date:x-google-sender-auth:message-id :subject:to:content-type:content-transfer-encoding; b=YsoFsM0VfumZwAhO2UFTy+bj0HXyPVejbwWDO949o2o9NC+HT/Ik0My+CaID2JkNT2 upevCMRjjS4/1rQ+mCeOod0M5wnccQQGLwG+PqTS7rp6aQ32B7Fk9PNkn+tfMgRuvTlH 0GqiJwhJdbI0u8UpbE/GbbyUDcpg9qp+ikppo= X-Google-Sender-Auth: o9JPEyaoEBd_n5n1fOb7pryS1_U X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-Received-From: 74.125.83.41 X-Mailman-Approved-At: Mon, 07 Feb 2011 22:30:15 -0500 X-BeenThere: info-gnu@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Announcements and Requests for Help from the GNU project and the Free Software Foundation <info-gnu.gnu.org> List-Unsubscribe: <http://lists.gnu.org/mailman/listinfo/info-gnu>, <mailto:info-gnu-request@gnu.org?subject=unsubscribe> List-Archive: <http://lists.gnu.org/archive/html/info-gnu> List-Post: <mailto:info-gnu@gnu.org> List-Help: <mailto:info-gnu-request@gnu.org?subject=help> List-Subscribe: <http://lists.gnu.org/mailman/listinfo/info-gnu>, <mailto:info-gnu-request@gnu.org?subject=subscribe>