From MAILER-DAEMON Sun Aug 07 21:11:05 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QqEMz-0001Hy-7w
	for mharc-coreutils@gnu.org; Sun, 07 Aug 2011 21:11:05 -0400
Received: from eggs.gnu.org ([140.186.70.92]:36711)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QqEMx-0001Hs-3F
	for coreutils@gnu.org; Sun, 07 Aug 2011 21:11:03 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QqEMv-0006MX-VI
	for coreutils@gnu.org; Sun, 07 Aug 2011 21:11:03 -0400
Received: from smtp.gentoo.org ([140.211.166.183]:37845)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QqEMv-0006ML-Qq
	for coreutils@gnu.org; Sun, 07 Aug 2011 21:11:01 -0400
Received: from vapier.localnet (localhost [127.0.0.1])
	by smtp.gentoo.org (Postfix) with ESMTP id 639E61B400D;
	Mon,  8 Aug 2011 01:10:59 +0000 (UTC)
From: Mike Frysinger <vapier@gentoo.org>
Organization: wh0rd.org
To: coreutils@gnu.org
Subject: Re: progress bar in cp
Date: Sun, 7 Aug 2011 21:10:45 -0400
User-Agent: KMail/1.13.7 (Linux/2.6.39; KDE/4.6.3; x86_64; ; )
References: <4E2C583D.1090607@gmail.com>
In-Reply-To: <4E2C583D.1090607@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="nextPart2537558.QMoVS225Dn";
	protocol="application/pgp-signature"; micalg=pgp-sha1
Content-Transfer-Encoding: 7bit
Message-Id: <201108072110.45671.vapier@gentoo.org>
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 140.211.166.183
Cc: Diogo Sousa <diogogsousa@gmail.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Aug 2011 01:11:04 -0000

--nextPart2537558.QMoVS225Dn
Content-Type: Text/Plain;
  charset="utf-8"
Content-Transfer-Encoding: quoted-printable

On Sunday, July 24, 2011 13:37:01 Diogo Sousa wrote:
> One feature that some users search for is a progress bar on the cp progra=
m.
>=20
> I would like to implement a progress bar in cp, would that patch be
> accepted? Is there any reason not to do it?

patches have been submitted in the past already.  semi up-to-date ones can =
be=20
found here:
http://sources.gentoo.org/gentoo/src/patchsets/coreutils/
=2Dmike

--nextPart2537558.QMoVS225Dn
Content-Type: application/pgp-signature; name=signature.asc 
Content-Description: This is a digitally signed message part.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)

iQIcBAABAgAGBQJOPzeVAAoJEEFjO5/oN/WBPfIP/AvWKbr/AWx8DJNJ1miYaAg/
+B6H0pf+Zx+Qj8EUSSYvfcI0vgQn3/KKjGyR8UF46cPwlgwrt4i4c1P2uSltvRj6
WpsnQLjfFIFhmZiY+4bs78XETg1JS+smiIwUTZbAjWKRJcFSdLycFB6tDNNTsNDs
ecmJeZT5/uy1V4yYhC+wEEDLEP5uYjAtG8EpgN2czReb89FfpyCWrbw6zML0Vjfj
ScRi5EdTYJIpcQCfe7ZbaBCPFhyv8IO+kTn3pJ3rkqufUO62lexTzSNUywKmORnq
MUj6a78mOJ/sQki73VoHdgDoaqZ1xgber/prjO9I48r9h1HBFkydlwZ1AhuzZ9uU
tvNdf53DXDOt0ga4xZBQo4d+nvdJ6h7ig8OjlzcHI+et58DALXpkLQphgooH3ZTQ
OTmeE9TuPdQLDUfsIsxS/ttvBcIO74rCmpYsB8O2rxovtj9Atm4NWOR8CrI4Vpl7
kjRxQ681iyBxu3zYO9YtP8BkDbdfW1rnjQJd5loJeBuKY00tHc0pvg4r0McvJlOl
fO6kfFqXHsScnu3YEewH/4/5fw1BnFNJXSLFLTYlqORiGztGrb115sKeCDb6g6lF
krTNp7Qktg4CrGmikjNFVVo1JxpmPhqHK/JXl9+jpdCfC6o2QqN/oaiojEaaTUB0
5YX3Rsla502kaBGIZ09S
=b1op
-----END PGP SIGNATURE-----

--nextPart2537558.QMoVS225Dn--


From MAILER-DAEMON Mon Aug 08 04:15:45 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QqKzx-0004Au-B7
	for mharc-coreutils@gnu.org; Mon, 08 Aug 2011 04:15:45 -0400
Received: from eggs.gnu.org ([140.186.70.92]:51241)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqKzv-0004Ao-2y
	for coreutils@gnu.org; Mon, 08 Aug 2011 04:15:43 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqKzu-0007k0-7z
	for coreutils@gnu.org; Mon, 08 Aug 2011 04:15:43 -0400
Received: from mx.meyering.net ([82.230.74.64]:44962)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqKzu-0007ju-16
	for coreutils@gnu.org; Mon, 08 Aug 2011 04:15:42 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 44F4960098
	for <coreutils@gnu.org>; Mon,  8 Aug 2011 10:15:41 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: [PATCH] maint: use xcalloc rather than xmalloc+memset (no semantic
	change)
Date: Mon, 08 Aug 2011 10:15:40 +0200
Message-ID: <87zkjkco9f.fsf@rho.meyering.net>
Lines: 29
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Mon, 08 Aug 2011 08:15:43 -0000

FYI,

>From 005534907cdc7ff0a4c7908631ff596c4b07ba56 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Thu, 4 Aug 2011 18:46:16 +0200
Subject: [PATCH] maint: use xcalloc rather than xmalloc+memset (no
 semantic change)

* src/join.c (init_linep): Use xcalloc, not xmalloc+memset.
---
 src/join.c |    3 +--
 1 files changed, 1 insertions(+), 2 deletions(-)

diff --git a/src/join.c b/src/join.c
index 941185c..99d918f 100644
--- a/src/join.c
+++ b/src/join.c
@@ -405,8 +405,7 @@ reset_line (struct line *line)
 static struct line *
 init_linep (struct line **linep)
 {
-  struct line *line = xmalloc (sizeof *line);
-  memset (line, '\0', sizeof *line);
+  struct line *line = xcalloc (1, sizeof *line);
   *linep = line;
   return line;
 }
--
1.7.6.351.gb35ac


From MAILER-DAEMON Tue Aug 09 04:35:35 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qqhmh-0001Xv-DZ
	for mharc-coreutils@gnu.org; Tue, 09 Aug 2011 04:35:35 -0400
Received: from eggs.gnu.org ([140.186.70.92]:59212)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qqhme-0001X9-BT
	for coreutils@gnu.org; Tue, 09 Aug 2011 04:35:33 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qqhma-0000Od-Oa
	for coreutils@gnu.org; Tue, 09 Aug 2011 04:35:32 -0400
Received: from mx.meyering.net ([82.230.74.64]:51876)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qqhma-0000OY-Fc
	for coreutils@gnu.org; Tue, 09 Aug 2011 04:35:28 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id B268F601D8
	for <coreutils@gnu.org>; Tue,  9 Aug 2011 10:35:27 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: [PATCH] maint: use gnulib's new largefile module
Date: Tue, 09 Aug 2011 10:35:27 +0200
Message-ID: <87d3gf7zjk.fsf@rho.meyering.net>
Lines: 36
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Aug 2011 08:35:33 -0000

This is insurance.
It's not necessary for me or for anyone using tarballs
I will release, because I am now using autoconf.git/master
which is newer than the required version.  As noted in
gnulib/m4/largefile.m4 comments, this is for Mac OS X 10.5 users.

I will be doing the same to diffutils, grep, gzip, patch, etc.,
except there, I will also remove any explicit use of AC_SYS_LARGEFILE
(there was none here).

>From 66c41a6ee048c0c4c9fa12bafdacfdff0be53674 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Tue, 9 Aug 2011 10:28:31 +0200
Subject: [PATCH] maint: use gnulib's new largefile modulue

* bootstrap.conf (gnulib_modules): Add largefile.
This is useful to Mac OS X 10.5 users if/when configure
is generated using autoconf prior to v2.68-80-gdb2f2e0.
---
 bootstrap.conf |    1 +
 1 files changed, 1 insertions(+), 0 deletions(-)

diff --git a/bootstrap.conf b/bootstrap.conf
index 0ba560c..7be4e5a 100644
--- a/bootstrap.conf
+++ b/bootstrap.conf
@@ -125,6 +125,7 @@ gnulib_modules="
   inttypes
   isapipe
   isblank
+  largefile
   lchmod
   lchown
   ldtoastr
--
1.7.6.409.ge7a85


From MAILER-DAEMON Tue Aug 09 10:45:39 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QqnYp-0003m9-Gg
	for mharc-coreutils@gnu.org; Tue, 09 Aug 2011 10:45:39 -0400
Received: from eggs.gnu.org ([140.186.70.92]:53199)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqmR1-0006K1-Cd
	for coreutils@gnu.org; Tue, 09 Aug 2011 09:33:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqmQy-0007BY-Sv
	for coreutils@gnu.org; Tue, 09 Aug 2011 09:33:31 -0400
Received: from mail-ew0-f41.google.com ([209.85.215.41]:58054)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqmQy-0007B1-BE
	for coreutils@gnu.org; Tue, 09 Aug 2011 09:33:28 -0400
Received: by ewy9 with SMTP id 9so1071699ewy.0
	for <coreutils@gnu.org>; Tue, 09 Aug 2011 06:33:26 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=message-id:date:from:user-agent:mime-version:to:subject:references
	:in-reply-to:content-type;
	bh=913PPqI4DX7BVW0YIlG7xMr2swOkIvkaL7XYwbz5F+g=;
	b=LIFukkM7D6I29Zr+96e/Lzp7h2Y1COSIzrYfMTEx5JEg+luB6BibxPRMEvx5kc07Ff
	TONcdWRlumdYTpleZfk1mO+WQKNpl8t4AMnBiQMWV5qXNzxiKktHGw+eD/UghTey9KWM
	j4GsgD79A9Il9stRBvc8+iit6hBhEdrsuJy2U=
Received: by 10.213.105.201 with SMTP id u9mr129320ebo.41.1312890090101;
	Tue, 09 Aug 2011 04:41:30 -0700 (PDT)
Received: from [81.19.90.34] ([81.19.90.34])
	by mx.google.com with ESMTPS id v1sm2549297eem.29.2011.08.09.04.41.27
	(version=SSLv3 cipher=OTHER); Tue, 09 Aug 2011 04:41:28 -0700 (PDT)
Message-ID: <4E411CE1.4030507@gmail.com>
Date: Tue, 09 Aug 2011 15:41:21 +0400
From: Dmitry Ilyin <idv1985@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; ru-RU;
	rv:1.9.2.12) Gecko/20101027 Thunderbird/3.1.6
MIME-Version: 1.0
To: coreutils@gnu.org
Subject: Re: progress bar in cp
References: <4E2C583D.1090607@gmail.com>
In-Reply-To: <4E2C583D.1090607@gmail.com>
Content-Type: multipart/mixed; boundary="------------010004070709030803090109"
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.215.41
X-Mailman-Approved-At: Tue, 09 Aug 2011 10:45:38 -0400
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Aug 2011 13:33:38 -0000

This is a multi-part message in MIME format.
--------------010004070709030803090109
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

24.07.2011 21:37, Diogo Sousa Ð¿Ð¸ÑˆÐµÑ‚:
> Hi,
>
> One feature that some users search for is a progress bar on the cp program.
>
> I would like to implement a progress bar in cp, would that patch be
> accepted? Is there any reason not to do it?
>
> Thank You,
> Diogo Sousa
>
>
Here are two implementations.

First is mine and second is someone else's.

There is also implementation here 
http://sources.gentoo.org/gentoo/src/patchsets/coreutils/ according to 
vapier@gentoo.org

Looks like a lot of people want this feature, invent their own bicycles and 
kludges waiting for it to be added to coreutils.

FreeBSD (hmm looks like MacOS too) have Ctrl+T SIGINFO to see how much time left 
to copy file and lot of tools support it.

Linux has nothing. I dont care that Posix doesn't describe SIGINFO, it's 
usefull, bsd has it and people like it.

I tried to implement SIGINFO in Linux kernel but failed to understand all tty 
stuff (which i could easily understand in freebsd kernel), and i'm not even 
trying to add new signal. So I could only replace Ctrl+\ SIGQUIT with SIGUSR1 
which 'dd' does understand as print status and 'fsck' too. I'm very happy with 
this feature on my rescue USB flash.

So the best solution to sucking coreutils interactivity would be:
1) Implement some option (-B ?) to show dot progress bar AND show file name and 
percent completed on SIGUSR1.
2) Implement Ctrl+T to send SIGUSR1 or even implement SIGINFO if it's possible.
3) Add info print out to as many console tools as possible.
4) Ctrl+K to send SIGKILL would be nice (ok, ok at least we have MagicSysrq that 
does something like that, linux-only feature)

Yes I understand that nobody will do anything of that because (.... insert your 
argument here ....), well enjoy 0-1% OS market share))
Unfortunately i'm not kernel developer, well not even C programmer, and 
implementing this is far beyond my abilities.
Actually even if I improve my skills and implement this you will not take my 
patches to mainstream, neither will kernel developers because (.... insert a lot 
of agruments here ....) so I will just improve my USB rescue system.




--------------010004070709030803090109
Content-Type: text/x-patch;
 name="copy.patch"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
 filename="copy.patch"

--- coreutils-8.5/src/copy.c	2010-04-20 23:52:04.000000000 +0400
+++ copy.c	2010-09-12 17:50:57.544775657 +0400
@@ -709,6 +709,20 @@
       buf_alloc = xmalloc (buf_size + buf_alignment_slop);
       buf = ptr_align (buf_alloc, buf_alignment);
 
+      int counter=0;
+      int writes_per_percent;
+      bool print_progress = false;
+ 
+      //decide should we print progress bar
+      if ((x->verbose) && (src_open_sb.st_size > 0))
+        print_progress = true;
+
+      //calculate number of writes per one percent of copy progress
+      if (print_progress)
+      {
+        writes_per_percent = (int)src_open_sb.st_size / (int)buf_size / 100;
+        printf("%d bytes: ",(int)src_open_sb.st_size);
+      }
       for (;;)
         {
           word *wp = NULL;
@@ -783,15 +797,29 @@
                   return_val = false;
                   goto close_src_and_dst_desc;
                 }
+
+              //print dot per percent of copy progress
+              if ((print_progress) && ((counter >= writes_per_percent) || (counter == 0)))
+                {
+                  counter=0;
+                  printf("*");
+                  fflush(stdout);
+                }
+              counter++;
+              
               last_write_made_hole = false;
 
               /* It is tempting to return early here upon a short read from a
                  regular file.  That would save the final read syscall for each
                  file.  Unfortunately that doesn't work for certain files in
                  /proc with linux kernels from at least 2.6.9 .. 2.6.29.  */
-            }
+            } 
         }
-
+        
+        //print newline after line of dots
+        if (print_progress)
+          printf(" Done!\n");
+        
       /* If the file ends with a `hole', we need to do something to record
          the length of the file.  On modern systems, calling ftruncate does
          the job.  On systems without native ftruncate support, we have to

--------------010004070709030803090109
Content-Type: text/x-patch;
 name="copy2.patch"
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
 filename="copy2.patch"

diff -ru coreutils-8.8/src/copy.c coreutils-8.8-1/src/copy.c
--- coreutils-8.8/src/copy.c	2010-01-03 18:06:20.000000000 +0100
+++ coreutils-8.8-1/src/copy.c	2010-08-25 21:11:40.629752495 +0200
@@ -457,6 +457,56 @@
   return lchmod (name, mode);
 }
 
+/* BEGIN progress mod */
+static void file_progress_bar ( char * _cDest, int _iBarLength, int _iProgress, int _iTotal )
+{
+  // write number to progress bar
+  float fPercent = ( float ) _iProgress / ( float ) _iTotal * 100.f;
+  sprintf ( _cDest + ( _iBarLength - 6 ), "%4.1f", fPercent );
+  // remove zero
+  _cDest[_iBarLength - 2] = ' ';
+
+  // fill rest with '-'
+  int i;
+  for ( i = 1; i <= _iBarLength - 9; i++ )
+  {
+    if ( fPercent > ( float ) ( i - 1 ) / ( _iBarLength - 10 ) * 100.f )
+      _cDest[i] = '|';
+    else
+      _cDest[i] = '-';
+  }
+}
+
+int file_size_format ( char * _cDst, int _iSize, int _iCounter )
+{
+  int iCounter = _iCounter;
+  double dSize = ( double ) _iSize;
+  while ( dSize >= 1000. )
+  {
+    dSize /= 1024.;
+    iCounter++;
+  }
+
+  /* get unit */
+  char * sUnit;
+  if ( iCounter == 0 )
+    sUnit = "B";
+  else if ( iCounter == 1 )
+    sUnit = "KiB";
+  else if ( iCounter == 2 )
+    sUnit = "MiB";
+  else if ( iCounter == 3 )
+    sUnit = "GiB";
+  else if ( iCounter == 4 )
+    sUnit = "TiB";
+  else
+    sUnit = "N/A";
+
+  /* write number */
+  return sprintf ( _cDst, "%5.1f %s", dSize, sUnit );
+}
+/* END progress mod */
+
 /* Copy a regular file from SRC_NAME to DST_NAME.
    If the source file contains holes, copies holes and blocks of zeros
    in the source file as holes in the destination file.
@@ -704,8 +704,146 @@
       buf_alloc = xmalloc (buf_size + buf_alignment_slop);
       buf = ptr_align (buf_alloc, buf_alignment);
 
+      /* BEGIN progress mod */
+      /* create a field of 6 lines */
+      char ** cProgressField = ( char ** ) calloc ( 6, sizeof ( char * ) );
+      /* get console width */
+      int iBarLength = 80;
+      struct winsize win;
+      if ( ioctl (STDOUT_FILENO, TIOCGWINSZ, (char *) &win) == 0 && win.ws_col > 0 )
+         iBarLength = win.ws_col;
+      /* create rows */
+      int it;
+      for ( it = 0; it < 6; it++ )
+      {
+        cProgressField[it] = ( char * ) malloc ( iBarLength + 1 );
+        /* init with spaces */
+        int j;
+        for ( j = 0; j < iBarLength; j++ )
+          cProgressField[it][j] = ' ';
+        cProgressField[it][iBarLength] = '\0';
+      }
+
+      /* global progress bar? */
+      if ( g_iTotalSize )
+      {
+        /* init global progress bar */
+        cProgressField[2][0] = '[';
+        cProgressField[2][iBarLength - 8] = ']';
+        cProgressField[2][iBarLength - 7] = ' ';
+        cProgressField[2][iBarLength - 1] = '%';
+
+        /* total size */
+        cProgressField[1][iBarLength - 11] = '/';
+        file_size_format ( cProgressField[1] + iBarLength - 9, g_iTotalSize, 1 );
+
+        /* show how many files were written */
+        int sum_length = sprintf ( cProgressField[1], "%d files copied so far...", g_iFilesCopied );
+        cProgressField[1][sum_length] = ' ';
+      }
+
+      /* truncate filename? */
+      int fn_length;
+      if ( strlen ( src_name ) > iBarLength - 22 )
+        fn_length =
+          sprintf ( cProgressField[4], "...%s", src_name + ( strlen ( src_name ) - iBarLength + 25 ) );
+      else
+        fn_length = sprintf ( cProgressField[4], "%s", src_name );
+      cProgressField[4][fn_length] = ' ';
+
+      /* filesize */
+      cProgressField[4][iBarLength - 11] = '/';
+      file_size_format ( cProgressField[4] + iBarLength - 9, src_open_sb.st_size, 0 );
+
+      int iCountDown = 1;
+      char * sProgressBar = cProgressField[5];
+      sProgressBar[0] = '[';
+      sProgressBar[iBarLength - 8] = ']';
+      sProgressBar[iBarLength - 7] = ' ';
+      sProgressBar[iBarLength - 1] = '%';
+
+      /* this will always save the time in between */
+      struct timeval last_time;
+      gettimeofday ( & last_time, NULL );
+      int last_size = g_iTotalWritten;
+      /* END progress mod */
+
       while (true)
         {
+          if (progress) {
+          /* BEGIN progress mod */
+          /* update countdown */
+          iCountDown--;
+          if ( iCountDown < 0 )
+            iCountDown = 100;
+
+          /* just print one line with the percentage, but not always */
+          if ( iCountDown == 0 )
+          {
+            /* calculate current speed */
+            struct timeval cur_time;
+            gettimeofday ( & cur_time, NULL );
+            int cur_size = g_iTotalWritten + n_read_total / 1024;
+            int usec_elapsed = cur_time.tv_usec - last_time.tv_usec;
+            double sec_elapsed = ( double ) usec_elapsed / 1000000.f;
+            sec_elapsed += ( double ) ( cur_time.tv_sec - last_time.tv_sec );
+            int copy_speed = ( int ) ( ( double ) ( cur_size - last_size )
+              / sec_elapsed );
+            char s_copy_speed[20];
+            file_size_format ( s_copy_speed, copy_speed, 1 );
+            /* update vars */
+            last_time = cur_time;
+            last_size = cur_size;
+
+            /* how many time has passed since the start? */
+            int isec_elapsed = cur_time.tv_sec - g_oStartTime.tv_sec;
+            int sec_remaining = ( int ) ( ( double ) isec_elapsed / cur_size
+              * g_iTotalSize ) - isec_elapsed;
+            int min_remaining = sec_remaining / 60;
+            sec_remaining -= min_remaining * 60;
+            int hours_remaining = min_remaining / 60;
+            min_remaining -= hours_remaining * 60;
+            /* print out */
+            sprintf ( cProgressField[3],
+              "Copying at %s/s (about %dh %dm %ds remaining)", s_copy_speed,
+              hours_remaining, min_remaining, sec_remaining );
+
+            int fs_len;
+            if ( g_iTotalSize )
+            {
+              /* global progress bar */
+              file_progress_bar ( cProgressField[2], iBarLength,
+                                  g_iTotalWritten + n_read_total / 1024, g_iTotalSize );
+
+              /* print the global status */
+              fs_len = file_size_format ( cProgressField[1] + iBarLength - 21,
+                                              g_iTotalWritten + n_read_total / 1024, 1 );
+              cProgressField[1][iBarLength - 21 + fs_len] = ' ';
+            }
+
+            /* current progress bar */
+            file_progress_bar ( sProgressBar, iBarLength, n_read_total, src_open_sb.st_size );
+
+            /* print the status */
+            fs_len = file_size_format ( cProgressField[4] + iBarLength - 21, n_read_total, 0 );
+            cProgressField[4][iBarLength - 21 + fs_len] = ' ';
+
+            /* print the field */
+            for ( it = g_iTotalSize ? 0 : 3; it < 6; it++ )
+            {
+              printf ( "\033[K%s\n", cProgressField[it] );
+              if ( strlen ( cProgressField[it] ) < iBarLength )
+                printf ( "" );
+            }
+            if ( g_iTotalSize )
+              printf ( "\r\033[6A" );
+            else
+              printf ( "\r\033[3A" );
+            fflush ( stdout );
+          }
+          /* END progress mod */
+          }
+
           word *wp = NULL;
 
           ssize_t n_read = read (source_desc, buf, buf_size);
@@ -788,6 +976,19 @@
                  /proc with linux kernels from at least 2.6.9 .. 2.6.29.  */
             }
         }
+if (progress) {
+      /* BEGIN progress mod */
+      /* update total size */
+      g_iTotalWritten += n_read_total / 1024;
+      g_iFilesCopied++;
+
+      int i;
+      for ( i = 0; i < 6; i++ )
+        free ( cProgressField[i] );
+      free ( cProgressField );
+      /* END progress mod */
+}
+
 
       /* If the file ends with a `hole', we need to do something to record
          the length of the file.  On modern systems, calling ftruncate does
diff -ru coreutils-8.8/src/copy.h coreutils-8.8-1/src/copy.h
--- coreutils-8.8/src/copy.h	2010-01-03 18:06:20.000000000 +0100
+++ coreutils-8.8-1/src/copy.h	2010-08-25 21:11:40.629752495 +0200
@@ -222,6 +222,9 @@
      Create destination directories as usual. */
   bool symbolic_link;
 
+  /* if true, draw a nice progress bar on screen */
+  bool progress_bar;
+
   /* If true, do not copy a nondirectory that has an existing destination
      with the same or newer modification time. */
   bool update;
@@ -280,4 +283,15 @@
 bool chown_failure_ok (struct cp_options const *);
 mode_t cached_umask (void);
 
+/* BEGIN progress mod */
+int file_size_format ( char * _cDst, int _iSize, int _iCounter );
+
+long g_iTotalSize;
+long g_iTotalWritten;
+int g_iFilesCopied;
+struct timeval g_oStartTime;
+int g_iTotalFiles;
+bool progress;
+/* END progress mod */
+
 #endif
diff -ru coreutils-8.8/src/cp.c coreutils-8.8-1/src/cp.c
--- coreutils-8.8/src/cp.c	2010-01-04 16:46:06.000000000 +0100
+++ coreutils-8.8-1/src/cp.c	2010-08-25 21:11:40.629752495 +0200
@@ -139,6 +139,7 @@
   {"target-directory", required_argument, NULL, 't'},
   {"update", no_argument, NULL, 'u'},
   {"verbose", no_argument, NULL, 'v'},
+  {"progress-bar", no_argument, NULL, 'g'},
   {GETOPT_HELP_OPTION_DECL},
   {GETOPT_VERSION_OPTION_DECL},
   {NULL, 0, NULL, 0}
@@ -176,6 +177,7 @@
   -f, --force                  if an existing destination file cannot be\n\
                                  opened, remove it and try again (redundant if\n\
                                  the -n option is used)\n\
+  -g, --progress-bar           add progress-bar\n\
   -i, --interactive            prompt before overwrite (overrides a previous -n\n\
                                   option)\n\
   -H                           follow command-line symbolic links in SOURCE\n\
@@ -612,6 +614,57 @@
                quote (file[n_files - 1]));
     }
 
+    struct timeval start_time;
+if (progress) {
+    /* BEGIN progress mod */
+    g_iTotalSize = 0;
+    g_iFilesCopied = 0;
+    g_iTotalWritten = 0;
+
+    /* save time */
+    gettimeofday ( & start_time, NULL );
+    g_oStartTime = start_time;
+
+    printf ( "Calculating total size... \r" );
+    fflush ( stdout );
+    long iTotalSize = 0;
+    int iFiles = n_files;
+    if ( ! target_directory )
+      iFiles = n_files - 1;
+    int j;
+    for (j = 0; j < iFiles; j++)
+    {
+      /* call du -s for each file */
+      /* create command */
+      char command[1024];
+      sprintf ( command, "du -s \"%s\"", file[j] );
+      /* TODO: replace all quote signs in file[i] */
+
+      FILE *fp;
+      char output[1024];
+
+      /* run command */
+      fp = popen(command, "r");
+      if (fp == NULL || fgets(output, sizeof(output)-1, fp) == NULL) {
+        printf("failed to run du.\n" );
+      }
+      else
+      {
+        /* isolate size */
+        strchr ( output, '\t' )[0] = '\0';
+        iTotalSize += atol ( output );
+
+        printf ( "Calculating total size... %ld\r", iTotalSize );
+        fflush ( stdout );
+      }
+
+      /* close */
+      pclose(fp);
+    }
+    g_iTotalSize = iTotalSize;
+    /* END progress mod */
+}
+
   if (target_directory)
     {
       /* cp file1...filen edir
@@ -754,6 +807,46 @@
       ok = copy (source, new_dest, 0, x, &unused, NULL);
     }
 
+if (progress) {
+    /* BEGIN progress mod */
+    /* remove everything */
+    int i;
+    if ( g_iTotalSize )
+    {
+      for ( i = 0; i < 6; i++ )
+        printf ( "\033[K\n" );
+      printf ( "\r\033[6A" );
+    }
+    else
+    {
+      for ( i = 0; i < 3; i++ )
+        printf ( "\033[K\n" );
+      printf ( "\r\033[3A" );
+    }
+
+    /* save time */
+    struct timeval end_time;
+    gettimeofday ( & end_time, NULL );
+    int usec_elapsed = end_time.tv_usec - start_time.tv_usec;
+    double sec_elapsed = ( double ) usec_elapsed / 1000000.f;
+    sec_elapsed += ( double ) ( end_time.tv_sec - start_time.tv_sec );
+
+    /* get total size */
+    char sTotalWritten[20];
+    file_size_format ( sTotalWritten, g_iTotalSize, 1 );
+    /* TODO: using g_iTotalWritten would be more correct, but is less accurate */
+
+    /* calculate speed */
+    int copy_speed = ( int ) ( ( double ) g_iTotalWritten / sec_elapsed );
+    char s_copy_speed[20];
+    file_size_format ( s_copy_speed, copy_speed, 1 );
+
+    /* good-bye message */
+    printf ( "%d files (%s) copied in %.1f seconds (%s/s).\n", g_iFilesCopied, sTotalWritten,
+             sec_elapsed, s_copy_speed );
+    /* END progress mod */
+}
+
   return ok;
 }
 
@@ -785,6 +878,7 @@
   x->recursive = false;
   x->sparse_mode = SPARSE_AUTO;
   x->symbolic_link = false;
+  x->progress_bar = false;
   x->set_mode = false;
   x->mode = 0;
 
@@ -923,7 +1017,7 @@
      we'll actually use backup_suffix_string.  */
   backup_suffix_string = getenv ("SIMPLE_BACKUP_SUFFIX");
 
-  while ((c = getopt_long (argc, argv, "abdfHilLnprst:uvxPRS:T",
+  while ((c = getopt_long (argc, argv, "abdfgHilLnprst:uvxPRS:T",
                            long_opts, NULL))
          != -1)
     {
@@ -975,6 +1069,10 @@
           x.unlink_dest_after_failed_open = true;
           break;
 
+        case 'g':
+          progress = true;
+          break;
+
         case 'H':
           x.dereference = DEREF_COMMAND_LINE_ARGUMENTS;
           break;
diff -ru coreutils-8.8/src/mv.c coreutils-8.8-1/src/mv.c
--- coreutils-8.8/src/mv.c	2010-01-03 18:06:20.000000000 +0100
+++ coreutils-8.8-1/src/mv.c	2010-08-25 21:11:40.629752495 +0200
@@ -64,6 +64,7 @@
   {"target-directory", required_argument, NULL, 't'},
   {"update", no_argument, NULL, 'u'},
   {"verbose", no_argument, NULL, 'v'},
+  {"progress-bar", no_argument, NULL, 'g'},
   {GETOPT_HELP_OPTION_DECL},
   {GETOPT_VERSION_OPTION_DECL},
   {NULL, 0, NULL, 0}
@@ -159,13 +160,100 @@
 static bool
 do_move (const char *source, const char *dest, const struct cp_options *x)
 {
+
+  struct timeval start_time;
+
+  if(progress) {
+    /* BEGIN progress mod */
+    g_iTotalSize = 0;
+    g_iFilesCopied = 0;
+    g_iTotalWritten = 0;
+
+    gettimeofday (& start_time, NULL);
+    g_oStartTime = start_time;
+
+    printf ("Calculating total size... \r");
+    fflush (stdout);
+    long iTotalSize = 0;
+    /* call du -s for each file */
+    /* create command */
+    char command[1024];
+    sprintf ( command, "du -s \"%s\"", source );
+    /* TODO: replace all quote signs in file[i] */
+
+    FILE *fp;
+    char output[1024];
+
+    /* run command */
+    fp = popen(command, "r");
+    if (fp == NULL || fgets(output, sizeof(output)-1, fp) == NULL) {
+      printf("failed to run du.\n" );
+    }
+    else
+    {
+      /* isolate size */
+      strchr ( output, '\t' )[0] = '\0';
+      iTotalSize += atol ( output );
+      printf ( "Calculating total size... %ld\r", iTotalSize );
+      fflush ( stdout );
+    }
+
+    /* close */
+    pclose(fp);
+    g_iTotalSize = iTotalSize;
+    /* END progress mod */
+
+  }
+
   bool copy_into_self;
   bool rename_succeeded;
   bool ok = copy (source, dest, false, x, &copy_into_self, &rename_succeeded);
 
+  if (progress) {
+    /* BEGIN progress mod */
+    /* remove everything */
+    int i;
+    if ( g_iTotalSize )
+    {
+      for ( i = 0; i < 6; i++ )
+        printf ( "\033[K\n" );
+      printf ( "\r\033[6A" );
+    }
+    else
+    {
+      for ( i = 0; i < 3; i++ )
+        printf ( "\033[K\n" );
+      printf ( "\r\033[3A" );
+    }
+
+    /* save time */
+    struct timeval end_time;
+    gettimeofday ( & end_time, NULL );
+    int usec_elapsed = end_time.tv_usec - start_time.tv_usec;
+    double sec_elapsed = ( double ) usec_elapsed / 1000000.f;
+    sec_elapsed += ( double ) ( end_time.tv_sec - start_time.tv_sec );
+
+    /* get total size */
+    char sTotalWritten[20];
+    file_size_format ( sTotalWritten, g_iTotalSize, 1 );
+    /* TODO: using g_iTotalWritten would be more correct, but is less accurate */
+
+    /* calculate speed */
+    int copy_speed = ( int ) ( ( double ) g_iTotalWritten / sec_elapsed );
+    char s_copy_speed[20];
+    file_size_format ( s_copy_speed, copy_speed, 1 );
+
+    /* good-bye message */
+    printf ( "%d files (%s) moved in %.1f seconds (%s/s).\n", g_iFilesCopied, sTotalWritten,
+             sec_elapsed, s_copy_speed );
+    /* END progress mod */
+  }
+
   if (ok)
     {
       char const *dir_to_remove;
+
+
       if (copy_into_self)
         {
           /* In general, when copy returns with copy_into_self set, SOURCE is
@@ -298,6 +386,7 @@
       --backup[=CONTROL]       make a backup of each existing destination file\n\
   -b                           like --backup but does not accept an argument\n\
   -f, --force                  do not prompt before overwriting\n\
+  -g, --progress-bar	       add progress-bar\n\
   -i, --interactive            prompt before overwrite\n\
   -n, --no-clobber             do not overwrite an existing file\n\
 If you specify more than one of -i, -f, -n, only the final one takes effect.\n\
@@ -366,7 +455,7 @@
      we'll actually use backup_suffix_string.  */
   backup_suffix_string = getenv ("SIMPLE_BACKUP_SUFFIX");
 
-  while ((c = getopt_long (argc, argv, "bfint:uvS:T", long_options, NULL))
+  while ((c = getopt_long (argc, argv, "bfint:uvgS:T", long_options, NULL))
          != -1)
     {
       switch (c)
@@ -411,6 +500,9 @@
         case 'v':
           x.verbose = true;
           break;
+	case 'g':
+	  progress = true;
+	  break;
         case 'S':
           make_backups = true;
           backup_suffix_string = optarg;

--------------010004070709030803090109--


From MAILER-DAEMON Tue Aug 09 12:34:09 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QqpFp-0002ff-CE
	for mharc-coreutils@gnu.org; Tue, 09 Aug 2011 12:34:09 -0400
Received: from eggs.gnu.org ([140.186.70.92]:41314)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqpFj-0002fV-0c
	for coreutils@gnu.org; Tue, 09 Aug 2011 12:34:07 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqpFe-0001Ed-EG
	for coreutils@gnu.org; Tue, 09 Aug 2011 12:34:02 -0400
Received: from mx.meyering.net ([82.230.74.64]:55722)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QqpFe-0001ER-5q
	for coreutils@gnu.org; Tue, 09 Aug 2011 12:33:58 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 1BF53600D0;
	Tue,  9 Aug 2011 18:33:56 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Dmitry Ilyin <idv1985@gmail.com>
Subject: Re: progress bar in cp
In-Reply-To: <4E411CE1.4030507@gmail.com> (Dmitry Ilyin's message of "Tue, 09
	Aug 2011 15:41:21 +0400")
References: <4E2C583D.1090607@gmail.com> <4E411CE1.4030507@gmail.com>
Date: Tue, 09 Aug 2011 18:33:56 +0200
Message-ID: <87d3ge7de3.fsf@rho.meyering.net>
Lines: 20
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Aug 2011 16:34:07 -0000

Dmitry Ilyin wrote:
> 24.07.2011 21:37, Diogo Sousa =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
>> Hi,
>>
>> One feature that some users search for is a progress bar on the cp progr=
am.
>>
>> I would like to implement a progress bar in cp, would that patch be
>> accepted? Is there any reason not to do it?
>>
>> Thank You,
>> Diogo Sousa
>>
>>
> Here are two implementations.
>
> First is mine and second is someone else's.

Thank you for the suggestion and patches.
Have you considered using rsync?
Is there some reason you require this functionality in cp?


From MAILER-DAEMON Tue Aug 09 16:59:49 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QqtOv-0007hV-PH
	for mharc-coreutils@gnu.org; Tue, 09 Aug 2011 16:59:49 -0400
Received: from eggs.gnu.org ([140.186.70.92]:36109)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqtOp-0007g4-Tp
	for coreutils@gnu.org; Tue, 09 Aug 2011 16:59:47 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqtOk-0003nj-UB
	for coreutils@gnu.org; Tue, 09 Aug 2011 16:59:43 -0400
Received: from mail-fx0-f41.google.com ([209.85.161.41]:62055)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1QqtOk-0003nJ-FS
	for coreutils@gnu.org; Tue, 09 Aug 2011 16:59:38 -0400
Received: by fxg9 with SMTP id 9so505732fxg.0
	for <coreutils@gnu.org>; Tue, 09 Aug 2011 13:59:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=subject:mime-version:content-type:from:in-reply-to:date:cc
	:content-transfer-encoding:message-id:references:to:x-mailer;
	bh=Idp3ZQfGoQ3XhhOxYIB6Bm8FaCjYG15JbiUbrRkM0lg=;
	b=LZak5jw+4B8unvmV8SocrKCqDaUNTFql9bTRWFkywEA8teUoqyvKVO2b5BCTlsgEmZ
	Zf2Iues+PUsp6maZK2HdOZWvlVn+Fu50LF2R2j3kKH0HxPDNIjN+1Ap1GK60IGSDk298
	RQmzRtJaNBEN6Q61fYOTiRi4uJVRux6xb5uEg=
Received: by 10.204.144.203 with SMTP id a11mr2067670bkv.42.1312923577277;
	Tue, 09 Aug 2011 13:59:37 -0700 (PDT)
Received: from [192.168.25.11] ([81.17.157.197])
	by mx.google.com with ESMTPS id p15sm42439bkd.29.2011.08.09.13.59.34
	(version=TLSv1/SSLv3 cipher=OTHER);
	Tue, 09 Aug 2011 13:59:35 -0700 (PDT)
Subject: Re: progress bar in cp
Mime-Version: 1.0 (Apple Message framework v1244.3)
Content-Type: text/plain; charset=windows-1251
From: =?koi8-r?B?5M3J1NLJyiDpzNjJzg==?= <idv1985@gmail.com>
In-Reply-To: <87d3ge7de3.fsf@rho.meyering.net>
Date: Wed, 10 Aug 2011 00:59:33 +0400
Content-Transfer-Encoding: quoted-printable
Message-Id: <D998626D-5D12-4893-92C5-9ADA151A3170@gmail.com>
References: <4E2C583D.1090607@gmail.com> <4E411CE1.4030507@gmail.com>
	<87d3ge7de3.fsf@rho.meyering.net>
To: Jim Meyering <jim@meyering.net>
X-Mailer: Apple Mail (2.1244.3)
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.161.41
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Aug 2011 20:59:48 -0000

>=20
> Have you considered using rsync?
> Is there some reason you require this functionality in cp?

Rsync is not in coreutils and is not always installed.

Yes you can use rsync, use pv with pipe, use dd or any other way to copy =
files.
But people are used to type 'cp' when they want to copy file.
And Ctrl+T to show what file is coping now and % left would be nice.

Lets look at MacOS X 'cp'

First i will make big file using dd and press Ctrl+T 3 times during =
process.

macbook:~ dilyin$ dd if=3D/dev/zero of=3Dbig.file bs=3D1m count=3D1000
load: 0.65  cmd: dd 32844 running 0.00u 0.29s
188+0 records in
188+0 records out
197132288 bytes transferred in 0.867653 secs (227201787 bytes/sec)
load: 0.65  cmd: dd 32844 running 0.00u 0.42s
285+0 records in
284+0 records out
297795584 bytes transferred in 1.327377 secs (224348937 bytes/sec)
load: 0.65  cmd: dd 32844 uninterruptible 0.00u 0.99s
734+0 records in
733+0 records out
768606208 bytes transferred in 3.518059 secs (218474507 bytes/sec)
load: 0.65  cmd: dd 32844 uninterruptible 0.00u 1.29s
958+0 records in
957+0 records out
1003487232 bytes transferred in 4.627076 secs (216872870 bytes/sec)
1000+0 records in
1000+0 records out
1048576000 bytes transferred in 4.825880 secs (217281831 bytes/sec)

I can see current speed and how much have been written at any time.
(210Mb/s write is SSD)
FreeBSD has same feature and this interactivity is VERY useful when =
testing HDD speeds and for many other things.

Ok now lets do the same on FreeBSD box
I write 100mb file and press Ctrl+T 3 times

[dilyin@fbsd ~]$ dd if=3D/dev/zero of=3Dbig.file bs=3D1m count=3D100=20
load: 0.00  cmd: dd 88698 [wdrain] 0.00u 0.29s 1% 1740k
19+0 records in
18+0 records out
18874368 bytes transferred in 1.145493 secs (16477069 bytes/sec)
load: 0.00  cmd: dd 88698 [wdrain] 0.00u 0.55s 2% 1760k
89+0 records in
88+0 records out
92274688 bytes transferred in 4.100333 secs (22504194 bytes/sec)
100+0 records in
100+0 records out
104857600 bytes transferred in 4.464110 secs (23489026 bytes/sec)

Looks same as MacOS.
(23 Mb/s old SCSI hdd)

Note that I write 1m instead of 1M as in Linux's dd. I have asked on =
this list to add 'm' letter for megabyte in dd's get opt but was =
ignored.
FreeBSD users always type 1m and are confused when it doesn't work in =
linux.

Coreutils' dd will printout same info on SIGUSR1 but there is no way to =
send SIGUSR1 from keyboard, so i have to use killall -USR1 dd from =
second terminal. Convenient? NO!



Now lets copy file pressing Ctrl+T

macbook:~ dilyin$ cp big.file big2.file=20
load: 0.47  cmd: cp 32595 uninterruptible 0.00u 0.27s
big.file -> big2.file  17%
load: 0.59  cmd: cp 32595 running 0.00u 0.62s
big.file -> big2.file  40%
load: 0.59  cmd: cp 32595 running 0.00u 0.89s
big.file -> big2.file  58%
load: 0.59  cmd: cp 32595 running 0.00u 1.21s
big.file -> big2.file  79%
load: 0.59  cmd: cp 32595 running 0.00u 1.47s
big.file -> big2.file  96%

See? we got file name being copied, percent and time passed. Great!

Now FreeBSD

[dilyin@fbsd ~]$ cp big.file big1.file
load: 0.05  cmd: cp 89581 [wdrain] 0.00u 0.20s 0% 792k
big.file -> big1.file  36%
load: 0.05  cmd: cp 89581 [wdrain] 0.00u 0.27s 1% 812k
big.file -> big1.file  52%
load: 0.05  cmd: cp 89581 [runnable] 0.00u 0.46s 1% 812k
big.file -> big1.file  95%

Very similar with minor differences.

FreeBSD also goes even farther reporting system load and current process =
state on Ctrl+T even in program doesn't support it! Macos doesn't have =
it.

What linux can offer to interactively monitor cp/mv/install? Nothing! =
Well=85 Use rsync)

Of cause implementing SIGINFO or at least SIGUSR1 from Ctrl+T will =
require tinker with kernel, but what can we do?

1. Add similar printout for cp/mv/install on SIGUSR1
2. Add option to display progress bar for every file copied and file =
name too. It's much easier to implement then new signals in kernel tty.
3. PLEASE Add 'm' synonym of 'M' in 'dd'. Backend library supports both =
just add one letter in get opt allowed options list.=


From MAILER-DAEMON Wed Aug 10 05:32:18 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qr598-0000Ok-JJ
	for mharc-coreutils@gnu.org; Wed, 10 Aug 2011 05:32:18 -0400
Received: from eggs.gnu.org ([140.186.70.92]:54006)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qr596-0000OK-Af
	for coreutils@gnu.org; Wed, 10 Aug 2011 05:32:17 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qr595-00016Q-D5
	for coreutils@gnu.org; Wed, 10 Aug 2011 05:32:16 -0400
Received: from rcsinet15.oracle.com ([148.87.113.117]:19731)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qr595-00016D-7p
	for coreutils@gnu.org; Wed, 10 Aug 2011 05:32:15 -0400
Received: from acsinet22.oracle.com (acsinet22.oracle.com [141.146.126.238])
	by rcsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7A9W9Wr007183
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 10 Aug 2011 09:32:11 GMT
Received: from acsmt356.oracle.com (acsmt356.oracle.com [141.146.40.156])
	by acsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7A9W8jt007008
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Wed, 10 Aug 2011 09:32:08 GMT
Received: from abhmt113.oracle.com (abhmt113.oracle.com [141.146.116.65])
	by acsmt356.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7A9W2qZ008721; Wed, 10 Aug 2011 04:32:02 -0500
Received: from [192.168.1.102] (/221.223.97.179)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Wed, 10 Aug 2011 02:32:02 -0700
Message-ID: <4E42500D.3050702@oracle.com>
Date: Wed, 10 Aug 2011 17:31:57 +0800
From: Jeff Liu <jeff.liu@oracle.com>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: coreutils@gnu.org
Subject: Feature Request for cp(1) utility, consider Btrfs ioctl clone range
	support
Content-Type: text/plain; charset=GB2312
Content-Transfer-Encoding: 7bit
X-Source-IP: acsinet22.oracle.com [141.146.126.238]
X-Auth-Type: Internal IP
X-CT-RefId: str=0001.0A090207.4E42501B.008A:SCFMA922111,ss=1,re=-4.000,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 148.87.113.117
Cc: chris.mason@oracle.com
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Aug 2011 09:32:17 -0000

Hello,

I just found a cool feature in Btrfs for cloning partially source file
to the destination by specifying the desired offset and length to be copied.

The call interface is something like below:
struct btrfs_clone_range_args cr;
cr.src_fd = source_desc;
cr.src_offset = (uint64_t) offset;
cr.src_length = (uint64_t) length;
cr.dest_offset = (uint64_t) d_offset;
ioctl(dest_fd, BTRFS_IOC_CLONE_RANGE, &args);

cp(1) has already works with "reflink" supported for a long time, IMHO,
this new feature could improve it to some extent.
Is it acceptable to add a new option like
"--reflink-range=src_offset,src_length,dst_offset" to clone partially
source file?
In this way, if reflink-range is triggered, cp(1) will try to parse the
offset and length which are separated by comma,
then try to clone src_length bytes from src_offset to the destination
file started at dst_offset.
if reflink-range failed, just let cp(1) fail with appropriate error info.

I'd like to implement it if you guys think it does make sense. :-P.

Thanks,
-Jeff


From MAILER-DAEMON Thu Aug 11 10:46:26 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrWWg-0003aA-Ja
	for mharc-coreutils@gnu.org; Thu, 11 Aug 2011 10:46:26 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33839)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrWWe-0003ZE-Oi
	for coreutils@gnu.org; Thu, 11 Aug 2011 10:46:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrWWe-0001xW-1B
	for coreutils@gnu.org; Thu, 11 Aug 2011 10:46:24 -0400
Received: from mx.meyering.net ([82.230.74.64]:44750)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrWWd-0001xQ-Pg
	for coreutils@gnu.org; Thu, 11 Aug 2011 10:46:23 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id F2DA96005B
	for <coreutils@gnu.org>; Thu, 11 Aug 2011 16:46:22 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: [PATCH] maint: use gnulib's new largefile modulue
Date: Thu, 11 Aug 2011 16:46:22 +0200
Message-ID: <87zkjgypj5.fsf@rho.meyering.net>
Lines: 37
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Aug 2011 14:46:25 -0000

FYI,

>From dce1da2b57fa57276583ee266b023a110062610f Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Tue, 9 Aug 2011 10:28:31 +0200
Subject: [PATCH] maint: use gnulib's new largefile modulue

* bootstrap.conf (gnulib_modules): Add largefile.
This is useful to Mac OS X 10.5 users if/when configure
is generated using autoconf prior to v2.68-80-gdb2f2e0.
* gnulib: Update to latest.
---
 bootstrap.conf |    1 +
 gnulib         |    2 +-
 2 files changed, 2 insertions(+), 1 deletions(-)

diff --git a/bootstrap.conf b/bootstrap.conf
index 0ba560c..7be4e5a 100644
--- a/bootstrap.conf
+++ b/bootstrap.conf
@@ -125,6 +125,7 @@ gnulib_modules="
   inttypes
   isapipe
   isblank
+  largefile
   lchmod
   lchown
   ldtoastr
diff --git a/gnulib b/gnulib
index fb73307..17857d4 160000
--- a/gnulib
+++ b/gnulib
@@ -1 +1 @@
-Subproject commit fb733077fcd97a36e1ffdb292387943df8e1b9b4
+Subproject commit 17857d41b41e7b22ba58e4e0d98693ee14f022d4
--
1.7.6.433.g1421f


From MAILER-DAEMON Thu Aug 11 18:02:31 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrdKh-0004jZ-0V
	for mharc-coreutils@gnu.org; Thu, 11 Aug 2011 18:02:31 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47872)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <darko.veberic@ung.si>) id 1QrdCf-0003Y7-VR
	for coreutils@gnu.org; Thu, 11 Aug 2011 17:54:14 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <darko.veberic@ung.si>) id 1QrdCe-0000fS-Ri
	for coreutils@gnu.org; Thu, 11 Aug 2011 17:54:13 -0400
Received: from rodez.p-ng.si ([193.2.120.10]:43249 helo=rodez.ung.si)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <darko.veberic@ung.si>) id 1QrdCe-0000fE-MO
	for coreutils@gnu.org; Thu, 11 Aug 2011 17:54:12 -0400
Received: from localhost (unknown [127.0.0.1])
	by rodez.ung.si (Postfix) with ESMTP id 5FFDD14665070;
	Thu, 11 Aug 2011 21:54:09 +0000 (UTC)
X-Virus-Scanned: amavisd-new at ung.si
Received: from rodez.ung.si ([127.0.0.1])
	by localhost (rodez.ung.si [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id uEa7bLjzkbWv; Thu, 11 Aug 2011 23:54:08 +0200 (CEST)
Received: from [192.168.1.2] (84-255-205-207.static.t-2.net [84.255.205.207])
	(using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits))
	(No client certificate requested)
	by rodez.ung.si (Postfix) with ESMTPSA id C30CA1465D3DF;
	Thu, 11 Aug 2011 23:54:08 +0200 (CEST)
Message-ID: <4E444F80.60506@ung.si>
Date: Thu, 11 Aug 2011 23:54:08 +0200
From: Darko Veberic <darko.veberic@ung.si>
Organization: UNG
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: coreutils@gnu.org
Subject: 'date' enhancement: flush in format string
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 193.2.120.10
X-Mailman-Approved-At: Thu, 11 Aug 2011 18:02:29 -0400
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Aug 2011 21:54:14 -0000

dear developers,

with awk i have been processing large text files where the first field 
was a human-readable date that had to be converted to unix second. for 
this purpose i was using an awk pipe call

{d="date -u -d "$1" +%s"; d | getline t; close(d); print t,...}

where $1 was holding the date string. unfortunately the files contained 
on the order of million such lines and awk was able to process only 
~2000 lines per second. the slowness was mostly due to the spawning of 
the "date" process for each line.

then it occurred to me that i could use "date" as a co-process in awk 
directly, spawning "date" only once and using the date's -f redirected 
to standard input:

BEGIN{d="date -u -f- +%s"}
{print $1 |& d; d |& getline t; print t,...}
END{close(d)}

unfortunately "date" is not flushing its output after each input line is 
processed, resulting in awk's getline deadlock.

enhancement request:
is it possible to add another % symbol to the date output format, say %f 
(not taken yet) which would trigger output flush, ie i would modify my 
example above into

date -u -f- +%s%f

this would really help in my case!

best regards,
%^>
-- 
darko.

asst.prof.dr. Darko Veberic --------------
Laboratory for Astroparticle Physics
University of Nova Gorica
Vipavska 13, SI-5000 Nova Gorica, Slovenia
mobile: +386 41 860 861
.phone: +386 5 3315 255
...fax: +386 5 3315 385
------------------------------------------
Department for Theoretical Physics
Jozef Stefan Institute,
Jamova 39, SI-1000 Ljubljana, Slovenia
------------------------------------------
CERN, NA61/SHINE, 892 R-A16 Z02200
CH-1211 Geneve 23, Switzerland
phone: +41 22 76 764 89
------------------------------------------


From MAILER-DAEMON Thu Aug 11 18:20:43 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrdcJ-0007y4-IV
	for mharc-coreutils@gnu.org; Thu, 11 Aug 2011 18:20:43 -0400
Received: from eggs.gnu.org ([140.186.70.92]:42586)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QrdcD-0007vF-H6
	for coreutils@gnu.org; Thu, 11 Aug 2011 18:20:41 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qrdc9-0004qw-GF
	for coreutils@gnu.org; Thu, 11 Aug 2011 18:20:37 -0400
Received: from mx1.redhat.com ([209.132.183.28]:32890)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qrdc9-0004qk-9G
	for coreutils@gnu.org; Thu, 11 Aug 2011 18:20:33 -0400
Received: from int-mx09.intmail.prod.int.phx2.redhat.com
	(int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7BMKV2L014307
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Thu, 11 Aug 2011 18:20:31 -0400
Received: from [10.3.113.151] (ovpn-113-151.phx2.redhat.com [10.3.113.151])
	by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7BMKVp2016739; Thu, 11 Aug 2011 18:20:31 -0400
Message-ID: <4E4455AE.1080404@redhat.com>
Date: Thu, 11 Aug 2011 16:20:30 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Darko Veberic <darko.veberic@ung.si>
Subject: Re: 'date' enhancement: flush in format string
References: <4E444F80.60506@ung.si>
In-Reply-To: <4E444F80.60506@ung.si>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 11 Aug 2011 22:20:41 -0000

On 08/11/2011 03:54 PM, Darko Veberic wrote:
> then it occurred to me that i could use "date" as a co-process in awk
> directly, spawning "date" only once and using the date's -f redirected
> to standard input:
>
> BEGIN{d="date -u -f- +%s"}
> {print $1 |& d; d |& getline t; print t,...}
> END{close(d)}

Interesting idea to use a coprocess!

>
> unfortunately "date" is not flushing its output after each input line is
> processed, resulting in awk's getline deadlock.
>
> enhancement request:
> is it possible to add another % symbol to the date output format, say %f

No.  Format symbols are scarce, and %f is already taken.

But there some other viable options.

One idea is to change date to always flush after every line.  But I 
don't know if this would hurt performance when the flushing is not 
needed, and you'd have the same problem as with your %f proposal - 
namely, it would take a while for the code to propagate onto your machine.

Another idea is to use something that already exists.  date uses stdio, 
so the stdbuf utility (also part of coreutils) can be used to force date 
into line-buffered mode.  So, try "stdbuf -o L date -u -f- +%s" as your 
command instead of raw date.

Also, how uniform is the date input already present in the input file? 
If it is sufficiently uniform, can you just use awk's own date parsing 
utilities?  It comes with a few builtins that may be able to already 
handle your needs without spawning external processes.

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Thu Aug 11 21:46:21 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrgpJ-00027d-AH
	for mharc-coreutils@gnu.org; Thu, 11 Aug 2011 21:46:21 -0400
Received: from eggs.gnu.org ([140.186.70.92]:34889)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1QrgpF-00024g-7o
	for coreutils@gnu.org; Thu, 11 Aug 2011 21:46:19 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1QrgpD-0006GC-Gq
	for coreutils@gnu.org; Thu, 11 Aug 2011 21:46:17 -0400
Received: from smtp.cs.ucla.edu ([131.179.128.62]:48776)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>)
	id 1Qrgp9-0006EH-DI; Thu, 11 Aug 2011 21:46:11 -0400
Received: from localhost (localhost.localdomain [127.0.0.1])
	by smtp.cs.ucla.edu (Postfix) with ESMTP id 1F01B39E810E;
	Thu, 11 Aug 2011 18:46:02 -0700 (PDT)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
	by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id K5E1IokbA14H; Thu, 11 Aug 2011 18:46:00 -0700 (PDT)
Received: from [198.18.132.116] (unknown [66.224.35.98])
	by smtp.cs.ucla.edu (Postfix) with ESMTPSA id AC19939E80D2;
	Thu, 11 Aug 2011 18:46:00 -0700 (PDT)
Message-ID: <4E4485D3.4050905@cs.ucla.edu>
Date: Thu, 11 Aug 2011 18:45:55 -0700
From: Paul Eggert <eggert@cs.ucla.edu>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: Simon Josefsson <simon@josefsson.org>
Subject: Re: make -q and maintainer-makefile issues?
References: <87pqkdkkz1.fsf@latte.josefsson.org> <4E441F37.9060007@cs.ucla.edu>
In-Reply-To: <4E441F37.9060007@cs.ucla.edu>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 131.179.128.62
Cc: bug-gnulib@gnu.org, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 01:46:19 -0000

On 08/11/2011 11:28 AM, Paul Eggert wrote:
> I'll look at coreutils shortly.

... and I discovered that coreutils was still using gettext 0.17 (!)
via autopoint, so it didn't pick up the gnulib patch (and it was missing
several other gnulib fixes since 0.17).  I installed the
following into coreutils to fix the problem.  In testing builds I found
some other porting issues, in gnulib getaddrinfo and in coreutils
pathchk, and will try to follow up on them soon.

>From 99399c6c8a6d65b359493d8bf9a9572dd98d200f Mon Sep 17 00:00:00 2001
From: Paul Eggert <eggert@cs.ucla.edu>
Date: Thu, 11 Aug 2011 11:42:03 -0700
Subject: [PATCH] bootstrap: use latest gnulib bootstrap, gettext

* bootstrap: Sync from gnulib.  This removes an obsolescent
gettext.m4 patch, along with some other changes that do not
seem to affect coreutils.
* bootstrap.conf (gnulib_modules): Use gettext, not gettext-h.
Current gnulib gettext seems to work without needing special hacking.
* configure.ac (AM_GNU_GETTEXT_VERSION): Now 0.18.1, not 0.17.
* gnulib: Update to latest.
---
 bootstrap      |  100 ++++++++++++++++++++++++++++++++++----------------------
 bootstrap.conf |    2 +-
 configure.ac   |    2 +-
 gnulib         |    2 +-
 4 files changed, 64 insertions(+), 42 deletions(-)

diff --git a/bootstrap b/bootstrap
index c45ae48..f76db9a 100755
--- a/bootstrap
+++ b/bootstrap
@@ -1,6 +1,6 @@
 #! /bin/sh
 # Print a version string.
-scriptversion=2011-05-03.08; # UTC
+scriptversion=2011-08-11.17; # UTC
 
 # Bootstrap this package from checked-out sources.
 
@@ -130,18 +130,7 @@ source_base=lib
 m4_base=m4
 doc_base=doc
 tests_base=tests
-
-# Extra files from gnulib, which override files from other sources.
-gnulib_extra_files="
-        $build_aux/install-sh
-        $build_aux/missing
-        $build_aux/mdate-sh
-        $build_aux/texinfo.tex
-        $build_aux/depcomp
-        $build_aux/config.guess
-        $build_aux/config.sub
-        doc/INSTALL
-"
+gnulib_extra_files=''
 
 # Additional gnulib-tool options to use.  Use "\newline" to break lines.
 gnulib_tool_option_extras=
@@ -229,6 +218,18 @@ case "$0" in
   *) test -r "$0.conf" && . ./"$0.conf" ;;
 esac
 
+# Extra files from gnulib, which override files from other sources.
+test -z "${gnulib_extra_files}" && \
+  gnulib_extra_files="
+        $build_aux/install-sh
+        $build_aux/missing
+        $build_aux/mdate-sh
+        $build_aux/texinfo.tex
+        $build_aux/depcomp
+        $build_aux/config.guess
+        $build_aux/config.sub
+        doc/INSTALL
+"
 
 if test "$vc_ignore" = auto; then
   vc_ignore=
@@ -278,14 +279,29 @@ if test -n "$checkout_only_file" && test ! -r "$checkout_only_file"; then
   exit 1
 fi
 
+# Ensure that lines starting with ! sort last, per gitignore conventions
+# for whitelisting exceptions after a more generic blacklist pattern.
+sort_patterns() {
+  sort -u "$@" | sed '/^!/ {
+    H
+    d
+  }
+  $ {
+    P
+    x
+    s/^\n//
+  }' | sed '/^$/d'
+}
+
 # If $STR is not already on a line by itself in $FILE, insert it,
 # sorting the new contents of the file and replacing $FILE with the result.
 insert_sorted_if_absent() {
   file=$1
   str=$2
   test -f $file || touch $file
-  echo "$str" | sort -u - $file | cmp - $file > /dev/null \
-    || echo "$str" | sort -u - $file -o $file \
+  echo "$str" | sort_patterns - $file | cmp - $file > /dev/null \
+    || { echo "$str" | sort_patterns - $file > $file.bak \
+      && mv $file.bak $file; } \
     || exit 1
 }
 
@@ -409,17 +425,28 @@ check_versions() {
         GZIP) ;; # Do not use $GZIP:  it contains gzip options.
         *) eval "app=\${$appvar-$app}" ;;
     esac
-    inst_ver=$(get_version $app)
-    if [ ! "$inst_ver" ]; then
-      echo "$me: Error: '$app' not found" >&2
-      ret=1
-    elif [ ! "$req_ver" = "-" ]; then
-      latest_ver=$(sort_ver $req_ver $inst_ver | cut -d' ' -f2)
-      if [ ! "$latest_ver" = "$inst_ver" ]; then
-        echo "$me: Error: '$app' version == $inst_ver is too old" >&2
-        echo "       '$app' version >= $req_ver is required" >&2
+    if [ "$req_ver" = "-" ]; then
+      # Merely require app to exist; not all prereq apps are well-behaved
+      # so we have to rely on $? rather than get_version.
+      $app --version >/dev/null 2>&1
+      if [ 126 -le $? ]; then
+        echo "$me: Error: '$app' not found" >&2
         ret=1
       fi
+    else
+      # Require app to produce a new enough version string.
+      inst_ver=$(get_version $app)
+      if [ ! "$inst_ver" ]; then
+        echo "$me: Error: '$app' not found" >&2
+        ret=1
+      else
+        latest_ver=$(sort_ver $req_ver $inst_ver | cut -d' ' -f2)
+        if [ ! "$latest_ver" = "$inst_ver" ]; then
+          echo "$me: Error: '$app' version == $inst_ver is too old" >&2
+          echo "       '$app' version >= $req_ver is required" >&2
+          ret=1
+        fi
+      fi
     fi
   done
 
@@ -643,10 +670,18 @@ symlink_to_dir()
         cp -fp "$src" "$dst"
       }
     else
+      # Leave any existing symlink alone, if it already points to the source,
+      # so that broken build tools that care about symlink times
+      # aren't confused into doing unnecessary builds.  Conversely, if the
+      # existing symlink's time stamp is older than the source, make it afresh,
+      # so that broken tools aren't confused into skipping needed builds.  See
+      # <http://lists.gnu.org/archive/html/bug-gnulib/2011-05/msg00326.html>.
       test -h "$dst" &&
       src_ls=`ls -diL "$src" 2>/dev/null` && set $src_ls && src_i=$1 &&
       dst_ls=`ls -diL "$dst" 2>/dev/null` && set $dst_ls && dst_i=$1 &&
-      test "$src_i" = "$dst_i" || {
+      test "$src_i" = "$dst_i" &&
+      both_ls=`ls -dt "$src" "$dst"` &&
+      test "X$both_ls" = "X$dst$nl$src" || {
         dot_dots=
         case $src in
         /*) ;;
@@ -765,20 +800,7 @@ slurp() {
         echo "$me: $dir/$file overrides $1/$dir/$file"
       else
         copied=$copied$sep$file; sep=$nl
-        if test $file = gettext.m4; then
-          echo "$me: patching m4/gettext.m4 to remove need for intl/* ..."
-          rm -f $dir/$file
-          sed '
-            /^AC_DEFUN(\[AM_INTL_SUBDIR],/,/^]/c\
-              AC_DEFUN([AM_INTL_SUBDIR], [])
-            /^AC_DEFUN(\[gt_INTL_SUBDIR_CORE],/,/^]/c\
-              AC_DEFUN([gt_INTL_SUBDIR_CORE], [])
-            $a\
-              AC_DEFUN([gl_LOCK_EARLY], [])
-          ' $1/$dir/$file >$dir/$file
-        else
-          cp_mark_as_generated $1/$dir/$file $dir/$file
-        fi
+        cp_mark_as_generated $1/$dir/$file $dir/$file
       fi || exit
     done
 
diff --git a/bootstrap.conf b/bootstrap.conf
index 7be4e5a..964b0be 100644
--- a/bootstrap.conf
+++ b/bootstrap.conf
@@ -101,7 +101,7 @@ gnulib_modules="
   getopt-gnu
   getpagesize
   getpass-gnu
-  gettext-h
+  gettext
   gettime
   gettimeofday
   getugroups
diff --git a/configure.ac b/configure.ac
index 41b2f00..291b19e 100644
--- a/configure.ac
+++ b/configure.ac
@@ -452,7 +452,7 @@ AC_SUBST([CONFIG_STATUS_DEPENDENCIES])
 # As long as "grep 'PRI[diouxX]' po/*.pot" reports matches in
 # translatable strings, we must use need-formatstring-macros here.
 AM_GNU_GETTEXT([external], [need-formatstring-macros])
-AM_GNU_GETTEXT_VERSION([0.17])
+AM_GNU_GETTEXT_VERSION([0.18.1])
 
 # For a test of uniq: it uses the $LOCALE_FR envvar.
 gt_LOCALE_FR
diff --git a/gnulib b/gnulib
index 17857d4..d2b8ab6 160000
--- a/gnulib
+++ b/gnulib
@@ -1 +1 @@
-Subproject commit 17857d41b41e7b22ba58e4e0d98693ee14f022d4
+Subproject commit d2b8ab669f3129ac0d349eead1217adc38d795eb
-- 
1.7.4.4



From MAILER-DAEMON Thu Aug 11 21:50:09 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qrgsz-0002P1-Ll
	for mharc-coreutils@gnu.org; Thu, 11 Aug 2011 21:50:09 -0400
Received: from eggs.gnu.org ([140.186.70.92]:35670)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qrgsx-0002Ka-4E
	for coreutils@gnu.org; Thu, 11 Aug 2011 21:50:08 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qrgsv-0006mq-Tw
	for coreutils@gnu.org; Thu, 11 Aug 2011 21:50:07 -0400
Received: from mx1.redhat.com ([209.132.183.28]:42078)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>)
	id 1Qrgst-0006kF-II; Thu, 11 Aug 2011 21:50:03 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7C1o0Vt021599
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Thu, 11 Aug 2011 21:50:01 -0400
Received: from [10.3.113.151] (ovpn-113-151.phx2.redhat.com [10.3.113.151])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7C1o0Qq002784; Thu, 11 Aug 2011 21:50:00 -0400
Message-ID: <4E4486C7.9050705@redhat.com>
Date: Thu, 11 Aug 2011 19:49:59 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Paul Eggert <eggert@cs.ucla.edu>
Subject: Re: make -q and maintainer-makefile issues?
References: <87pqkdkkz1.fsf@latte.josefsson.org>
	<4E441F37.9060007@cs.ucla.edu> <4E4485D3.4050905@cs.ucla.edu>
In-Reply-To: <4E4485D3.4050905@cs.ucla.edu>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: Simon Josefsson <simon@josefsson.org>, bug-gnulib@gnu.org,
	coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 01:50:08 -0000

On 08/11/2011 07:45 PM, Paul Eggert wrote:
> On 08/11/2011 11:28 AM, Paul Eggert wrote:
>> I'll look at coreutils shortly.
>
> ... and I discovered that coreutils was still using gettext 0.17 (!)

To some degree, that was intentional.  At least cygwin still ships with 
only gettext 0.17, because all versions of 0.18 are unbuildable on the 
current cygwin.

Pushing this change makes it impossible to do a bootstrap of coreutils 
on cygwin.  :(

> * bootstrap.conf (gnulib_modules): Use gettext, not gettext-h.

'gettext' is used when you want bleeding edge, and requires 0.18.1. 
'gettext-h' is when you don't care about bleeding edge, and instead want 
to be portable to distros that are still at 0.17 (this includes popular 
distros like RHEL 5 and CentOS 5).  I'm not sure if we should revert 
this part of your change.

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Fri Aug 12 02:31:21 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrlH7-0000B6-86
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 02:31:21 -0400
Received: from eggs.gnu.org ([140.186.70.92]:32976)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1QrlH3-00006w-KY
	for coreutils@gnu.org; Fri, 12 Aug 2011 02:31:18 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1QrlH2-00059q-Gx
	for coreutils@gnu.org; Fri, 12 Aug 2011 02:31:17 -0400
Received: from smtp.cs.ucla.edu ([131.179.128.62]:51735)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>)
	id 1QrlH0-00059N-6p; Fri, 12 Aug 2011 02:31:14 -0400
Received: from localhost (localhost.localdomain [127.0.0.1])
	by smtp.cs.ucla.edu (Postfix) with ESMTP id 0BEEAA60003;
	Thu, 11 Aug 2011 23:31:12 -0700 (PDT)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
	by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id q3vW65JNDmwS; Thu, 11 Aug 2011 23:31:11 -0700 (PDT)
Received: from [198.18.132.116] (unknown [66.224.35.98])
	by smtp.cs.ucla.edu (Postfix) with ESMTPSA id 73626A60002;
	Thu, 11 Aug 2011 23:31:11 -0700 (PDT)
Message-ID: <4E44C8A6.6090109@cs.ucla.edu>
Date: Thu, 11 Aug 2011 23:31:02 -0700
From: Paul Eggert <eggert@cs.ucla.edu>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: Eric Blake <eblake@redhat.com>
Subject: Re: make -q and maintainer-makefile issues?
References: <87pqkdkkz1.fsf@latte.josefsson.org>
	<4E441F37.9060007@cs.ucla.edu> <4E4485D3.4050905@cs.ucla.edu>
	<4E4486C7.9050705@redhat.com>
In-Reply-To: <4E4486C7.9050705@redhat.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 131.179.128.62
Cc: Simon Josefsson <simon@josefsson.org>, bug-gnulib@gnu.org,
	coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 06:31:18 -0000

On 08/11/2011 06:49 PM, Eric Blake wrote:
> I'm not sure if we should revert this part of your change.

Unfortunately if that part is reverted, then coreutils would lose
all gnulib fixes in the gettext area, due to the funny way that
'bootstrap' invokes autopoint.  This includes not only the fix for
make -q but also fixes for uClibc, ksh's FPATH, visibility decls, and
probably some other stuff (I got tired of reading the diff).

If there's some way to keep the gnulib gettext fixes, but still
bootstrap on Cygwin, that'd be good.  In the meantime, surely it's
not a great loss if coreutils can't bootstrap on Cygwin.
Bootstrapping is for developers who have recent tools, and we
needn't worry overly much about bootstrapping on platforms that
don't have up-to-date tools.


From MAILER-DAEMON Fri Aug 12 03:25:04 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qrm76-0001B5-Bg
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 03:25:04 -0400
Received: from eggs.gnu.org ([140.186.70.92]:55375)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1Qrm73-000177-MN
	for coreutils@gnu.org; Fri, 12 Aug 2011 03:25:02 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1Qrm72-0005Me-IX
	for coreutils@gnu.org; Fri, 12 Aug 2011 03:25:01 -0400
Received: from smtp.cs.ucla.edu ([131.179.128.62]:57085)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>)
	id 1Qrm70-0005MG-8j; Fri, 12 Aug 2011 03:24:58 -0400
Received: from localhost (localhost.localdomain [127.0.0.1])
	by smtp.cs.ucla.edu (Postfix) with ESMTP id DB3C5A60003;
	Fri, 12 Aug 2011 00:24:56 -0700 (PDT)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
	by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id E-+OlLKmzBed; Fri, 12 Aug 2011 00:24:56 -0700 (PDT)
Received: from [198.18.132.116] (unknown [66.224.35.98])
	by smtp.cs.ucla.edu (Postfix) with ESMTPSA id 4C056A60002;
	Fri, 12 Aug 2011 00:24:56 -0700 (PDT)
Message-ID: <4E44D546.1040005@cs.ucla.edu>
Date: Fri, 12 Aug 2011 00:24:54 -0700
From: Paul Eggert <eggert@cs.ucla.edu>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: bug-gnulib@gnu.org
Subject: [PATCH] getaddrinfo: fix sh typo in gai_strerrorA decl checking
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 131.179.128.62
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 07:25:03 -0000

I pushed this typo fix into gnulib, and it should eventually
appear in coreutils.

getaddrinfo: fix sh typo in gai_strerrorA decl checking
* m4/getaddrinfo.m4 (gl_GETADDRINFO): Fix typo in the generated
shell code: it contained a 'break' that was not in a loop.
Apparently the macro assumed that AC_CHECK_DECLS is implemenented
via a shell-language loop; this may have been true in old Autoconf
versions, but it's not true in Autoconf 2.68.  I found this bug
when testing coreutils git on Solaris 8, whose shell complains
about the syntax error.
diff --git a/m4/getaddrinfo.m4 b/m4/getaddrinfo.m4
index 4fecfb2..fe8d14f 100644
--- a/m4/getaddrinfo.m4
+++ b/m4/getaddrinfo.m4
@@ -1,4 +1,4 @@
-# getaddrinfo.m4 serial 27
+# getaddrinfo.m4 serial 28
 dnl Copyright (C) 2004-2011 Free Software Foundation, Inc.
 dnl This file is free software; the Free Software Foundation
 dnl gives unlimited permission to copy and/or distribute it,
@@ -63,7 +63,7 @@ AC_DEFUN([gl_GETADDRINFO],
   # We can't use AC_REPLACE_FUNCS here because gai_strerror may be an
   # inline function declared in ws2tcpip.h, so we need to get that
   # header included somehow.
-  AC_CHECK_DECLS([gai_strerror, gai_strerrorA], [], [break], [[
+  AC_CHECK_DECLS([gai_strerror], [], [], [[
 #include <sys/types.h>
 #ifdef HAVE_SYS_SOCKET_H
 #include <sys/socket.h>
@@ -77,6 +77,19 @@ AC_DEFUN([gl_GETADDRINFO],
 #include <stddef.h>
 ]])
   if test $ac_cv_have_decl_gai_strerror = yes; then
+    AC_CHECK_DECLS([gai_strerrorA], [], [], [[
+#include <sys/types.h>
+#ifdef HAVE_SYS_SOCKET_H
+#include <sys/socket.h>
+#endif
+#ifdef HAVE_NETDB_H
+#include <netdb.h>
+#endif
+#ifdef HAVE_WS2TCPIP_H
+#include <ws2tcpip.h>
+#endif
+#include <stddef.h>
+]])
     dnl check for correct signature
     AC_CACHE_CHECK([for gai_strerror with POSIX signature],
      [gl_cv_func_gai_strerror_posix_signature], [


From MAILER-DAEMON Fri Aug 12 04:18:32 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qrmwq-0002nm-IB
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 04:18:32 -0400
Received: from eggs.gnu.org ([140.186.70.92]:52237)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1Qrmwn-0002m6-Ij
	for coreutils@gnu.org; Fri, 12 Aug 2011 04:18:30 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1Qrmwm-00069T-Io
	for coreutils@gnu.org; Fri, 12 Aug 2011 04:18:29 -0400
Received: from smtp.cs.ucla.edu ([131.179.128.62]:53034)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eggert@cs.ucla.edu>) id 1Qrmwm-00069P-AA
	for coreutils@gnu.org; Fri, 12 Aug 2011 04:18:28 -0400
Received: from localhost (localhost.localdomain [127.0.0.1])
	by smtp.cs.ucla.edu (Postfix) with ESMTP id 503E1A60003
	for <coreutils@gnu.org>; Fri, 12 Aug 2011 01:18:26 -0700 (PDT)
X-Virus-Scanned: amavisd-new at smtp.cs.ucla.edu
Received: from smtp.cs.ucla.edu ([127.0.0.1])
	by localhost (smtp.cs.ucla.edu [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id qGuygVgGhsi9 for <coreutils@gnu.org>;
	Fri, 12 Aug 2011 01:18:25 -0700 (PDT)
Received: from [198.18.132.116] (unknown [66.224.35.98])
	by smtp.cs.ucla.edu (Postfix) with ESMTPSA id C486EA60002
	for <coreutils@gnu.org>; Fri, 12 Aug 2011 01:18:25 -0700 (PDT)
Message-ID: <4E44E1D0.2050000@cs.ucla.edu>
Date: Fri, 12 Aug 2011 01:18:24 -0700
From: Paul Eggert <eggert@cs.ucla.edu>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: coreutils@gnu.org
Subject: [PATCH] pathchk: port to hosts where mbstate_t is replaced
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 131.179.128.62
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 08:18:30 -0000

I pushed this:

pathchk: port to hosts where mbstate_t is replaced
This problem was discovered when trying to build git coreutils on
Solaris 8 sparcv9 with Sun C 5.8: the 3rd argument to mbrlen was
of type int * (a pointer to the gnulib replacement mbstate_t) but
the system mbrlen wants the system mbstate_t *.
* bootstrap.conf (gnulib_modules): Add mbrlen.
* src/pathchk.c (mbrlen, mbstate_t) [!(HAVE_MBRLEN && HAVE_MBSTATE_T)]:
Remove macros, which are wrong now that gnulib supplies
replacements for mbstate_t and mbrlen.
diff --git a/bootstrap.conf b/bootstrap.conf
index 964b0be..820cb54 100644
--- a/bootstrap.conf
+++ b/bootstrap.conf
@@ -139,6 +139,7 @@ gnulib_modules="
   maintainer-makefile
   malloc-gnu
   manywarnings
+  mbrlen
   mbrtowc
   mbsalign
   mbswidth
diff --git a/src/pathchk.c b/src/pathchk.c
index 8146528..4632696 100644
--- a/src/pathchk.c
+++ b/src/pathchk.c
@@ -25,11 +25,6 @@
 #include "quote.h"
 #include "quotearg.h"

-#if ! (HAVE_MBRLEN && HAVE_MBSTATE_T)
-# define mbrlen(s, n, ps) 1
-# define mbstate_t int
-#endif
-
 /* The official name of this program (e.g., no `g' prefix).  */
 #define PROGRAM_NAME "pathchk"



From MAILER-DAEMON Fri Aug 12 11:26:47 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrtdH-0006oR-Mo
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 11:26:47 -0400
Received: from eggs.gnu.org ([140.186.70.92]:49458)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrtdE-0006oD-My
	for coreutils@gnu.org; Fri, 12 Aug 2011 11:26:46 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrtdD-00032k-TM
	for coreutils@gnu.org; Fri, 12 Aug 2011 11:26:44 -0400
Received: from mx.meyering.net ([82.230.74.64]:46966)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QrtdD-00032U-Ny
	for coreutils@gnu.org; Fri, 12 Aug 2011 11:26:43 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 0595E600D5;
	Fri, 12 Aug 2011 17:26:41 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: idv1985@gmail.com
Subject: Re: progress bar in cp
In-Reply-To: <D998626D-5D12-4893-92C5-9ADA151A3170@gmail.com>
	(=?utf-8?B?ItCU0LzQuNGC0YDQuNC5CdCY0LvRjNC40L0iJ3M=?= message of "Wed,
	10 Aug 2011 00:59:33 +0400")
References: <4E2C583D.1090607@gmail.com> <4E411CE1.4030507@gmail.com>
	<87d3ge7de3.fsf@rho.meyering.net>
	<D998626D-5D12-4893-92C5-9ADA151A3170@gmail.com>
Date: Fri, 12 Aug 2011 17:26:41 +0200
Message-ID: <87r54qwszy.fsf@rho.meyering.net>
Lines: 23
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 15:26:46 -0000

idv1985@gmail.com wrote:
>> Have you considered using rsync?
>> Is there some reason you require this functionality in cp?
>
> Rsync is not in coreutils and is not always installed.

If rsync is not installed, perhaps you can install it.
At worst, you can build it yourself.

> Yes you can use rsync, use pv with pipe, use dd or any other way to copy files.
> But people are used to type 'cp' when they want to copy file.
> And Ctrl+T to show what file is coping now and % left would be nice.

If you really need to know what a cp process is doing,
you can also run strace on it.

Or, if some cp process is taking too long for a particular file,
you can even set up a progress bar after the fact: search for
"phantom progress bar".

Sorry, but even catching a signal and printing status the way dd does
seems unwarranted: there are already so many other ways to get
more/better progress displays.


From MAILER-DAEMON Fri Aug 12 13:00:28 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qrv5w-0001zH-Oy
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 13:00:28 -0400
Received: from eggs.gnu.org ([140.186.70.92]:42337)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bruno@clisp.org>) id 1Qrv5s-0001us-RZ
	for coreutils@gnu.org; Fri, 12 Aug 2011 13:00:26 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <bruno@clisp.org>) id 1Qrv5r-0003oc-MF
	for coreutils@gnu.org; Fri, 12 Aug 2011 13:00:24 -0400
Received: from mo-p00-ob.rzone.de ([81.169.146.161]:12969)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bruno@clisp.org>)
	id 1Qrv5l-0003mg-Au; Fri, 12 Aug 2011 13:00:17 -0400
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1313168415; l=3940;
	s=domk; d=haible.de;
	h=Content-Transfer-Encoding:Content-Type:MIME-Version:In-Reply-To:
	References:Cc:Date:Subject:To:From:X-RZG-CLASS-ID:X-RZG-AUTH;
	bh=n56nCCIjqS8aQ1KOn59veASXBuQ=;
	b=lZ2YLhXLl2O0fqLslBIkH8s0U38qIMYS2qPjquZ0b2bqxF7TQtn6gtt1yN7c4bUbj3/
	QbMkAP/Sd2Pmn5sweq0ayhAv8PKI02ug63E3HEaV5uEort0z14EvDShGtKLSyW4+iIqH1
	L0U01zHg/CONe2ticGlRVI/soSldK0IFsAA=
X-RZG-AUTH: :Ln4Re0+Ic/6oZXR1YgKryK8brksyK8dozXDwHXjf9hj/zDNRav445DE8
X-RZG-CLASS-ID: mo00
Received: from linuix.haible.de
	(dslb-088-068-038-069.pools.arcor-ip.net [88.68.38.69])
	by smtp.strato.de (jimi mo58) (RZmta 26.2)
	with ESMTPA id p06324n7CGZMzT ; Fri, 12 Aug 2011 18:58:46 +0200 (MEST)
From: Bruno Haible <bruno@clisp.org>
To: bug-gnulib@gnu.org, bug-gettext@gnu.org,
	Charles Wilson <cygwin@cwilson.fastmail.fm>
Subject: Re: make -q and maintainer-makefile issues?
Date: Fri, 12 Aug 2011 19:00:25 +0200
User-Agent: KMail/1.13.6 (Linux/2.6.37.6-0.5-desktop; KDE/4.6.0; x86_64; ; )
References: <87pqkdkkz1.fsf@latte.josefsson.org>
	<4E4485D3.4050905@cs.ucla.edu> <4E4486C7.9050705@redhat.com>
In-Reply-To: <4E4486C7.9050705@redhat.com>
MIME-Version: 1.0
Content-Type: Text/Plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
Message-Id: <201108121900.26282.bruno@clisp.org>
X-detected-operating-system: by eggs.gnu.org: Solaris 10 (beta)
X-Received-From: 81.169.146.161
Cc: Simon Josefsson <simon@josefsson.org>, Paul Eggert <eggert@cs.ucla.edu>,
	coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 17:00:26 -0000

[CCing bug-gettext and Charles Wilson]
Eric Blake wrote in [1]:
> At least cygwin still ships with 
> only gettext 0.17, because all versions of 0.18 are unbuildable on the 
> current cygwin.

This is a myth, and is factually wrong.

I just built gettext 0.18.1.1 on a Cygwin 1.7.5 system, with gcc 4.3.4,
and it passed "make check" with only 1 failure in lang-tcl, and
"make install" succeeded as well. Likewise on Cygwin 1.7.9, with
gcc 4.3.4 as well. The build command was:

$ mkdir build3
$ cd build3
$ ../configure --prefix=/usr/local/cygwin \
               CPPFLAGS="-I/usr/local/cygwin/include -Wall" \
               LDFLAGS="-L/usr/local/cygwin/lib" \
               --with-included-libxml 2>&1 | tee log1
$ make 2>&1 | tee log2
$ make check 2>&1 | tee log3
$ make install 2>&1 | tee log4

Reviewing the history of these build reports:

* Eric Blake tried to build it on 2010-06-16 [2], got the error

  undefined reference to `_xmlFree'

  I recommended trying --without-libxml2-prefix [3]. This would have helped
  if libxml2 was installed in a nonstandard location. But it's installed in
  /usr/lib/, so the option that's needed is --with-included-libxml.

  He reports that he "ran into a bug with the cygwin linker claiming that
  libintl.dll.a had an invalid symbol relocation". Well, on Cygwin 1.7.5
  and 1.7.9 I don't run into this bug. So, install Cygwin 1.7.5 or 1.7.9,
  and you can build gettext binaries.

* Markus Moeller reported this error [4]

   collect2: ld terminated with signal 6 [Aborted]
   /usr/lib/gcc/i686-pc-cygwin/4.3.4/../../../../i686-pc-cygwin/bin/ld: /usr/lib/libintl.dll.a(d000050.o): illegal symbol index 1633970 478 in relocs
   make[4]: *** [msgcmp.exe] Error 1

  whereupon Corinna Vinschen put the blame on gettext [5].
  Then Markus Moeller gave it a try with the opposite flag than what
  what gettext uses and found that the same linker error still existed [6].
  So it was *not* a problem with gettext's use of --disable-auto-import.

* After which Eric Blake continued to report that gettext 0.18 does not
  build on Cygwin 1.7. [7]

Half of his diagnosis in [7] was correct:

  * The xmlFree link error is a consequence of --disable-auto-import.
    Witness:

    $ cat > foo.c <<EOF
    #include <libxml/xmlversion.h>
    #include <libxml/xmlmemory.h>
    int main ()
    {
      xmlCheckVersion (0); xmlFree ((void *) 0);
      return 0;
    }
    EOF
    $ gcc -I/usr/include/libxml2 foo.c -lxml2
    [works fine]
    $ gcc -I/usr/include/libxml2 foo.c -lxml2 -Wl,--disable-auto-import
    /tmp/cc4EveXj.o:foo.c:(.text+0x23): undefined reference to `_xmlFree'
    collect2: ld returned 1 exit status

    But gettext's configure provides the right option to fix it. You
    only need to do "./configure --help | grep xml".

    Additionally, the next version of gettext will detect this situation
    automatically.

  * The Cygwin maintainer of gettext didn't put enough time into it.

The other half of the diagnosis was incorrect:

  * No, gettext is not unbuildable on Cygwin.

  * No, the collect2 linker crash has been demonstrated to also occur
    with --enable-auto-import.

I hope, with this mail, I've helped to separate truth from myth.

Please, next time, be more modest and don't say "gettext is unbuildable",
but rather "I have not succeeded in building gettext".

Bruno

[1] http://lists.gnu.org/archive/html/bug-gnulib/2011-08/msg00099.html
[2] http://lists.gnu.org/archive/html/bug-gnu-utils/2010-06/msg00057.html
[3] http://lists.gnu.org/archive/html/bug-gnu-utils/2010-06/msg00061.html
[4] http://cygwin.com/ml/cygwin/2010-08/msg00082.html
[5] http://cygwin.com/ml/cygwin/2010-08/msg00154.html
[6] http://cygwin.com/ml/cygwin/2010-08/msg00157.html
[7] http://www.cygwin.com/ml/cygwin/2011-01/msg00400.html
[8] http://git.savannah.gnu.org/gitweb/?p=gettext.git;a=commitdiff;h=fcf0f235f4dd3e6ceb2149002834223b1c7e9f47
-- 
In memoriam Itzik Feffer <http://en.wikipedia.org/wiki/Itzik_Feffer>


From MAILER-DAEMON Fri Aug 12 13:53:39 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QrvvP-00042n-1X
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 13:53:39 -0400
Received: from eggs.gnu.org ([140.186.70.92]:39660)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QrvvM-00040c-9E
	for coreutils@gnu.org; Fri, 12 Aug 2011 13:53:37 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QrvvL-0004Ww-3v
	for coreutils@gnu.org; Fri, 12 Aug 2011 13:53:36 -0400
Received: from mx1.redhat.com ([209.132.183.28]:53201)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QrvvK-0004Wj-Rt
	for coreutils@gnu.org; Fri, 12 Aug 2011 13:53:35 -0400
Received: from int-mx10.intmail.prod.int.phx2.redhat.com
	(int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7CHrXMX012821
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 12 Aug 2011 13:53:33 -0400
Received: from [10.3.113.151] (ovpn-113-151.phx2.redhat.com [10.3.113.151])
	by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7CHrWb1031869; Fri, 12 Aug 2011 13:53:33 -0400
Message-ID: <4E45689C.3020404@redhat.com>
Date: Fri, 12 Aug 2011 11:53:32 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Darko Veberic <darko.veberic@ung.si>, Coreutils <coreutils@gnu.org>
Subject: Re: 'date' enhancement: flush in format string
References: <4E444F80.60506@ung.si> <4E4455AE.1080404@redhat.com>
	<4E455D31.7090807@ung.si>
In-Reply-To: <4E455D31.7090807@ung.si>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 17:53:37 -0000

Re-adding the list, for closure.

On 08/12/2011 11:04 AM, Darko Veberic wrote:
> dear eric,
>
> thanks for the prompt answer!
>
> On 08/12/2011 12:20 AM, Eric Blake wrote:
>> No. Format symbols are scarce, and %f is already taken.
>
> ok. at some point i guess one-letter ones will run out... what about
> %{flush} ...? ;)

Adding a new % has to be done at the strftime() wrapper level, so it 
won't happen (there is no single character 'flush' that you can output 
from strftime).

>
>> One idea is to change date to always flush after every line. But I don't
>> know if this would hurt performance when the flushing is not needed, and
>
> probably. i am not advocating this. it should not be automatic. user
> should request it either with a format symbol or command-line switch.

If it has to be conditional, then it has to be a separate command line 
option, and not part of the format string.

> nevertheless, your "stdbuf" suggestion below is more of a clean solution...
>
>> you'd have the same problem as with your %f proposal - namely, it would
>> take a while for the code to propagate onto your machine.
>>
>> Another idea is to use something that already exists. date uses stdio,
>> so the stdbuf utility (also part of coreutils) can be used to force date
>> into line-buffered mode. So, try "stdbuf -o L date -u -f- +%s" as your
>> command instead of raw date.
>
> elegant solution, indeed. now awk runs much faster with a co-process.

Glad to hear it!  And best of all, no new coreutils code needed.

>
> spawning date is slow:
>
> time (for ((i=0; i<10000; ++i)) ; do date -u | sed 's/UTC //'; done >foo)
> real 0m28.325s
>
> awk with date spawned for each line:
>
> time (awk '{d="date -u -d \""$0"\" +%s"; d | getline t; close(d); print
> t}' foo >/dev/null)
> real 0m11.316s
>
> awk with co-process "date" (~80x faster on larger sample):
>
> time (awk 'BEGIN{d="stdbuf -o L date -u -f- +%s"}{print $0 |& d; d |&
> getline t; print t}END{close(d)}' foo >/dev/null)
> real 0m0.198s
>
> date's file transform (flush overhead?):

Yes, line buffering is more expensive than fully buffered; it's the 
price you pay to avoid deadlock.

>
> time (stdbuf -o L date -u -f foo +%s >/dev/null)
> real 0m0.062s
>
> time (date -u -f foo +%s >/dev/null)
> real 0m0.055s

Still a nice speedup compared to multiple processes.

>> Also, how uniform is the date input already present in the input file?
>
> it is basically the output string of "date -u | sed 's/UTC //'"...
>
>> If it is sufficiently uniform, can you just use awk's own date parsing
>> utilities? It comes with a few builtins that may be able to already
>> handle your needs without spawning external processes.
>
> can it convert say "Fri Aug 12 16:24:30 2011" to unix second?

Yes, it should be possible, with gawk (but since %s is not POSIX, good 
luck with any other vendor's awk).  Parse the date into fields, set up 
an array to convert 3-letter months into two digits, then pass the 
rearranged fields in to strftime("%s", mktime(YYYY MM DD HH MM SS)).

It might take a multi-line function to do all that work, but shouldn't 
be too far-fetched to get working:

$ awk 'END { print strftime("%s", mktime("2011 08 12 11 50 00")) }' \
     /dev/null
1313171400

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Fri Aug 12 14:44:38 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qrwik-0006bI-0s
	for mharc-coreutils@gnu.org; Fri, 12 Aug 2011 14:44:38 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33277)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1Qrwii-0006bC-Gg
	for coreutils@gnu.org; Fri, 12 Aug 2011 14:44:37 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1Qrwih-0000NN-NF
	for coreutils@gnu.org; Fri, 12 Aug 2011 14:44:36 -0400
Received: from smtp.gentoo.org ([140.211.166.183]:58727)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1Qrwih-0000NB-Ii
	for coreutils@gnu.org; Fri, 12 Aug 2011 14:44:35 -0400
Received: from vapier.localnet (localhost [127.0.0.1])
	by smtp.gentoo.org (Postfix) with ESMTP id 828111B4008;
	Fri, 12 Aug 2011 18:44:33 +0000 (UTC)
From: Mike Frysinger <vapier@gentoo.org>
Organization: wh0rd.org
To: coreutils@gnu.org
Subject: Re: progress bar in cp
Date: Fri, 12 Aug 2011 14:44:32 -0400
User-Agent: KMail/1.13.7 (Linux/2.6.39; KDE/4.6.3; x86_64; ; )
References: <4E2C583D.1090607@gmail.com> <87d3ge7de3.fsf@rho.meyering.net>
	<D998626D-5D12-4893-92C5-9ADA151A3170@gmail.com>
In-Reply-To: <D998626D-5D12-4893-92C5-9ADA151A3170@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="nextPart3282528.CaZ9nFCrE4";
	protocol="application/pgp-signature"; micalg=pgp-sha1
Content-Transfer-Encoding: 7bit
Message-Id: <201108121444.32992.vapier@gentoo.org>
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 140.211.166.183
Cc: =?utf-8?b?0JTQvNC40YLRgNC40Lkg0JjQu9GM0LjQvQ==?= <idv1985@gmail.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Aug 2011 18:44:37 -0000

--nextPart3282528.CaZ9nFCrE4
Content-Type: Text/Plain;
  charset="windows-1251"
Content-Transfer-Encoding: quoted-printable

On Tuesday, August 09, 2011 16:59:33 =C4=EC=E8=F2=F0=E8=E9 =C8=EB=FC=E8=ED =
wrote:
> > Have you considered using rsync?
> > Is there some reason you require this functionality in cp?
>=20
> Rsync is not in coreutils and is not always installed.

but neither is a patched coreutils cp ;)
=2Dmike

--nextPart3282528.CaZ9nFCrE4
Content-Type: application/pgp-signature; name=signature.asc 
Content-Description: This is a digitally signed message part.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)

iQIcBAABAgAGBQJORXSQAAoJEEFjO5/oN/WBTuYP/0/JudwHUoSdKU/STrwBH1Xd
2NeWPHO9X+dJCJrZMe8bT5/6s3yhadcDcjfb2dFx/1jhB2RFYim6wUoptC8UzbKQ
twJFnbfPt3WWVMscKmbhrIl9EgLVHoXDKNTKGV6grghNnbh3AUI7pRzi1m46QuR3
QnTMC2w6I18L1CeaUtqbtUYXyrE+/K9lDwA6v4Uxoz9Z7+ifMMcfACb/rcFcjEkg
/IoQLuOb721XMb5ukU66WdDJ4mdgKEtzVkCgncsNUZEQMiUsVY2L0uViT/KPbuDz
nGfYGF/CCgCVpS3/+S/0YVPKmlq/rDRd1qYQGZKgoNoL5XNxAnd5ESrNcxpCO+yH
VRH//0CKA//p9fslV+E6FStfhQIVNLad9pT1c/EAT8THAA9HP4CrN05LLoHeEOTu
eVuevXjZfVFF/Dj847hozmWpJifQcu+4CI7r7qQgQfAP1kEhlgYbwRkYZ/rPuszJ
F4RNHrcMAuRjegRPbPb+bMaAk3ySDPFUT2gdXlxcm3N1J5Rln3k/eRFboN28LC6u
qaOXybS7gnsjSiqD4DD7TTULIcX36pd+tyL5Whza7mazR9QePdgSVH4hthqU284j
tilFj/IyPyi0NCVkRr6xyBmDwy44nq6dOQqN3Pi0S0FXLoWnDYEL2tl3x5uxIxzv
msdex5YdyzyPxcPrZrBq
=zKga
-----END PGP SIGNATURE-----

--nextPart3282528.CaZ9nFCrE4--


From MAILER-DAEMON Sat Aug 13 05:36:01 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QsAdN-0006wc-A8
	for mharc-coreutils@gnu.org; Sat, 13 Aug 2011 05:36:01 -0400
Received: from eggs.gnu.org ([140.186.70.92]:43896)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QsAdK-0006vT-9D
	for coreutils@gnu.org; Sat, 13 Aug 2011 05:35:59 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QsAdI-00007x-Os
	for coreutils@gnu.org; Sat, 13 Aug 2011 05:35:58 -0400
Received: from mx.meyering.net ([82.230.74.64]:33149)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QsAdI-00007s-Ey
	for coreutils@gnu.org; Sat, 13 Aug 2011 05:35:56 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 6D145601AF;
	Sat, 13 Aug 2011 11:35:55 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Bernhard Voelker <mail@bernhard-voelker.de>
Subject: Re: [PATCH] maint: remove empty statement after jump label
In-Reply-To: <4E2DAF05.4030901@bernhard-voelker.de> (Bernhard Voelker's
	message of "Mon, 25 Jul 2011 19:59:33 +0200")
References: <4E2DAF05.4030901@bernhard-voelker.de>
Date: Sat, 13 Aug 2011 11:35:55 +0200
Message-ID: <87liuxvekk.fsf@rho.meyering.net>
Lines: 118
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
Cc: Coreutils <coreutils@gnu.org>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sat, 13 Aug 2011 09:35:59 -0000

Bernhard Voelker wrote:
> As discussed in
> https://lists.gnu.org/archive/html/bug-coreutils/2011-07/msg00195.html
> empty statements must follow a jump label if the next statement
> is a declaration. Therefore, the other way round: the empty statement
> can be omitted when no declaration follows.
>
> Have a nice day,
> Berny
>
>
> From b7e72c789eac010bcd1666dbb25f7ec4e5332137 Mon Sep 17 00:00:00 2001
> From: Bernhard Voelker <mail@bernhard-voelker.de>
> Date: Mon, 25 Jul 2011 18:39:28 +0200
> Subject: [PATCH] maint: remove empty statement after jump label
>
> * src/head.c: removed the empty statement ";" after a jump label,
>   as it is only needed when a declaration follows.
> * src/kill.c, src/od.c, src/paste.c, src/printf.c: Likewise.

I've applied that.
Note that your patch was broken (3 @@... lines were split
by your mail client) and I've adjusted the log to include
function names.

We could also have decided to add the trailing ";"
everywhere, in the interest of having something
consistent and syntactically-easy to check.
However, not only would adding all of those ";"s have
been invasive, but I prefer the minimal policy of using
the added ";" only when required.

>From 036a9c69099f372ca581ce8b5c22e88656a2b478 Mon Sep 17 00:00:00 2001
From: Bernhard Voelker <mail@bernhard-voelker.de>
Date: Mon, 25 Jul 2011 18:39:28 +0200
Subject: [PATCH] maint: remove empty statement after jump label

* src/head.c (elide_tail_bytes_pipe): Remove the empty statement, ";"
after a jump label; it is needed only when a declaration follows.
* src/kill.c (main): Likewise.
* src/od.c (main): Likewise.
* src/paste.c (collapse_escapes): Likewise.
* src/printf.c (print_formatted): Likewise.
---
 src/head.c   |    2 +-
 src/kill.c   |    2 +-
 src/od.c     |    2 +-
 src/paste.c  |    2 +-
 src/printf.c |    2 +-
 5 files changed, 5 insertions(+), 5 deletions(-)

diff --git a/src/head.c b/src/head.c
index 1c6e6bc..1742912 100644
--- a/src/head.c
+++ b/src/head.c
@@ -389,7 +389,7 @@ elide_tail_bytes_pipe (const char *filename, int fd, uintmax_t n_elide_0)
             }
         }

-    free_mem:;
+    free_mem:
       for (i = 0; i < n_bufs; i++)
         free (b[i]);
       free (b);
diff --git a/src/kill.c b/src/kill.c
index b94e68c..9f95114 100644
--- a/src/kill.c
+++ b/src/kill.c
@@ -292,7 +292,7 @@ main (int argc, char **argv)
       default:
         usage (EXIT_FAILURE);
       }
- no_more_options:;
+ no_more_options:

   if (signum < 0)
     signum = SIGTERM;
diff --git a/src/od.c b/src/od.c
index 9ddd519..2f3593e 100644
--- a/src/od.c
+++ b/src/od.c
@@ -1905,7 +1905,7 @@ it must be one character from [doxn]"),

   ok &= (flag_dump_strings ? dump_strings () : dump ());

-cleanup:;
+cleanup:

   if (have_read_stdin && fclose (stdin) == EOF)
     error (EXIT_FAILURE, errno, _("standard input"));
diff --git a/src/paste.c b/src/paste.c
index 217357f..17aacd4 100644
--- a/src/paste.c
+++ b/src/paste.c
@@ -145,7 +145,7 @@ collapse_escapes (char const *strptr)
         }
     }

- done:;
+ done:

   delim_end = strout;
   return backslash_at_end ? 1 : 0;
diff --git a/src/printf.c b/src/printf.c
index 24070b8..ddb6c46 100644
--- a/src/printf.c
+++ b/src/printf.c
@@ -533,7 +533,7 @@ print_formatted (const char *format, int argc, char **argv)
               default:
                 goto no_more_flag_characters;
               }
-        no_more_flag_characters:;
+        no_more_flag_characters:

           if (*f == '*')
             {
--
1.7.6.433.g1421f


From MAILER-DAEMON Tue Aug 16 04:56:51 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QtFS7-0004B9-S7
	for mharc-coreutils@gnu.org; Tue, 16 Aug 2011 04:56:51 -0400
Received: from eggs.gnu.org ([140.186.70.92]:39061)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mtcruzcodina@hotmail.com>) id 1Qt7fm-0005Ns-HG
	for coreutils@gnu.org; Mon, 15 Aug 2011 20:38:27 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mtcruzcodina@hotmail.com>) id 1Qt7fl-000723-Fx
	for coreutils@gnu.org; Mon, 15 Aug 2011 20:38:26 -0400
Received: from snt0-omc2-s17.snt0.hotmail.com ([65.55.90.92]:2480)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mtcruzcodina@hotmail.com>) id 1Qt7fl-00071z-83
	for coreutils@gnu.org; Mon, 15 Aug 2011 20:38:25 -0400
Received: from SNT130-W8 ([65.55.90.71]) by snt0-omc2-s17.snt0.hotmail.com
	with Microsoft SMTPSVC(6.0.3790.4675); 
	Mon, 15 Aug 2011 17:18:23 -0700
Message-ID: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
Content-Type: multipart/alternative;
	boundary="_308ff955-15d5-4c95-8301-a744b6b63343_"
X-Originating-IP: [190.53.74.236]
From: Marco Tulio Cruz Codina <mtcruzcodina@hotmail.com>
To: <coreutils@gnu.org>
Subject: i made a huge mistake please help me!! i erased core utilities
Date: Mon, 15 Aug 2011 17:18:22 -0700
Importance: Normal
MIME-Version: 1.0
X-OriginalArrivalTime: 16 Aug 2011 00:18:23.0064 (UTC)
	FILETIME=[02743580:01CC5BAA]
X-detected-operating-system: by eggs.gnu.org: Windows 2000 SP4, XP SP1+
X-Received-From: 65.55.90.92
X-Mailman-Approved-At: Tue, 16 Aug 2011 04:56:49 -0400
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Aug 2011 00:38:27 -0000

--_308ff955-15d5-4c95-8301-a744b6b63343_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable





hi=2C sorry to bother you but i need your help=2C i made a huge mistake=2C =
i acidentally deleted the core utilities (/bin) program from my 32gb ipad 2=
=2C using cydia. immediately after that cydia closed and it wouldn't open a=
gain=2C so i turned off my ipad and then i tried to turn it on again and it=
 won't turn on=2C it just starts showing the little apple that shows when n=
ormally turning it on=2C and then it shuts down and starts again repeating =
that process=2C is there anything i can do?=2C please answer me as soon as =
you are able=2C i will be be completely grateful with you!! 		 	   		  =

--_308ff955-15d5-4c95-8301-a744b6b63343_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 10pt=3B
font-family:Tahoma
}
--></style>
</head>
<body class=3D'hmmessage'><div dir=3D'ltr'>



hi=2C sorry to bother you but i need your help=2C i made a huge mistake=2C =
i acidentally deleted the core utilities (/bin) program from my 32gb ipad 2=
=2C using cydia. immediately after that cydia closed and it wouldn't open a=
gain=2C so i turned off my ipad and then i tried to turn it on again and it=
 won't turn on=2C it just starts showing the little apple that shows when n=
ormally turning it on=2C and then it shuts down and starts again repeating =
that process=2C is there anything i can do?=2C please answer me as soon as =
you are able=2C i will be be completely grateful with you!! 		 	   		  </di=
v></body>
</html>=

--_308ff955-15d5-4c95-8301-a744b6b63343_--


From MAILER-DAEMON Tue Aug 16 09:20:06 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QtJYs-0008BV-IH
	for mharc-coreutils@gnu.org; Tue, 16 Aug 2011 09:20:06 -0400
Received: from eggs.gnu.org ([140.186.70.92]:56119)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QtIFt-0003We-2o
	for coreutils@gnu.org; Tue, 16 Aug 2011 07:56:26 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QtIFs-0007zh-Cs
	for coreutils@gnu.org; Tue, 16 Aug 2011 07:56:24 -0400
Received: from m4.master-telecom.ru ([85.193.64.14]:23097)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QtIFr-0007zQ-V2
	for coreutils@gnu.org; Tue, 16 Aug 2011 07:56:24 -0400
Received: from m4.master-telecom.ru (localhost [127.0.0.1])
	by m4.master-telecom.ru (8.14.4/8.14.4) with ESMTP id p7GBOILY041080;
	Tue, 16 Aug 2011 15:24:18 +0400 (MSD)
	(envelope-from mitya@m4.master-telecom.ru)
Received: (from mitya@localhost)
	by m4.master-telecom.ru (8.14.4/8.14.4/Submit) id p7GBOIf2041079;
	Tue, 16 Aug 2011 15:24:18 +0400 (MSD) (envelope-from mitya)
Date: Tue, 16 Aug 2011 15:24:18 +0400
From: Dmitry Sivachenko <mitya@cavia.pp.ru>
To: coreutils@gnu.org
Subject: sort --parallel problem?
Message-ID: <20110816112418.GA39255@m4.master-telecom.ru>
MIME-Version: 1.0
Content-Type: text/plain; charset=koi8-r
Content-Disposition: inline
WWW-Home-Page: http://mitya.pp.ru/
X-PGP-Key: http://mitya.pp.ru/mitya.asc
User-Agent: Mutt/1.5.21 (2010-09-15)
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 85.193.64.14
X-Mailman-Approved-At: Tue, 16 Aug 2011 09:20:05 -0400
Cc: jharris@widomaker.com
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Aug 2011 11:56:26 -0000

Hello!

I am using coreutils-8.12 on FreeBSD-7.2 (compiled from FreeBSD ports).

When I use --parallel option, I frequently (not always, but often) get
the following error:

Fatal error 'mutex is on list' at line XXX in file
/usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)

and sort aborts.

Is it a known issue? Is it FreeBSD-specific?

Thanks in advance!


From MAILER-DAEMON Tue Aug 16 13:31:15 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QtNTv-0005x2-5u
	for mharc-coreutils@gnu.org; Tue, 16 Aug 2011 13:31:15 -0400
Received: from eggs.gnu.org ([140.186.70.92]:58344)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QtNTt-0005vp-5T
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:31:13 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QtNTr-0005U5-Av
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:31:13 -0400
Received: from smtp.gentoo.org ([140.211.166.183]:56673)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <vapier@gentoo.org>) id 1QtNTq-0005TT-Tr
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:31:11 -0400
Received: from vapier.localnet (localhost [127.0.0.1])
	by smtp.gentoo.org (Postfix) with ESMTP id B4753641C1;
	Tue, 16 Aug 2011 17:31:08 +0000 (UTC)
From: Mike Frysinger <vapier@gentoo.org>
Organization: wh0rd.org
To: coreutils@gnu.org
Subject: Re: i made a huge mistake please help me!! i erased core utilities
Date: Tue, 16 Aug 2011 13:31:07 -0400
User-Agent: KMail/1.13.7 (Linux/2.6.39; KDE/4.6.3; x86_64; ; )
References: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
In-Reply-To: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="nextPart2260807.T5lzqBPZRL";
	protocol="application/pgp-signature"; micalg=pgp-sha1
Content-Transfer-Encoding: 7bit
Message-Id: <201108161331.08017.vapier@gentoo.org>
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 140.211.166.183
Cc: Marco Tulio Cruz Codina <mtcruzcodina@hotmail.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Aug 2011 17:31:13 -0000

--nextPart2260807.T5lzqBPZRL
Content-Type: Text/Plain;
  charset="utf-8"
Content-Transfer-Encoding: 7bit

On Monday, August 15, 2011 20:18:22 Marco Tulio Cruz Codina wrote:
> acidentally deleted the core utilities (/bin) program from my 32gb ipad 2,

sorry, but this is not the list you seek.  please try an apple support forum.
-mike

--nextPart2260807.T5lzqBPZRL
Content-Type: application/pgp-signature; name=signature.asc 
Content-Description: This is a digitally signed message part.

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)

iQIcBAABAgAGBQJOSqlbAAoJEEFjO5/oN/WBwOkP/37zualrydroJaogxnuQASKS
/jyo9JUGS6+2sAzGG3kE4sHXAd6lM5H+ATiR3uII3mZOMfcDJ1QTLqZ8uueudcrF
XwHN0B6oQ3giWGuJ05jvUgrXMUaq9LkX7Bceaqijd4HqlxT61H66sg5ERPwjIbHD
U2KjR/Js9teVh0I2HGiEpHASW0H+lcGu4/5s/fLZvvUXswSxWPsTTtfOwaPZQkHk
19EKW1SUFzN8DBR51/x2N4ddvd9YctQq6OEGKyGRmCKMcbcE99AGT7lmIscIVKzj
wu1JIcOsFoJ88bXbGXmMS08PF2piEO07K/LoExPoRjmktW3jY39+ZnifeTVnf4JK
HLL/lMfl+Z1XhZvGb/fA18HLU+/Nvehs6V0Bm9i1RHK3rD0IsGF4iZUHZSlQVbHN
D5mWSwQONmUl+uB1gZW3y1P6tWFDB4BU2/jw4ez8AxDD1ROdJ1od34FBeUuf4/tA
FjWnnToBniElcGe+1/rJHhajVhoaP0Qlsl6OnKzte/bkEVErMvGxbYfj24sZyyrf
VhQcjDo9d5P/jhLh3c78UZWkDHSF76LmQu/pTUR4BtlKLzUnfhzKjwdiRtsWLapt
eEQ7VEtw0YT7+3ZXojlfXAk1RoClz6eKEufNZGY2ekk+eEA0GfR4SdpOKuSc6KWq
Ea26ulFGMLGkbMZdRmu7
=FqRp
-----END PGP SIGNATURE-----

--nextPart2260807.T5lzqBPZRL--


From MAILER-DAEMON Tue Aug 16 13:43:55 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QtNgB-00020K-6p
	for mharc-coreutils@gnu.org; Tue, 16 Aug 2011 13:43:55 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47170)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QtNg9-0001zO-B6
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:43:54 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QtNg8-00013u-Gg
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:43:53 -0400
Received: from mx.meyering.net ([82.230.74.64]:40954)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QtNg8-00013h-86
	for coreutils@gnu.org; Tue, 16 Aug 2011 13:43:52 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id A5B7060103;
	Tue, 16 Aug 2011 19:43:50 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Dmitry Sivachenko <mitya@cavia.pp.ru>
Subject: Re: sort --parallel problem?
In-Reply-To: <20110816112418.GA39255@m4.master-telecom.ru> (Dmitry
	Sivachenko's message of "Tue, 16 Aug 2011 15:24:18 +0400")
References: <20110816112418.GA39255@m4.master-telecom.ru>
Date: Tue, 16 Aug 2011 19:43:50 +0200
Message-ID: <87liutb6ax.fsf@rho.meyering.net>
Lines: 18
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
Cc: jharris@widomaker.com, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 16 Aug 2011 17:43:54 -0000

Dmitry Sivachenko wrote:
> I am using coreutils-8.12 on FreeBSD-7.2 (compiled from FreeBSD ports).
>
> When I use --parallel option, I frequently (not always, but often) get
> the following error:
>
> Fatal error 'mutex is on list' at line XXX in file
> /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
>
> and sort aborts.
>
> Is it a known issue?

This is the first I've heard of that problem.

> Is it FreeBSD-specific?

Could be.


From MAILER-DAEMON Wed Aug 17 04:03:49 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qtb6L-0004WZ-52
	for mharc-coreutils@gnu.org; Wed, 17 Aug 2011 04:03:49 -0400
Received: from eggs.gnu.org ([140.186.70.92]:39815)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <devel@romanr.name>) id 1Qtb6I-0004Uh-4E
	for coreutils@gnu.org; Wed, 17 Aug 2011 04:03:47 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <devel@romanr.name>) id 1Qtb6H-0004gx-4f
	for coreutils@gnu.org; Wed, 17 Aug 2011 04:03:46 -0400
Received: from host.romanr.info ([82.146.61.98]:42552)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <devel@romanr.name>) id 1Qtb6G-0004gh-ML
	for coreutils@gnu.org; Wed, 17 Aug 2011 04:03:45 -0400
Received: from roma.avp.ru (withheld) by host.romanr.info (Postfix) with
	ESMTPSA id 4E049655C139
	for <coreutils@gnu.org>; Wed, 17 Aug 2011 12:03:38 +0400 (MSD)
Message-ID: <4E4B75EA.9090502@romanr.name>
Date: Wed, 17 Aug 2011 12:03:54 +0400
From: Roman Rybalko <devel@romanr.name>
User-Agent: Thunderbird 2.0.0.24 (X11/20100331)
MIME-Version: 1.0
To: coreutils@gnu.org
Subject: Re: sort --parallel problem?
References: <20110816112418.GA39255@m4.master-telecom.ru>
	<87liutb6ax.fsf@rho.meyering.net>
In-Reply-To: <87liutb6ax.fsf@rho.meyering.net>
Content-Type: multipart/alternative;
	boundary="------------060706090408010108020403"
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 82.146.61.98
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 08:03:47 -0000

This is a multi-part message in MIME format.
--------------060706090408010108020403
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Jim Meyering wrote:
> Dmitry Sivachenko wrote:
>   
>> I am using coreutils-8.12 on FreeBSD-7.2 (compiled from FreeBSD ports).
>> When I use --parallel option, I frequently (not always, but often) get
>> the following error:
>> Fatal error 'mutex is on list' at line XXX in file
>> /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
>> and sort aborts.
>> Is it a known issue?
>>     
> This is the first I've heard of that problem
>> Is it FreeBSD-specific?
>>     
> Could be.
>   
Sometimes happens for me, but with different tools, my own particularly.
Seems FreeBSD's pthread_mutex_init does not clear the memory, and then 
may be possible situation when random mutex data interfere with internal 
lists.
memset(&mutex, 0, sizeof(mutex)) before pthread_mutex_init fixes the 
problem for me.
Using FreeBSD-8.x

-- 
WBR,
Roman Rybalko


--------------060706090408010108020403
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
  <meta content="text/html;charset=ISO-8859-1" http-equiv="Content-Type">
  <title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
Jim Meyering wrote:
<blockquote cite="mid:87liutb6ax.fsf@rho.meyering.net" type="cite">
  <pre wrap="">Dmitry Sivachenko wrote:
  </pre>
  <blockquote type="cite">
    <pre wrap="">I am using coreutils-8.12 on FreeBSD-7.2 (compiled from FreeBSD ports).
When I use --parallel option, I frequently (not always, but often) get
the following error:
Fatal error 'mutex is on list' at line XXX in file
/usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
and sort aborts.
Is it a known issue?
    </pre>
  </blockquote>
  <pre wrap="">This is the first I've heard of that problem</pre>
  <blockquote type="cite">
    <pre wrap="">Is it FreeBSD-specific?
    </pre>
  </blockquote>
  <pre wrap=""><!---->Could be.
  </pre>
</blockquote>
Sometimes happens for me, but with different tools, my own particularly.<br>
Seems FreeBSD's pthread_mutex_init does not clear the memory, and then
may be possible situation when random mutex data interfere with
internal lists.<br>
memset(&amp;mutex, 0, sizeof(mutex)) before pthread_mutex_init fixes
the problem for me.<br>
Using FreeBSD-8.x<br>
<pre class="moz-signature" cols="72">-- 
WBR,
Roman Rybalko
</pre>
</body>
</html>

--------------060706090408010108020403--


From MAILER-DAEMON Wed Aug 17 04:11:14 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QtbDW-00057t-R1
	for mharc-coreutils@gnu.org; Wed, 17 Aug 2011 04:11:14 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33397)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QtbDU-00056X-G7
	for coreutils@gnu.org; Wed, 17 Aug 2011 04:11:13 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QtbDQ-0005yc-F1
	for coreutils@gnu.org; Wed, 17 Aug 2011 04:11:12 -0400
Received: from mx.meyering.net ([82.230.74.64]:58211)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>)
	id 1QtbDL-0005y1-Fh; Wed, 17 Aug 2011 04:11:03 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 82170601B4;
	Wed, 17 Aug 2011 10:11:02 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Roman Rybalko <devel@romanr.name>
Subject: Re: sort --parallel problem?
In-Reply-To: <4E4B75EA.9090502@romanr.name> (Roman Rybalko's message of "Wed, 
	17 Aug 2011 12:03:54 +0400")
References: <20110816112418.GA39255@m4.master-telecom.ru>
	<87liutb6ax.fsf@rho.meyering.net> <4E4B75EA.9090502@romanr.name>
Date: Wed, 17 Aug 2011 10:11:02 +0200
Message-ID: <87zkj8a25l.fsf@rho.meyering.net>
Lines: 32
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 82.230.74.64
Cc: bug-gnulib@gnu.org, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 08:11:13 -0000

Roman Rybalko wrote:

> Jim Meyering wrote:
>
>     Dmitry Sivachenko wrote:
>
>         I am using coreutils-8.12 on FreeBSD-7.2 (compiled from FreeBSD ports).
>         When I use --parallel option, I frequently (not always, but often) get
>         the following error:
>         Fatal error 'mutex is on list' at line XXX in file
>         /usr/src/lib/libthr/thread/thr_mutex.c (errno = 0)
>         and sort aborts.
>         Is it a known issue?
>
>     This is the first I've heard of that problem
>
>         Is it FreeBSD-specific?
>
>     Could be.
>
> Sometimes happens for me, but with different tools, my own particularly.
> Seems FreeBSD's pthread_mutex_init does not clear the memory, and then may be
> possible situation when random mutex data interfere with internal lists.
> memset(&mutex, 0, sizeof(mutex)) before pthread_mutex_init fixes the problem for
> me.
> Using FreeBSD-8.x

Thanks for the suggestion.
Do you know of a way to test for this bug?
With that, we should be able to write a gnulib
module that would transparently replace
pthread_mutex_init with a version that works around the flaw.


From MAILER-DAEMON Wed Aug 17 08:54:45 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qtfdt-0004kR-Ek
	for mharc-coreutils@gnu.org; Wed, 17 Aug 2011 08:54:45 -0400
Received: from eggs.gnu.org ([140.186.70.92]:42888)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfdq-0004kF-VL
	for coreutils@gnu.org; Wed, 17 Aug 2011 08:54:44 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfdp-00060m-5v
	for coreutils@gnu.org; Wed, 17 Aug 2011 08:54:42 -0400
Received: from mail-bw0-f41.google.com ([209.85.214.41]:62971)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfdp-00060K-0G
	for coreutils@gnu.org; Wed, 17 Aug 2011 08:54:41 -0400
Received: by bkbzt4 with SMTP id zt4so807172bkb.0
	for <coreutils@gnu.org>; Wed, 17 Aug 2011 05:54:39 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=message-id:date:from:user-agent:mime-version:to:cc:subject
	:references:in-reply-to:content-type:content-transfer-encoding;
	bh=qgcNN6M+30Z4yYdwqDjC/g09Xny0N4CPZ9XuUiT0rCs=;
	b=Y4ScuoCKMgpWps+SYoOYMC37+nOwa4kdriQxW27uf74w6vDRjqBv/PnGoYzeW0obuk
	1ndzgN6yzPLmHViYiQlgzUUPziH+D+tNoeqQfeV7NASVwVQoOyj80ql9nwH9gOQtxAdi
	lXvuUSNfF6p6EgmUqMerRRoUVj2O8JC9DrSu8=
Received: by 10.205.65.5 with SMTP id xk5mr399574bkb.111.1313585679388;
	Wed, 17 Aug 2011 05:54:39 -0700 (PDT)
Received: from [81.19.90.34] ([81.19.90.34])
	by mx.google.com with ESMTPS id p15sm387619bkq.37.2011.08.17.05.54.35
	(version=SSLv3 cipher=OTHER); Wed, 17 Aug 2011 05:54:37 -0700 (PDT)
Message-ID: <4E4BBA09.1030707@gmail.com>
Date: Wed, 17 Aug 2011 16:54:33 +0400
From: Dmitry Ilyin <idv1985@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; ru-RU;
	rv:1.9.2.12) Gecko/20101027 Thunderbird/3.1.6
MIME-Version: 1.0
To: Marco Tulio Cruz Codina <mtcruzcodina@hotmail.com>
Subject: Re: i made a huge mistake please help me!! i erased core utilities
References: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
In-Reply-To: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.214.41
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 12:54:44 -0000

16.08.2011 04:18, Marco Tulio Cruz Codina Ð¿Ð¸ÑˆÐµÑ‚:
> hi, sorry to bother you but i need your help, i made a huge mistake, i 
> acidentally deleted the core utilities (/bin) program from my 32gb ipad 2, 
> using cydia. immediately after that cydia closed and it wouldn't open again, 
> so i turned off my ipad and then i tried to turn it on again and it won't turn 
> on, it just starts showing the little apple that shows when normally turning 
> it on, and then it shuts down and starts again repeating that process, is 
> there anything i can do?, please answer me as soon as you are able, i will be 
> be completely grateful with you!!

1. Ipad coreutils are from macos or freebsd and not from GNU afaik.
2. DO NOT install cydia and other random crap on iPad. Use ONLY stuff from AppStore.
3. Get Android if you want to tinker with your device. Mac devices are for 
normal users.

This may help you


  How to fix a 'frozen' iPad

Mat Toor


    This guide shows you how to fix a frozen and unresponsive iPad by using the
    restart, reset and restore options to force it back into life

Published on Apr 7, 2010

Occasionally your Apple iPad may freeze or hang during an operation - some would 
call this a crash - and won't respond to the Home button, Sleep/wake button or 
the touchscreen.

If this happens there are two solutions you should try first:

    * *Restart the iPad*: press and hold down the sleep/wake on the front of the
      iPad for few seconds until the red slider appears, slide this across to
      shut the iPad down. Restart the iPad by pressing the Sleep/wake button on
      the top until the Apple logo appears
    * *Reset the iPad*: if restarting the iPad didn't work then you will need to
      reset the iPad. You can do this by pressing the Home button and the
      Sleep/wake button on the top the iPad's case and holding them down
      together for 10 seconds. The iPad should then reset itself


      Restore the iPad

If neither of these two options fixes your unresponsive iPad then you will need 
to restore the iPad to its factory settings.

   1. First make sure you have a USB 2.0 connection cable and the latest version
      ofiTunes <http://www.apple.com/itunes/download>installed
   2. Connect the iPad to your Mac or PC and launch iTunes
   3. In the*Devices*section click on the*iPad*icon then the*Summary*tab and
      then click on the*Restore*button
   4. When prompted, click on*Back Up*to back up all your iPad's media and settings
   5. Then click on the*Restore*button
   6. This will restore your iPad to its factory settings and install the latest
      version of the iPad operating software. Once this is completed, the iPad
      will restart
   7. You can now restore all your iPad's media and settings from the most
      recent back up then click*Continue*. Your iPad should now be up and
      running again...





From MAILER-DAEMON Wed Aug 17 09:08:18 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qtfr0-0000r0-DV
	for mharc-coreutils@gnu.org; Wed, 17 Aug 2011 09:08:18 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33912)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfqv-0000qt-C4
	for coreutils@gnu.org; Wed, 17 Aug 2011 09:08:17 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfqu-0000JC-Gf
	for coreutils@gnu.org; Wed, 17 Aug 2011 09:08:13 -0400
Received: from mail-bw0-f41.google.com ([209.85.214.41]:58955)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <idv1985@gmail.com>) id 1Qtfqu-0000Ir-Bm
	for coreutils@gnu.org; Wed, 17 Aug 2011 09:08:12 -0400
Received: by bkbzt4 with SMTP id zt4so818863bkb.0
	for <coreutils@gnu.org>; Wed, 17 Aug 2011 06:08:11 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=message-id:date:from:user-agent:mime-version:to:cc:subject
	:references:in-reply-to:content-type:content-transfer-encoding;
	bh=HD4cT+hz9LPlGUBsPyxXfVG1s5WZsUi0gJxGEfoldig=;
	b=fx1m8Mt0f9lqCYBxgTglJV5BNfoTrCHptw4/JqNDoOdLNpSeu91F/VuXf6qzb1AQOy
	8C7Hi2tHbwQYYR7vBWCl1teZ0OeTreaYwgB4oTcjcJ7XWoVGUdpimicCFq8HGeMCbiyJ
	igsWpwoNQLVaIr5kaLnVKA09PzpGReqFcNpiw=
Received: by 10.204.164.1 with SMTP id c1mr456382bky.121.1313586490620;
	Wed, 17 Aug 2011 06:08:10 -0700 (PDT)
Received: from [81.19.90.34] ([81.19.90.34])
	by mx.google.com with ESMTPS id z7sm391794bkt.39.2011.08.17.06.08.08
	(version=SSLv3 cipher=OTHER); Wed, 17 Aug 2011 06:08:09 -0700 (PDT)
Message-ID: <4E4BBD37.6050706@gmail.com>
Date: Wed, 17 Aug 2011 17:08:07 +0400
From: Dmitry Ilyin <idv1985@gmail.com>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; ru-RU;
	rv:1.9.2.12) Gecko/20101027 Thunderbird/3.1.6
MIME-Version: 1.0
To: Mike Frysinger <vapier@gentoo.org>
Subject: Re: i made a huge mistake please help me!! i erased core utilities
References: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
	<201108161331.08017.vapier@gentoo.org>
In-Reply-To: <201108161331.08017.vapier@gentoo.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.214.41
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Aug 2011 13:08:17 -0000


> sorry, but this is not the list you seek.  please try an apple support forum.
> -mike

You guys impress me so much. I can't even imagine epic humiliation, scolding and 
abuse this guy would get on russian linux forum. Our open-source community is 
VERY hostile to outsiders, well... insiders too and create very bad image for 
entire open source ideas.

You guy are MUCH better.


From MAILER-DAEMON Thu Aug 18 08:55:37 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu28H-0000OH-Gd
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 08:55:37 -0400
Received: from eggs.gnu.org ([140.186.70.92]:41114)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <nathan.watson-haigh@awri.com.au>) id 1QtqhY-0006nN-Ht
	for coreutils@gnu.org; Wed, 17 Aug 2011 20:43:18 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <nathan.watson-haigh@awri.com.au>) id 1QtqhW-0003HB-98
	for coreutils@gnu.org; Wed, 17 Aug 2011 20:43:16 -0400
Received: from firewall-2.awri.adelaide.edu.au ([129.127.182.188]:35000
	helo=mail.awri.com.au) by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <nathan.watson-haigh@awri.com.au>) id 1QtqhV-0003Gs-EB
	for coreutils@gnu.org; Wed, 17 Aug 2011 20:43:14 -0400
Content-Type: multipart/related;
	boundary="----=_NextPart_000_6859_01CC5D8F.6E46EC30"
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.3790.4862
Importance: normal
Priority: normal
Content-Class: urn:content-classes:message
MIME-Version: 1.0
Subject: sort --parallel
Date: Thu, 18 Aug 2011 10:13:09 +0930
Message-ID: <33310ACF3DEFD849AEC81CE5896D371002FF9ED4@holly.AWRI.local>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: sort --parallel
thread-index: AcxdP808QIfyCTMSR8GaDuUOU2P2AA==
From: "Nathan Watson-Haigh" <nathan.watson-haigh@awri.com.au>
To: <coreutils@gnu.org>
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 129.127.182.188
X-Mailman-Approved-At: Thu, 18 Aug 2011 08:55:35 -0400
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 00:43:18 -0000

This is a multi-part message in MIME format.

------=_NextPart_000_6859_01CC5D8F.6E46EC30
Content-Transfer-Encoding: 7bit
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01CC5D3F.CD653E66"


------_=_NextPart_001_01CC5D3F.CD653E66
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable

I've just discovered that a more recent version of coreutils (8.12) than
the one I currently have installed (5.97) has the --parallel option.
However, when I try to sort a large file I don't see any speedup when
using --parallel=3D8 over --parallel=3D1. In addition, I only see < 100% =
CPU
usage. I'm on a 32 core system with 128GB RAM and would like to sort a
stream consisting of several 100million lines in a smaller amount of
time.

=20

I'm also investigating GNU parallel, any comments on pros/cons of each?
E.g. does GNU sort parallelise the merge part? My limited experience
with GNU parallel is that it only parallelises the sort but then a
single thread is used to do the merge across all the smaller sorted
files.

=20

Cheers,

Nathan



=20
Nathan Watson-Haigh
Senior Bioinformatician | The Australian Wine Research Institute
Waite Precinct, Hartley Grove cnr Paratoo Road, Urrbrae (Adelaide) SA =
5064 | http://www.awri.com.au/contact/map.asp
PO Box 197, Glen Osmond SA 5064, Australia
T: +61 8 83136836 (direct) | T: +61 8 83136600 | F: +61 8 83136601
8 www: http://www.awri.com.au/ | http://www.awri.com.au/events/calendar/

This communication, including attachments, is intended only for the =
addressee(s) and contains information which might be confidential and/or =
the copyright of The Australian Wine Research Institute (AWRI) or a =
third party. If you are not the intended recipient of this communication =
please immediately delete and destroy all copies and contact the sender. =
If you are the intended recipient of this communication you should not =
copy, disclose or distribute any of the information contained herein =
without the consent of the AWRI and the sender. Any views expressed in =
this communication are those of the individual sender except where the =
sender specifically states them to be the views of the AWRI. No =
representation is made that this communication, including attachments, =
is free of viruses. Virus scanning is recommended and is the =
responsibility of the recipient.

------_=_NextPart_001_01CC5D3F.CD653E66
Content-Type: text/html;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable

<HTML xmlns=3D"http://www.w3.org/TR/REC-html40" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word"><head><META =
content=3D"text/html; charset=3Dutf-8" http-equiv=3D"Content-Type">

<STYLE><!--         /* Style Definitions */         =
p.9ee00731-501f-459e-b49d-b524d362925e, =
li.9ee00731-501f-459e-b49d-b524d362925e, =
div.9ee00731-501f-459e-b49d-b524d362925e, =
table.9ee00731-501f-459e-b49d-b524d362925eTable	        {margin:0cm;	=
margin-bottom:.0001pt;}        div.Section1        {page:Section1;}      =
  --></STYLE>
<meta content=3D"text/html; charset=3Dutf-8" =
http-equiv=3DContent-Type><meta content=3D"Microsoft Word 12 (filtered =
medium)" name=3DGenerator><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:612.0pt 792.0pt;
	margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><BODY><div =
class=3DWordSection1><p class=3DMsoNormal>I&#8217;ve just discovered =
that a more recent version of coreutils (8.12) than the one I currently =
have installed (5.97) has the --parallel option. However, when I try to =
sort a large file I don&#8217;t see any speedup when using =
--parallel=3D8 over --parallel=3D1. In addition, I only see &lt; 100% =
CPU usage. I&#8217;m on a 32 core system with 128GB RAM and would like =
to sort a stream consisting of several 100million lines in a smaller =
amount of time.<o:p></o:p></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><p class=3DMsoNormal>I&#8217;m =
also investigating GNU parallel, any comments on pros/cons of each? E.g. =
does GNU sort parallelise the merge part? My limited experience with GNU =
parallel is that it only parallelises the sort but then a single thread =
is used to do the merge across all the smaller sorted =
files.<o:p></o:p></p><p class=3DMsoNormal><o:p>&nbsp;</o:p></p><p =
class=3DMsoNormal>Cheers,<o:p></o:p></p><p =
class=3DMsoNormal>Nathan<o:p></o:p></p></div><BR><BR><FONT =
SIZE=3D"+0"></FONT><FONT FACE=3D"Arial" SIZE=3D"2">
<TABLE BORDER=3D"0" CELLPADDING=3D"0" CELLSPACING=3D"0" =
CLASS=3D"9ee00731-501f-459e-b49d-b524d362925eTable" STYLE=3D"WIDTH: =
100%; BORDER-COLLAPSE: collapse" WIDTH=3D"100%">
<TBODY>
<TR>
<TD VALIGN=3D"top">
<P CLASS=3D"9ee00731-501f-459e-b49d-b524d362925e"><FONT =
COLOR=3D"#999999"><IMG ALIGN=3D"top" ALT=3D"AWRI logo" BORDER=3D"0" =
HSPACE=3D"0" =
SRC=3D"cid:image8f3ec5.bmp@67234c34.d2e74ccf">&nbsp;</FONT></P></TD>
<TD>
<P CLASS=3D"9ee00731-501f-459e-b49d-b524d362925e"><FONT =
COLOR=3D"#999999" FACE=3D"arial" SIZE=3D"2"><STRONG>Nathan =
Watson-Haigh<BR></STRONG></FONT><FONT COLOR=3D"#999999" FACE=3D"arial" =
SIZE=3D"2">Senior Bioinformatician | The Australian Wine Research =
Institute<BR></FONT><FONT FACE=3D"arial" SIZE=3D"2"><FONT =
COLOR=3D"#999999">Waite Precinct, Hartley Grove cnr Paratoo Road, =
Urrbrae (Adelaide) SA 5064 | <A =
HREF=3D"http://www.awri.com.au/contact/map.asp"><FONT =
SIZE=3D"2">Map</FONT></A><BR>PO Box 197, Glen Osmond SA 5064,<FONT =
SIZE=3D"3"> </FONT></FONT><FONT COLOR=3D"#999999" =
SIZE=3D"2">Australia<BR></FONT></FONT><FONT COLOR=3D"#999999"><FONT =
FACE=3D"Wingdings" SIZE=3D"3">(</FONT><FONT FACE=3D"arial" SIZE=3D"2"> =
</FONT><FONT FACE=3D"arial" SIZE=3D"2">+61 8 83136836 (direct) | <FONT =
FACE=3D"Wingdings" SIZE=3D"3">(</FONT> +61 8 83136600 | =
<STRONG></STRONG></FONT><FONT FACE=3D"Webdings" =
SIZE=3D"3">=C3=8A</FONT><FONT SIZE=3D"2"><FONT FACE=3D"arial"> +61 8 =
83136601</FONT><BR></FONT></FONT><FONT COLOR=3D"#999999"><FONT =
FACE=3D"wingdings" SIZE=3D"3">8<FONT FACE=3D"Arial" SIZE=3D"2"> =
</FONT></FONT><A HREF=3D"http://www.awri.com.au/"><FONT =
SIZE=3D"2">www.awri.com.au</FONT></A><FONT SIZE=3D"2"> |&nbsp;</FONT><A =
HREF=3D"http://www.awri.com.au/events/calendar/"><FONT SIZE=3D"2">AWRI =
Events</FONT></A></FONT></P></TD></TR></TBODY></TABLE></FONT><TD></TD><TR=
></TR><TR><TD COLSPAN=3D"2">
<P><BR><FONT COLOR=3D"#999999" FACE=3D"Arial" SIZE=3D"1">This =
communication, including attachments, is intended only for the =
addressee(s) and contains information which might be confidential and/or =
the copyright of The Australian Wine Research Institute (AWRI) or a =
third party. If you are not the intended recipient of this communication =
please immediately delete and destroy all copies and contact the sender. =
If you are the intended recipient of this communication you should not =
copy, disclose or distribute any of the information contained herein =
without the consent of the AWRI and the sender. Any views expressed in =
this communication are those of the individual sender except where the =
sender specifically states them to be the views of the AWRI. No =
representation is made that this communication, including attachments, =
is free of viruses. Virus scanning is recommended and is the =
responsibility of the recipient.<BR></FONT></P></TD></TR><TBODY></TBODY>
<TABLE>
<TBODY><FONT COLOR=3D"#999999" =
FACE=3D"Arial"></FONT></TBODY></TABLE><FONT SIZE=3D"+0"></FONT>
<P><FONT COLOR=3D"#999999" =
FACE=3D"Arial"></FONT></P><TD></TD><TR></TR><TBODY></TBODY>
<TABLE>
<TBODY><FONT COLOR=3D"#999999" FACE=3D"Arial"></FONT></TBODY></TABLE>
<P><FONT SIZE=3D"+0"></FONT></P>
<P></P>=20
<P></P></BODY></HTML>

------_=_NextPart_001_01CC5D3F.CD653E66--

------=_NextPart_000_6859_01CC5D8F.6E46EC30
Content-Type: image/bmp
Content-Transfer-Encoding: base64
Content-ID: <image8f3ec5.bmp@67234c34.d2e74ccf>

Qk3KJQAAAAAAADYAAAAoAAAAMQAAAEEAAAABABgAAAAAAJQlAAAAAAAAAAAAAAAAAAAAAAAA///8
//z3//Xyyraxmn53mXpxmndtmXdqmXprl3prlXtrlXtrl3prmXprm3lsm3lsm3lsmXlsmXlsmXls
mXlsmXlumXlumXlumXlumXlumXlumXlumXlum3lsm3hum3hum3dvm3dvl3hvlXlulXpslXtrl3pr
mXprmnhrmnhrnXpwlXZtmX94wrCp9Oji///7///+AP/07dHBupB9dnZfV3JWT3NWTYNlWoZmW4Rn
WYRnWYJnWYJoWIFoWIFoWIFoWIJoWIZrXYZpW39jWHxgVXxiVn9kWn1iWHleVHpeV3xfWH5hWIFi
WYJjWoRkWYNiWYFiWYBkXXlfWHthWnhiV3VfU4BrXIJtXnRdTn1jVYxyZIFlWmtORXteV3lcV4Rq
ZNK+uf//+wD/6+ORfHRPODB5X1i6n5XfwrnszsPcvrPrzcLrzcLrzsDpzsDoz7/mz7/mz7/mz7/f
xLbjyLrozMHr0cXu08nu1cvt08zr0crq0Mrsz8rs0Mnsz8jsz8btzsXszcTpzMPnz8ngysTl0Mjn
08jgzsPm1cjs2crj0MHkz8Dmz8DnzcHawLTEpJ58XFZcOTWcf3r46uQA2MG5c1xUdl1Ty7Ko7tPJ
7dDH8NLH6Mi98tLF8tLF8tLF8NPF7tTE7dTE7dTE7dTE99rM9NfJ79HG683C5ci/5Mm/5svB6c7E
7NDJ68/I6s7H6c3G6MzF6czF6czD6M3D5s7I3cfB5M/H6dXK4MzB38y/6NPE5tHC7dbH18Cx172x
6tDE/9/ZzKymfltXdlhTw7CpAJmCem1TTL2kmv/q4MeqoYhqX4VlWo9sYoVjVoVjVoVjVoNkVYFk
VX9lVX9lVYFkVYdnWoVjVoRhV4VlWoRmW4NkW4FkW4NmXYFlXoBkXX9jXH1jXH1jXH5kXX9lXoBm
X4BoYnNdV3lkXH9rYHdhVXVgUX1oWYJrXIt0ZYBmWHthVY9zaOLDuv/z7c2qpntbVpd9dgCTenB0
W1HTuK7429KafHFiQjdmQjhtSj11UkV1UkV1UkR1UkR0U0RyVENyVENyU0RvTD9wSj5zUEN9Wk19
W051UkhrS0BoSj9nSkFlSkBiST9gSj9fSEBfSEBeSUFeSEJkTEZaQjxeRz9kTkNhST1iSzxoUUJo
Tz9dRDRqUEBuU0VcQDWbfHP729XcvLeBYVuXdm0AnYR6iG1j4sW87tDFk3NodVJIelRIfVdLc0s/
c0w+c0w+cUw+b009b009bk09b009e1RGcko+bUU5bUc7b0k9dFFEiWdann5zlHZrkXZsj3ZsjXds
inVthnNrg3Fqg3Bpj3dxiW9oi3JoknhsknhsmH5wlHpqgGZWbVNDcFZGel1PY0Y4hWZd4cK517ex
iGZgnnpwAI1zZ4pwZO/TyO7QxZFuZG9MP2hCNnRMQHpQQ3pQQ3pQQ3hRQnhRQnZSQnZSQHhRQoBW
SXpQQ3dNQHdNQH5UR5t0Zti1p//w4fzf0fzg1f3k2vzo3fvo4Pfn4PPl3/bk3f/p4//k3f/k2v/j
2P/k2f/p2+3QwcCkk3RYR2VIOXJSRWZJO45vZvDRyOTHwIhnXpt4awCTeW2SeGz42s/21suefG97
VUlqQjZ8UkV7T0J7T0J7UEF5UEF5UEF3UEF5UT95UT91Sjt6TkGAVEd8UUJyRziCWki8mIj518f/
49T/6Nr/7+P/9+z/+/T//ff//Pb/+/X//PT/+O//9Ov/7eL/7d//7N3kw7Okg3NuTT1qSTl5Wktn
RzqHaV7z1s3qzcZ9XlWbeGsAlHpui3Fl9NfJ/d3Ql3VodE5CdU5AelBDfFBDfVBCfVBCfFFCfFFA
elJAfFFAfFFAf1RFfVBCeUw+eEw7fFA/g1lGiWFPi2dVqol5lXhpnoZ6rpqP79/Y//jy///7+evl
//jw2byzuZqRmXlukG5hpoV2lnRkdFJCc1FBc1FBbUw9cVFEhGZb8NTJ6czDf2NYmXprAJR6botx
ZfLXyfve0Jd1aHJPQXVOQHpQQ3xRQn1QQn1QQn1RQHxRQHxRQHxRQHxRQH5TRH1QQntPPnlOO3pP
PHxRPH1TQHtWQmdDMVo8K15ENmVRRpuJgt3Rzf/+/P/x7tW+to1vZHJSR2tJPGI/MWtHN21JOXZP
QHdQQXVRQW5LPXFSQ4RnWfDUyejNw35kWJV7agCSe2yJcmPx18n53tCVdmdyT0F1TkB6UUJ8UUJ8
UUJ9UUB9UUB9UUB9Uj98Uj98UUB6T0B7UEF7UD97UT57UDt5Tzh2SzZySzV5VEB2VUVsUUNeSD1p
VlHMvbr/+Pjx4uCghn9kRjtiQjdxT0JtSDptRjdxSDmAWEZ5UT93UT9wTDxzUkOEZ1nw1cfozsJ8
ZVaUfGoAkHtsh3Jj79jJ+N/PlXZncVBBc08/eFFCelFCfFFAfVFAfVFAfVI/fVI/fFI/fFI/dk48
eFA+elI/fVQ+f1U+fVM8fFI7eVA5dlE7fl1Kd1pMaVBGX0tG1cbE//3+6drYjnRtbExBdlRHfFlL
eFFDgVhJfFFAdko5fFA/eVE/cEw8c1JChGdZ79XH5s7CfGVWknxqAI58a4VzYu3ZyPbfz5N2Z29R
QHFPP3ZSQnpSQHpSQHxRQHxSP3xSP3xSP3xTPXpSP3ZQPnZQPnlRPntSPH1TPH9WPYFVPYBXPnJL
NXRRPWpLPGJHPV9JRNjGxf/8/+nX2KGFfnNTSHJPQnNOQHJIO4BVRn9RQHlLOX5QPntQP3JLPHRS
QoRnWe/Vx+bOwnxlVpJ7awCMfGuDc2Lr2cj238+Rd2ZtUUBwTz90UkJ4UkB6UkB8Uj98Uj98Uj98
Uj98Uz16Uj93U0F1UT92UT12UDh4UDd6UjZ+Uzh9VTmIX0h4Uz9rSjtnSkF7Yl7axsX/9/ry3d+j
hn9lQjhjPTF5UkR9UkN/U0J/Tz2IWEaAUD58UT50TDp0UkKEZ1jv1cfmzsJ6ZVaUe2sAi31rgnRi
69nI9ODPkHhma1FAblA9dFNAeFJAeFJAelI/elI/elM9elM9elM9eFM/dFNAc1I/dFE9dVE5eVE4
elI2fFE2e1M3d043ZkEtc1BCi2xjwaai9N7g//v///X3tpmSfFlPdU9DflRHeUw+fU8+eko4fEw6
gFA+fFE+dEw6dFJChGdY79XH5M7CemVWlXtrAIl8bIJ0YuvYyfTgz5F3Z29RQHFPP3hSQHpRQnxR
QH1RQH1SP3xSP3xTPXpSP3pSP3VQPHZRPXlRPntUPn1UPX5VPH5VPHxTPH9YQnVSPp59bcyuo//2
7//9+f/9+//79v/p4NSypbGOgYFcTmdAMYFWR4RYR3dLOn5QP3xQP3RLPHZSQoZnWO/Vx+TPwHpl
VpV7awCLe26Dc2Pt18v43tCVdWh0T0F5TUB/UEKATkKFUUSHU0aHVESBUEB7UD16Tz58UT6DVkF7
TDeEVEJ/UT96TzyBVkV1Tz1pRTNpSDjDpZT/5tX/6dnv1cXQt6fDq5nTuannx7rqyLvtzcDcv7GC
ZVZdPi+EY1RrRjh5T0J7T0J0Sj12UUOIZlnw1cfkz8B6ZVaVe2sAi3tug3Jl7dfL+d3Sl3Vodk5C
ek1AgU9DgEo/gEo/f0o9fUk8fEs7e08+flNCg1hFglA8fkw4hFJAflA/d0w9c0w9dVJEg2JTza6f
686/38W1qpB/h25agWlTfmRMeVxHhmVWnX1wz7Kk/ePV1ryuf2VXZEk7bk5Bd09DeU9DdEo+eFBE
iGZZ8NXH5M/AemVWlXtrAIx7boVyZe/Xy/nd0pd1aHZOQnpNQIFPQ4hUSIZSRoNPQoBPQX9RQH1S
QXtTQXtTQX5QPoJUQoFTQX5TQnhPQG9KPIpoW7iYi//z5eTHuKiOfnRaSV5DL2hNOHJVQGhKN2lI
OWdHOoVoWsmvof/p29G3qXdcTnBQQ3dPQ3lPQ3RKPnhQRIhmWfDVx+TPwHplVpV7awCMe26FcmXv
18v53dKXdWh2TkJ5TUB/T0N/TUF/TUF+T0F/UkR+U0J4UkBvSzlqRjRxSTd9UkFySjhzTD1vSjxr
STyjg3blyLrhw7iMcWNgRTdqTT5oTDtmSDVvUT51VUKDYlNpSTxeQTNvVUfUuqz/7+GxlohwUEN3
T0N5T0N0Sj54UESIZlnw1cfkz8B6ZVaVe2sAjntuh3Fl79fL+d3SlXVodE5Cd01AfFBDfE9CfVBD
flNEfFVGfFhGellGd1dEdFRBcEw6fFhIbUk5cU5AcU9Cfl5Tyaug/+PYrpGIblJHXkI3fF9Rfl9Q
clFBc1JCdFNDdlVGbU1AeFtNXkQ2jXNl9dvN2b6wgWFUd09DeU9DdEo+eFBEiGZZ8NXH5M/AemVW
lXtrAJB6bodxZe/Xy/nd0pV1aHJPQnNOQHhRQ3tRRHhRQ3ZPQG5MPGpKN2hKN2lOOm1SPmhKOXRT
Q2FCM2lJPGlLQIptZNu+tebLwX1hWnBVS21ORW9PRG9NQHVSRHVSRGpHOW1LPmFBNHxfUWxSRGlP
QcWrnerPwaqKfXdPQ3lPQ3RKPnhQRIhmWfDVx+TPwHplVpV7awCSem6JcWXx18v53dKTdmhxT0Jx
TkB2UUNrRjhvTD51U0NxU0JqTztlTDhmTjprUz9rUUB1WElkSTtsUUNsUkaghXvozMW6npdbPjls
UElrTENfPzRmRDdzUEJzTkBuSTt9Wk1jQzZoSz1rUUNiSDqli33w1cfXt6p3T0N5T0N0Sj54UESI
Zlnw1cfkz8B6ZVaVe2sAknpuiXFl8dfL+d3Sk3Zob09CcE9Ac1JDdlNFiWhZnoBvqY18p456pIt3
pIx4p497oYh4p45+moByoot8oId93MO5//74xaulm355rI+IqYmDqIh9tZGHroh8pH1vrId5fFlM
dlZJbE9Bb1VHY0k7kXdp79TG9NTHd09DeU9DdEo+eFBEiGZZ8NXH5M/AemVWlXtrAI93a4RsYO7U
yPre05Z5a29PQm5PQHVWR7uai/bXyPrcy/jcy//u2v/o1P/n0//q1v/15fbdzf/l1//36Pjf1f/4
7f/t5//x6//o4//i2//q5P/v5P/b0fjSxv/f0f/p29y5rI5uYXJVR2JIOmJIOnheUNzBs//0566G
enRKPnZMQHRMQI1rXu7TxebRwndiU5V7awCSem6Kcmbt08f02s6QdWdoSz1/YFGuj4D/6Nn83c7R
taTOsqHcwa3cwa3exbHWvanexLPSuanWvK7bxLXbw7f//fL/6eLhx8DWubTWubLiwbjmw7natKjX
sKLkuq3sxbf+287OrqGUd2lpT0FlSz1rUUPFqpz11cixiX12TEB3TUF0TECMal3t0sTn0sN4Y1SV
e2sAkHhsjnZq7tTI9NrOkXZoXkM1hGdY4MO07M/AooV2ZUc2akw7blA9bE47eVtIaEo3bVFAblRD
bFJCZ00/g2ld48rAx6yidltRYkY/aEtCclFIdFFHcEo+cEk7eE5BfVZI6ca5/NzPtJeJclhKaU9B
W0EzuZ6Q78/Cto6CeU9DeE5CdExAi2lc7dLE59LDeWRVlXtrAIpyZo93a+/Vyfnf05l+cFg9L3xf
UOnMvebJupBxYl5AL3dWRnFQPWhHNHtaR2pJNmxMOXJUQ2lNPGNGN45zZf/n3Nu/tHFVSmNGPWtN
Qm1NQnBNQHRPQXJLPHFIOXRNPqqHefnZzLibjXNZS2xSRFU7LcCll//l2LmRhXtRRXlPQ3NLP4po
W+zRw+jTxHplVpV7awCLc2eOdmrq0sb23tKbgXNbQTNzWUnXuqvdwLGTdGVlQzN5VUV6VEJzTTuF
XUtzTTtxTTtyUT5qSjdnRjaUdWb/59nava9xVEZtT0R0VEdwTkFyT0F9WUl1Tz1vRzV6VEKui33w
0MOoi31pT0FsUkRYPjDCp5n/59q5kYV7UUV5T0NzSz+KaFvs0cPo08R6ZVaVe2sAkXltj3dr6NDE
79fLlnxuZEo8dVtLuZyN8NHCxKOUe1dHa0Q1e1NBgFVEhlpJek8+e1NAdlM/cE05bk06l3Zm/+HS
2rqte1tOcFBDdFVGbk0+clBAf1tJcUw4dU06mnRi9NHD6cm8kXRmYEY4alBCXUM1uZ6Q8tLFto6C
eU9DeE5CdExAi2lc7dLE59LDeWRVlXtrAI54bIx2auvVyezWyo12Z2lPQXFXR41wYeDBsvTRw6Z/
cGpBMnxQP4BSQXxLO35QPnxTPXxVP3VQPG9LOZVzY//i0uPCs4dmV2pJOnJRQm1KPHJQQHtXRWpF
MYVeSNCrl//s3r+fknhbTWJIOmlPQWNJO7idj/LSxbGJfXZMQHdNQXRMQIxqXe3SxOfSw3hjVJV7
awCIcmaKdGjz3dHz3M2JcmNpUEBmTDxkSDe4mYr/6dnMqJh3UEF/Vkd5Tj9uQTOFV0Z5Szl/VD92
TjtqRjSQb1//59bnyruLbF1nRjd1UkR0T0F6VkZ8WEhoRDKUc1/93Mnvzb2KZ1loSTprUUFpUEBm
TD7Cp5n/6t2shnpySj52TEB0TECNa17w08Xm0cJ3YlOVe2sAknpuiXFl79jJ+N7QkHdna1FAalA/
b1RAeFpJ3b+u/+zcoH9vXTosfVpMeVZJckg7g09CgU4+eE0+a0o6fWRUzLin28a3kXdpbEo9elRI
b0U5gFZKfVpNXkEzzLWm/uXVs49/eE9AcE4+cVNCX0c1YEk5zbSk+NvMpoV2g15QaEA0dE5Cjmpg
7tDF5Mq+hG1el3prAJJ6bolxZfHXyfjfz5F3Z2tRQGxRPW9UQGtNOraYhf/h0MyunXJSRWhIO3VV
SnRMQIFLQIRNQHpOQWpLPHpmVbysm+fUxZJ7bGA9M3xTSnVHP3tQR3BLQ52Ad+nXzOXPw5NsXXRJ
OHROPHlZRmVLOmtVQ97FtfjezpJxYnlWSGpCNnVPQ45qYPLSx+XLv4FnWZd6bACSem6JcWXx18n4
38+Rd2dtUUBuUD1xU0BnRzSMbFngv6/+3c2efnFcPC9xUUZ8VEiASj+DTkF9UURsSzx6Y1Opl4b7
6NmfhXdcPDF6U0p4TURyRz5zTkbmycD349i1nZFySzx1Sjl0Tjx9XUpoTj19ZVPw1sbw08R5WEly
T0FuRjp1T0OMaV/z1crmzMB8YlSXemwAknpuiXFl8dfJ+d/Pk3Znb1FAblA9c1NAb088dVVCr45+
/+fX2Lirb09CaUk+e1VJgExAhVBDfVFEaUg5dl1Nk39u//Ljs5mLako/d1BHdk1EbUQ7n3tz/+jf
0ryxe2NXakM0gFVEck48eVlGaE49kXln993N17qrakk6ck0/c0s/dU9DiGVb9NbL6M7CemBSl3ps
AJB6bolxZfHXyfnfz5N2Z29RQHBQPXRTQHRTQHNSP4VjU+7Nvf/r3qSEd2dJPm1KPYBOQoZSRXtP
QmdENm5URIFqWv/r3MyypH5eU2hEOnBJQH5XTuTAuPrb0pqBd2FHO3NMPYZbSm9LOW1PPGhOPa2V
g/bczLucjWtIOnZRQ3ZOQndPQ4ViWPLUyejQxHliU5d6bACQem6HcWXx18n538+TdmdxUEBxUD12
UkByTjx3U0FzTz+/nY3/8eTgwLOBY1hlQjV8T0KEU0V6TkFrRjhqTT52XU3pz8HkyryRcWZbOC5z
T0WsiH7/6eDUtax2W1FoTEF5UkN/V0VtTDloSjduVEPPtaTw08SggXJwTT95UkR4TkJ4UESGY1nv
08jlz8N6ZVaVemwAkHpuh3Fl8dfJ+d/PlXZncVBAc089eFJAdE48eFJAck4+iWdX4sCz/+XYtZeM
c1FEdko9gFFDeU1AcUw+bEs8dVhJyK2f9NnLpYd8Xj4zg2NY5cW6+NfOpIV8Z0pBcVNId1NDckw6
dVRBbU88el5N69HA4MO0imladVBCeU9CdUs/elJGiWZc7tLH483BfGdYlXpsAJB6bodxZe/Yyfnf
z5V2Z3JQQHVPPXpSQHtTQXlRP3hRQmE/L6qIe//x5OLEuYpqXXBGOXxPQXlNQHhRQ25LPXdYSbKV
h/vg0riaj2hKP5R2a//v5NGyqYFiWWNEO25OQ3ZSQmxGNH9eS3ZYRYNnVvvfztS1pnhXSHdQQnVL
PnJIPHxUSI1qYO3Tx+DNwH1oWZV6bACOe26HcWXv2Mn538+Xdmd0UEB3Tz18UUB/VEN6Tz57VEVp
RTWAXVDHp5r/9erBoZR9VkhsQTJ+VEd2T0F4UUNuSz2DY1b/6tzavrOSeGzXvbH64NSVeG9hQjl5
WE9xTkRrRzeFYU9pSTZtTzzNsaD/59a+n5BpRjh5T0J7T0J2ST54UESIZVvv1cniz8J4ZVaVemwA
jntuh3Fl79jJ+d/Pl3ZndFBAeU49fVFAeEw7ek49gVhJcks8ck9CnHxv/N7T89bInHdpcEk6eU9C
eE5BeU9Cc0w+fVpN3cCy/+fc+eHV+OLWxKygdVpQXj82a0c/aUU7cU09Yz8tWjonmXto8dXE5Mi3
lXRlakU3eU9Ce09Cdkk+eFBEiGVb79XJ4M/CeGVWlXpsAIx7boVyZe/Yyfvez5h1Z3ZPQHpOPX9R
QHpMO31PPoBVRnhRQm5LPnFRRMeroP/p28WklXpWRnRKPXpOQXpOQXdNQHVPQ6WFeNW7r//98enW
yZJ/cndeVHdYT29KQoRdVJFtXXdWQ4JiT8+xnv3h0L+hkHlWSHtURntPQnxPQnZJPnhQRIZmW+3V
yd/PwnZmVpV6bACMe26FcmXv2Mn73s+YdWd4T0B6Tj2BUECCUUGBU0J4Sz17UkN5VkliQjWNcWbg
xbflxreGYlJzSTx/UkV6TUB7T0JzSz96Wk3Tua3///T/+u3p2Mv74tj42dDiu7P/2tH72cn62sf5
28j73crdwbCWeGdqRzl3UEJ7T0J8T0J3ST54UESGZlvt1cnfz8J1ZlaUemwAjHtuhXJl8dfJ+97P
mHVneE9AfE49g1BAgk8/iFdHeUo8eVBBfVpNZ0c6cFRJxqud9NXGkG5edEo9glVIf01Bf09DeU9D
aEY5wamd//fq49bI4tLF79nO9NXM4bqy78a9+NbG/+XS+dvIzLGdmX1sdVdGbUg6d01AfE9CfE9C
d0k+elBEhmZb7dXJ3dDCdWZWlHpsAIx7boVyZfHXyf3ez5p1Z3pPQH5NPYNQQHlGNolYSH9QQnlQ
QXZQRGtLPnFVStW7rfPWx5p4aHZMP4RUSIJOQoFPQ35RRmVDNsOrn/Pj1qWajIt+cIBqX55/dp91
bpVqYZBuXo5wXYpsWXpfS2xQP2tNPHdSRIFXSnxPQn5OQndJPnpQRIZmW+3Vyd3QwnVmVpR6bACM
e26FcmXx18n93s+adWd6T0B+TT2DUEB9STmHVER+T0F7UkNxSz9tTUBxV0vgxrjx1MWjgnJ0Sj1/
T0OEUESCTkJ+UUZmQzbErqLu4dODemxeU0VMNitsTUR1S0RzSD94VkZrTTpsTjtuUz9rTz5uUD94
U0V7UUR+TkJ+TkJ3ST56UESGZlvt1cnd0MJ1ZlaUemwAjHpvhXJl79fL+97QmHVneE9Aek49f1FA
hlVFflA/dEg3flVGdVBCcFBDbVBC17yu8dTFqYh5cEk7d0s+g1FFfU1BfE9EZUI1xqyg9eLVh3Zp
dmNWaU9Dck9Fb0M8hllOb0g5bk05eFdEdlZDa0s4cU8/fFVGdk0+fE9CfE9Cdko9eFBEhmZZ7dbH
38/CdmZWlXpsAI55cYVxZu/Xy/je0JV2Z3FQQHNPPXhTP3JKN39XRHdSPnpUQm5KOm5LPX1cTd/A
sf/h1J17bmhFOHhSRntTR3BIPG5IPGxJPMupnP/h1KCAc3FPQnZTRnVPQ29EO4RYS3xRQHxTPXxS
P3xSP3xSP3xRQHxRQHxRQHtQQXlQQXBMPHNSQ4RnWO3WxuLPwHplVpl5bACOeXGHcWbv1sz43tCT
dmdvUUBxUD10Uz9zUDx4VUFxTjp5VUNyTj5xTT18V0neu63108abeWxpRzpxT0J0UURwTUBwTUBm
QzbSrKD/4NSkfHBxST13T0N6UkZzST2BVUh9Uj9/Uj1/Uj1/Uj1/UT9/UT9/UUB8UUB5UT91UT9u
TDxxU0KCaFjv1sbk0L98ZVWZeWwAkHlxh3Fm79bM+N7Qk3Znb1FAcVA9dlJAeVRAeFM/b0k3fVdF
eFFCcEw8eVRG3rut99XIoYF0clBDdFJFd1VIelhLeVZJZ0Q31K6i/9/TonxwbUc7c0s/fVVJdk5C
e1FEfVI/f1I9gVE/gVE/gVE/f1E/f1FAfVFAe1BBd1BBcEw8c1JChGdY79bG5s+/fmVVl3prAJJ4
cYlvaPHWzPnd0pV1aHFQQHNPP3hSQHtWQnpSP3FJN4BYRnlQQXBJOnxVR+TBs/nXypx8b2dFOGpI
O25MP3BOQW5LPl06LdKsoP/c0KV/c3JMQHFJPXtTR3hQRHhOQX1SP39SPYFRP4FRP4FRP4FRP39R
QH1RQHtQQXdQQXBMPHNSQoRnWPDWxujPv35lVZV7awCUeHGLb2jy1cz73dKXdWhyUEBzTz94UkB7
U0B+VEF2Szp/V0V2TT5uRzh9Vkjowrb/4tWhgXRpSTxwUEN1U0ZyUENwTkFnRTjPrJ/51smmgHR6
VEhvST10TkJ3T0N4TkF9UUB/UT+BUT+BUT+BUECBUEB/UEJ9UEJ7UEF5UEFySz10UUOGZlnw1cfo
zsB+ZVWUe2sAlHhxi29o9NXM/d3Sl3VodE9BdU4/elJAek8+gFZDeE08f1RDdks8ckg7fFJG2rSo
5sS3mHhrcFBDdlZJdVNGdFJFd1VIbkw/17Sn8c7BoHpuf1lNcUs/cUs/dk5CeU9CfVFAf1E/gVE/
gVE/gVBAgVBAf1BCfVBCfE9BeVBBcks9dFFDhmZZ8tXH6c7AfmRWlHtrAJR3cotvaPTVzP3d0pd1
aHRPQXVOP3pSQHdMO4FWRXlMPntQQXhMP3hOQXVLP72Xi/jWyde6rNCwo8ysn8GhlMysn9a0p8Oh
lOfEt+rHupBtYHtYS3NNQXFLP3ROQnhRQ3xRQn1RQH9RQH9RQH9QQn9QQn9QQn1QQnxPQnlPQnJK
PnRRRIhmWfLVx+nNwn9kVpV7awCUd3KLbmny1c773NOXdGpyT0J1TkB6UUJ2SzyBVkV3Sjx4TT57
T0J+VEduRDilf3Ppybzz1sj/5dj42Mvnx7r/39L/6t3uzL/208bmw7aEYVR2U0Z0TkJyTEB2UER5
UkR6UUJ8UUB9UUB9UUB9UEJ9UEJ/UEJ9UEJ7T0J5T0JySj50UUSIZlny1cfrzcJ/ZFaXemsAkHNv
lnl0687H8tPKm3hud1RHfVZIdUw9ek9Aek9Aek5Bek5Bek1CeE5CeE1EdE1Eg2NWf2RWgWRWgWRW
gWRWgWRWg2NWg2NWgV9Sf11QelhLdlRHdVJFdFFEdFFEd1JEdk9AeFA+ek9Aek9Aek9Aek9Ae05B
ek5BgFNIYzktf1dLfVpNjGlf5si96cvAhWdcm3tuAJBzb49ybuLFwO7RypFwZ189MGpEOHpTRXlQ
QXlQQXtPQnlPQnlPQ3dPQ3dORXNPRWdKPGVKPGdKPGdKPGdKPGdKPGlJPGlJPHVTRnNRRHBOQW5M
P25LPm5LPm9MP3BNP3VRQXVRP3dQQXdQQXlQQXlQQXlPQnlPQoddUXhQRHxWSmdEN4dnXOfJvtzA
tX5iV5l5bgCJbWx2W1fIrqjz19CpioFoSDtnRDeAW010TT90TT92TD90TT90TEByS0JyS0NvTEJs
T0FqT0FqT0FqT0FsT0FsT0FsT0FsT0FsTD9rSz5sSj1rSTxsSj1tSz5wTUBxTkBwTj5wTj5yTj5y
Tj50TT90TT90TEB0TEBxST10TkJrRz1jQDasjYT/4tnTuK6CZ12ZfHMApY6MbFNPpIuH8dfQ38K5
qYuAjmxflXJkmHNlmHNlmHNlmHJmmHFolnJolnFplXJoknRpkHVnkHVnkHVnknVnknVnknVnknVn
lHRnlHRnlXNmlXNmlnRnl3VomXZpmnhrk3Rlk3VklXRklXRklnNllnNllnNmlnNmlXJlmndqk3Bm
o4N48NPK/+TapYyCcVpSm4F6ANnEwm1ZVHFbVsewqPzh1//j2O7Owe7Mv/XUxfbTxfbTxvXTxvXS
yPXSyPXRyfPTyOvPxOrQwuvQwuvQwuvQwuvQwu3Qwu3QwvPTxvLSxfLSxfHRxPPRxPPRxPPRxPLS
xfHUxe/VxfHUxfHUxfPTxvPTxvXTxvXTxvfUyu/PxOfIv/PWzf/u5Mato2pTS3FeVsi1sAD/9PGJ
dnNVQTx2YFqskovRt6vUtqvZuazYuarauarauKvYuKvYuK3YuK3Yt67Wt67Xu7DWvK7XvK7XvK7X
vK7XvK7ZvK7ZvK7ZuazYuKvYuKvXt6rYtqnYtqnXtajVtajTuqrTuqrTuqrUuqrUuavWuavWuavW
uavSsqfGqJ3JrKPKr6W0m5FwWk9TPjaWhH3/9fEA//77zr26nImEd2RdZ1BIbVVJak5Db1JEdVZH
dVZHdVVIdVVIdVVKc1VKc1RLcVRLblRIblRGblRGblRGb1RGb1RGb1RGb1RGdVhKdVhKd1dKd1dK
d1dKdlZJd1VIc1ZIbldHbFhHbldHcFdHcFZIcVZIcVVKcVVKd1lOa09EeV5Udl1TbVZOc15Wk352
yr21///6AP/8+f/49f/9+ODNxqaRiZZ+co91aZZ7bZl6a5l6a5l5bJl5bJd5bpd5bpV4cZV4b5R6
bpR6bJR6bJR6bJV6bJV6bJV6bJV6bJV4apV4aph4a5l5bJl5bJl5bJp4a5Z5a5J7a458a5J7a5J7
a5R6bJR6bJV5bpV5bpt/dIpwZJV6cIx2a56Hf+DLw//27v//+P///AA=

------=_NextPart_000_6859_01CC5D8F.6E46EC30--


From MAILER-DAEMON Thu Aug 18 08:55:38 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu28H-0000PY-UZ
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 08:55:37 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47033)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1QttU5-00076a-4f
	for coreutils@gnu.org; Wed, 17 Aug 2011 23:41:33 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1QttU4-0001sZ-Dy
	for coreutils@gnu.org; Wed, 17 Aug 2011 23:41:33 -0400
Received: from mail-vw0-f41.google.com ([209.85.212.41]:34335)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1QttU4-0001sR-7S
	for coreutils@gnu.org; Wed, 17 Aug 2011 23:41:32 -0400
Received: by vwm42 with SMTP id 42so1457975vwm.0
	for <coreutils@gnu.org>; Wed, 17 Aug 2011 20:41:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=mime-version:date:message-id:subject:from:to:content-type;
	bh=nGV/4JzaNMoRgf5mFmfydd630b6zVpuW+kTYPdcQsSw=;
	b=tOVH8A8HTVxJx5xhj2iUbYQQWShBiVh+TVjX0gdb1k0BDTH950xBGgYHTv6kf3JAMa
	jC+XuW1X6PgYcfYd+A39VY6Z4SutD0uwKlkIu1Di848VXu0g5ib8yH7SlOWHiz0ZmkRS
	wqbywubu3S2Y1uR07tiLlv5LyRRDmCwPc+eK0=
MIME-Version: 1.0
Received: by 10.52.29.42 with SMTP id g10mr238267vdh.36.1313638891608; Wed, 17
	Aug 2011 20:41:31 -0700 (PDT)
Received: by 10.220.98.139 with HTTP; Wed, 17 Aug 2011 20:41:31 -0700 (PDT)
Date: Wed, 17 Aug 2011 23:41:31 -0400
Message-ID: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
Subject: human-readable / block-size as a general utility?
From: Aaron Davies <aaron.davies@gmail.com>
To: coreutils@gnu.org
Content-Type: text/plain; charset=ISO-8859-1
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.212.41
X-Mailman-Approved-At: Thu, 18 Aug 2011 08:55:35 -0400
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 03:41:34 -0000

is there a way to access the -h functionality of du/df/ls as a general utility?

i'd like to write a wrapper for a badly-behaved quota tool that only
uses 1K blocks
-- 
Aaron Davies
aaron.davies@gmail.com


From MAILER-DAEMON Thu Aug 18 09:41:40 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu2qq-00019p-Ow
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 09:41:40 -0400
Received: from eggs.gnu.org ([140.186.70.92]:56402)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu2qn-00019j-M1
	for coreutils@gnu.org; Thu, 18 Aug 2011 09:41:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu2qm-0001Px-Jf
	for coreutils@gnu.org; Thu, 18 Aug 2011 09:41:37 -0400
Received: from mail3.vodafone.ie ([213.233.128.45]:42313)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu2qm-0001Pt-FF
	for coreutils@gnu.org; Thu, 18 Aug 2011 09:41:36 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBADwVTU5tTcb2/2dsb2JhbAAMN4RLpl4BAQUjDwFGEAsNCwICBSECAg8CRgYNAQcBAa9nkVWBLIQMgRAEmD2LTA
Received: from unknown (HELO [192.168.1.79]) ([109.77.198.246])
	by mail3.vodafone.ie with ESMTP; 18 Aug 2011 14:41:33 +0100
Message-ID: <4E4D168D.70908@draigBrady.com>
Date: Thu, 18 Aug 2011 14:41:33 +0100
From: =?UTF-8?B?UMOhZHJhaWcgQnJhZHk=?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Nathan Watson-Haigh <nathan.watson-haigh@awri.com.au>
Subject: Re: sort --parallel
References: <33310ACF3DEFD849AEC81CE5896D371002FF9ED4@holly.AWRI.local>
In-Reply-To: <33310ACF3DEFD849AEC81CE5896D371002FF9ED4@holly.AWRI.local>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.45
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 13:41:38 -0000

On 08/18/2011 01:43 AM, Nathan Watson-Haigh wrote:
> Iâ€™ve just discovered that a more recent version of coreutils (8.12) than the one I currently have installed (5.97) has the --parallel option. However, when I try to sort a large file I donâ€™t see any speedup when using --parallel=8 over --parallel=1. In addition, I only see < 100% CPU usage. Iâ€™m on a 32 core system with 128GB RAM and would like to sort a stream consisting of several 100million lines in a smaller amount of time.
> 
>  
> 
> Iâ€™m also investigating GNU parallel, any comments on pros/cons of each? E.g. does GNU sort parallelise the merge part? My limited experience with GNU parallel is that it only parallelises the sort but then a single thread is used to do the merge across all the smaller sorted files.

It sounds like your bottleneck is the disk?
You might try to split your input to separate devices first.
Note recent versions of split have the --number=l/N option
which might help here (N is the number of chunks you want
to split to).

cheers,
PÃ¡draig.


From MAILER-DAEMON Thu Aug 18 10:00:11 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu38l-00079p-Mw
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:00:11 -0400
Received: from eggs.gnu.org ([140.186.70.92]:60201)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu38h-00070O-3R
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:00:08 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu38d-0005T2-5L
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:00:07 -0400
Received: from mail3.vodafone.ie ([213.233.128.45]:16645)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu38d-0005Qm-0d
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:00:03 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBANUZTU5tTcb2/2dsb2JhbAAMNqspAQEFMgFGEAsNCwkWDwkDAgECAUUGDQEHAQHBU4Mrgx0EmD2LTA
Received: from unknown (HELO [192.168.1.79]) ([109.77.198.246])
	by mail3.vodafone.ie with ESMTP; 18 Aug 2011 15:00:01 +0100
Message-ID: <4E4D1AE0.8070804@draigBrady.com>
Date: Thu, 18 Aug 2011 15:00:00 +0100
From: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Aaron Davies <aaron.davies@gmail.com>
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
In-Reply-To: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.45
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:00:08 -0000

On 08/18/2011 04:41 AM, Aaron Davies wrote:
> is there a way to access the -h functionality of du/df/ls as a general utility?
> 
> i'd like to write a wrapper for a badly-behaved quota tool that only
> uses 1K blocks

That might be quite useful.
Someone told me recently that `wc -h` would be
very useful to them, and I said something more
general would be even better.

Perhaps a printf format spec?
%h is available, but it's probably best
go with something a bit more future proof.
Perhaps %{human} ?

cheers,
Pádraig.


From MAILER-DAEMON Thu Aug 18 10:09:20 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu3Hc-00014F-3G
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:09:20 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33476)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu3Ha-000149-Od
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:09:19 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu3HZ-0007B7-Hb
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:09:18 -0400
Received: from mx1.redhat.com ([209.132.183.28]:64807)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu3HZ-0007B0-9V
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:09:17 -0400
Received: from int-mx12.intmail.prod.int.phx2.redhat.com
	(int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7IE9Dln015393
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Thu, 18 Aug 2011 10:09:14 -0400
Received: from [10.3.113.130] (ovpn-113-130.phx2.redhat.com [10.3.113.130])
	by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7IE9Dup032538; Thu, 18 Aug 2011 10:09:13 -0400
Message-ID: <4E4D1D08.5010408@redhat.com>
Date: Thu, 18 Aug 2011 08:09:12 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
	<4E4D1AE0.8070804@draigBrady.com>
In-Reply-To: <4E4D1AE0.8070804@draigBrady.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25
Content-Transfer-Encoding: quoted-printable
X-MIME-Autoconverted: from 8bit to quoted-printable by mx1.redhat.com id
	p7IE9Dln015393
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: Aaron Davies <aaron.davies@gmail.com>, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:09:19 -0000

On 08/18/2011 08:00 AM, P=E1draig Brady wrote:
>
> Perhaps a printf format spec?
> %h is available,

No it's not.  printf %hx prints a short int, printf %hhx prints a char=20
as an int.

Meanwhile, although both the bash builtin and coreutils' printf parse=20
these two formats, they actually still end up widening to int before=20
printing; arguably a bug:

$ printf %hhx -1
ffffffffffffffff
$ echo 'format(%hx,-1)' | m4
ff

--=20
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Thu Aug 18 10:15:20 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu3NQ-0002Hd-BY
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:15:20 -0400
Received: from eggs.gnu.org ([140.186.70.92]:59812)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1Qu3NO-0002HW-0G
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:15:18 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1Qu3NM-0008LK-Rb
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:15:17 -0400
Received: from mail-yi0-f41.google.com ([209.85.218.41]:60610)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <aaron.davies@gmail.com>) id 1Qu3NM-0008LG-NJ
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:15:16 -0400
Received: by yib2 with SMTP id 2so1626706yib.0
	for <coreutils@gnu.org>; Thu, 18 Aug 2011 07:15:16 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=subject:references:from:content-type:x-mailer:in-reply-to
	:message-id:date:to:content-transfer-encoding:mime-version;
	bh=xbu1IudyJU+fgK2x4kTaRwlcibGQiiCpgKt6SK7vCJk=;
	b=jOvCG2MRnRLZexPB95RP4955GmLjDHf9OQ6n+vCBKa2hKGDT5ZVsXthpqOEWG1H7qD
	wOtM0b6i3eNjtumimpSEPb54gYUC8l/6n9JP1LPlF0HQN9ZwiDM3yn6dQlZBDf4yp2Iz
	CJyHJKUnRrVvf2dklfycAVd0hmTOasoRkT+Sc=
Received: by 10.42.88.10 with SMTP id a10mr822749icm.318.1313676916080;
	Thu, 18 Aug 2011 07:15:16 -0700 (PDT)
Received: from [10.48.49.93] (mobile-166-137-137-048.mycingular.net
	[166.137.137.48])
	by mx.google.com with ESMTPS id m21sm979169ibf.59.2011.08.18.07.15.13
	(version=TLSv1/SSLv3 cipher=OTHER);
	Thu, 18 Aug 2011 07:15:14 -0700 (PDT)
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
	<4E4D1AE0.8070804@draigBrady.com>
From: Aaron Davies <aaron.davies@gmail.com>
Content-Type: text/plain;
	charset=utf-8
X-Mailer: iPhone Mail (8J2)
In-Reply-To: <4E4D1AE0.8070804@draigBrady.com>
Message-Id: <FAD2C294-C61D-4DFE-80DD-8AF306B15928@gmail.com>
Date: Thu, 18 Aug 2011 10:13:38 -0400
To: "coreutils@gnu.org" <coreutils@gnu.org>
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (iPhone Mail 8J2)
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 209.85.218.41
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:15:18 -0000

On Aug 18, 2011, at 10:00 AM, P=C3=A1draig Brady <P@draigBrady.com> wrote:

> On 08/18/2011 04:41 AM, Aaron Davies wrote:
>> is there a way to access the -h functionality of du/df/ls as a general ut=
ility?
>>=20
>> i'd like to write a wrapper for a badly-behaved quota tool that only
>> uses 1K blocks
>=20
> That might be quite useful.
> Someone told me recently that `wc -h` would be
> very useful to them, and I said something more
> general would be even better.
>=20
> Perhaps a printf format spec?

yes, that's exactly what I was thinking of. how hard would that be to implem=
ent?



From MAILER-DAEMON Thu Aug 18 10:52:25 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu3xJ-0005Dx-SL
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:52:25 -0400
Received: from eggs.gnu.org ([140.186.70.92]:38011)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <cygwin@cwilson.fastmail.fm>) id 1Qu3e0-0008Au-GX
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:32:30 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <cygwin@cwilson.fastmail.fm>) id 1Qu3dz-0003RL-1u
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:32:28 -0400
Received: from out2.smtp.messagingengine.com ([66.111.4.26]:33664)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <cygwin@cwilson.fastmail.fm>)
	id 1Qu3dq-0003NS-8M; Thu, 18 Aug 2011 10:32:18 -0400
Received: from compute3.internal (compute3.nyi.mail.srv.osa [10.202.2.43])
	by gateway1.messagingengine.com (Postfix) with ESMTP id D9F1C22285;
	Thu, 18 Aug 2011 10:32:13 -0400 (EDT)
Received: from frontend2.messagingengine.com ([10.202.2.161])
	by compute3.internal (MEProxy); Thu, 18 Aug 2011 10:32:13 -0400
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=
	messagingengine.com; h=message-id:date:from:mime-version:to:cc
	:subject:references:in-reply-to:content-type; s=smtpout; bh=IpnI
	4geQgRl1oKCe2T++2HNF7+o=; b=TeeE5ewZFTYWnUdIdC6HTClVODfMWwKBe9UE
	m9SHFWvGjUFH5/xIPG/Cefo/8mdWl2qyY1eFPbUIefadX/MkGFVWtIqYkZfomEed
	AufYKlD0ccud55TTsHa6Iwz813fFBf3QDxmv6FAFqpW8+/8zBf3Bz1arklv7kuK/
	gVmyEB8=
X-Sasl-enc: Zf6SVA0xWZCV7rrer0+HZQaO4Pq2w09HbRPnFljoy+eQ 1313677933
Received: from [192.168.1.3] (50-88-210-98.res.bhn.net [50.88.210.98])
	by mail.messagingengine.com (Postfix) with ESMTPSA id 0AB3E7201CA;
	Thu, 18 Aug 2011 10:32:12 -0400 (EDT)
Message-ID: <4E4D2248.3030900@cwilson.fastmail.fm>
Date: Thu, 18 Aug 2011 10:31:36 -0400
From: Charles Wilson <cygwin@cwilson.fastmail.fm>
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US;
	rv:1.8.1.23) Gecko/20090812 Thunderbird/2.0.0.23 Mnenhy/0.7.6.666
MIME-Version: 1.0
To: Bruno Haible <bruno@clisp.org>
Subject: Re: make -q and maintainer-makefile issues?
References: <87pqkdkkz1.fsf@latte.josefsson.org>
	<4E4485D3.4050905@cs.ucla.edu> <4E4486C7.9050705@redhat.com>
	<201108121900.26282.bruno@clisp.org>
In-Reply-To: <201108121900.26282.bruno@clisp.org>
X-Enigmail-Version: 1.0.1
Content-Type: multipart/mixed; boundary="------------020302010809080303070402"
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 66.111.4.26
X-Mailman-Approved-At: Thu, 18 Aug 2011 10:52:23 -0400
Cc: Simon Josefsson <simon@josefsson.org>, Paul Eggert <eggert@cs.ucla.edu>,
	bug-gnulib@gnu.org, bug-gettext@gnu.org, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:32:30 -0000

This is a multi-part message in MIME format.
--------------020302010809080303070402
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit

On 8/12/2011 1:00 PM, Bruno Haible wrote:
> [CCing bug-gettext and Charles Wilson]
> Eric Blake wrote in [1]:
>> At least cygwin still ships with 
>> only gettext 0.17, because all versions of 0.18 are unbuildable on the 
>> current cygwin.
> 
> This is a myth, and is factually wrong.
...
>   * The Cygwin maintainer of gettext didn't put enough time into it.
>
> The other half of the diagnosis was incorrect:
> 
>   * No, gettext is not unbuildable on Cygwin.

Apparently it can be done -- provided you configure and build in a
specific way.  However, it does not appear to be buildable the way I
*want* to build it.

On cygwin, we typically reautotool almost any package, as a routine part
of building it.  This is mostly historical, but there are (still) good
reasons for it -- mainly having to do with the /patched/ versions of
libtool that we've commonly needed to use, and have provided by default,
on cygwin.

Also, cygport (the semi-de-facto-standard build tool for maintaining
cygwin packages) also typically forces updating gettext (in packages
other than gettext itself, naturally) to 0.17 at present, via autopoint
-V (our autopoint is hacked to re-enable the -V option).

Now, unlike earlier versions, stock libtool-2.2 was pretty good, for
native cygwin builds, so maybe we can skip updating libtool files now --
e.g. don't reautoconf or ./autogen at all.  (OTOH, cygport now supports
cross builds, and good support for cross builds to cygwin targets wasn't
added to libtool until 2.4...so if I wanted to build *and test* gettext
using linux->cygwin, with a WINE test env, I'd need to update libtool to
stock libtool 2.4, if not cygwin-libtool-2.4 which adds a few bugfixes)

The following ought to Just Work(tm):

.../gettext-0.18.1.1$ libtoolize --automake --copy --force
.../gettext-0.18.1.1$ ./autogen.sh --quick --skip-gnulib

but it doesn't:

configure.ac:71: warning: AC_LANG_CONFTEST: no AC_LANG_SOURCE call
detected in b
ody
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/
lang.m4:194: AC_LANG_CONFTEST is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/
general.m4:2591: _AC_COMPILE_IFELSE is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/
general.m4:2607: AC_COMPILE_IFELSE is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/m4sugar/m
4sh.m4:606: AS_IF is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/general.m4:2032:
AC_CACHE_VAL is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/general.m4:2053:
AC_CACHE_CHECK is expanded from...
gnulib-m4/include_next.m4:28: gl_INCLUDE_NEXT is expanded from...
gnulib-m4/include_next.m4:124: gl_CHECK_NEXT_HEADERS is expanded from...
gnulib-m4/gnulib-comp.m4:36: gl_INIT is expanded from...
configure.ac:71: the top level
configure.ac:71: warning: AC_LANG_CONFTEST: no AC_LANG_SOURCE call
detected in body
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/lang.m4:194:
AC_LANG_CONFTEST is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/general.m4:2591:
_AC_COMPILE_IFELSE is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/general.m4:2607:
AC_COMPILE_IFELSE is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/m4sugar/m4sh.m4:606:
AS_IF is expanded from...
/usr/src/packages/autoconf/26/autoconf2.5-2.68-1/src/autoconf-2.68/lib/autoconf/general.m4:2591:
_AC_COMPILE_IFELSE is expanded from...

etc etc etc

It's this sort of thing, every dadgum blasted time I try to build
gettext -- whatever the $DATE and $VERSION, that causes me to 'not put
enough time into it'.

For 0.17, it was the need to modify a bunch of the gnulib .m4 files:

-  AC_REQUIRE([AC_GNU_SOURCE])
-  AC_REQUIRE([gl_USE_SYSTEM_EXTENSIONS])
+  AC_REQUIRE([AC_USE_SYSTEM_EXTENSIONS])

Not being an autoconf guru, that's what google told me to do, to fix
whatever error I originally ran into when re-bootstrapping gettext-0.17.

Now, concerning 0.18.1.1, I have run into this "warning:
AC_LANG_CONFTEST: no AC_LANG_SOURCE call detected in body" issue before,
with other packages; I know how to fix it -- but it requires editing a
bunch of m4 files.  It's a PITA.



Since time is limited, I spend an hour or so...and give up for another
month or seven.  This is why cygwin-gettext is still 0.17.



On a wild hair, I just tried running autogen.sh with ac-2.64+am-1.11.1
first in my path, rather than ac-2.68+am-1.11.1 (don't ask why those
particular versions; it's what I had available) and that appeared to
work better...crossing fingers...seems to be MOSTLY ok...just a few
worrisome warnings in the build...and it ignored my
--with-libncurses-prefix and linked against the wrong libncurses...also,
I wanted the java stuff built as a .jar, not an .exe, so I did
--disable-native-java (but NOT --disable-java), but...no .jar.

See attached build-log (and test result summary).

Now, about this:
>   * The xmlFree link error is a consequence of --disable-auto-import.
...
>     But gettext's configure provides the right option to fix it. You
>     only need to do "./configure --help | grep xml".

You're basically suggesting to use --with-included-libxml.  But what
that demonstrates, is that gettext's internal applications can't be
linked against any external DLL unless that DLL either (a) follows the
Bruno Woe32 One True Way [that is, libintl and libiconv alone, out of
the universe of cygwin DLLs] or (b) provides a fully declspec(dllimport)
interface in its headers for exported DATA items, so that clients need
not auto-import.

Now, DLLs in case (a) are few: exactly 2.  DLLs in case (b) are ALSO few
on the cygwin platform.  Apparently cygxml2-2.dll is not one of them.
Neither, unfortunately, is cygncurses (vestigial and probably bitrotted
support, kept around for some future msvc effort, implements declspec
labelling in the ncurses headers, but it is not active for __CYGWIN__).

However, libgettextlib did link, successfully, against libncurses. I can
only assume that, simply by luck, libgettextlib doesn't actually
reference any of the DATA items exported by the libncurses DLL:
	BC DATA
	PC DATA
	SP DATA
	UP DATA
	ospeed DATA
	_nc_* stuff (these are internal symbols and probably
                     should not have been exported; call it
                     a upstream ncurses bug)
-- if it did, then it would need to auto-import them, and the link would
go boom.  I don't like relying on luck...

(Downside: libgettextlib linked against the /wrong/ ncurses: it found
/usr/lib/libncurses.dll.a even tho I specifically told it
--with-libncurses-prefix=/some/other/path [I wanted to force it to use
the wide-char-enabled version].  Sigh.  That's another rebuild cycle
(which takes forEVER on cygwin), after tracking down WHY it ignored me.
 Plus I need to track down the details of some of the test failures.

And people wonder why cygwin-gettext doesn't get updated often.)


--
Chuck

--------------020302010809080303070402
Content-Type: application/octet-stream;
 name="gettext-0.18.1.1-1-compile.log.xz"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
 filename="gettext-0.18.1.1-1-compile.log.xz"

/Td6WFoAAATm1rRGAgAhARYAAAB0L+Wj4r5XRiNdADGeSRK2Pgtv/vV1RxTnzphKgNHjpXPm
JLaEgawQbp6V/W52Jhd7zjrbEJ9Gpb95Q3sXWCaFPMY+StBfEdqyr9YlCN2cDUZtU+MaS7Mz
nF9QGM01PzKue/G7S8AasbGfjKvF2+VLXKgE2hC3mjf6VFSI7Pbfmm/4NfCtINTtOW/SAFzU
lkxo7LE6M/LsgMUh3OcaZSMvPInmMflI0JQlK8jXaymLbUcLCXSC/8fk77Ei63GQODP0xE9P
+fOJprsayqsLM/HzrzNTjVWlwrGAcIoqtw/dB34i0bIdtUoRaNMNTFN1uBGtNOGZl5SB80Ys
qPFlCdPAOex55TE21AnNMGWzMD9bXUDg/G1t8g8hg35kheca+vtvheox8XctATqRVK7tHlRG
Tqux32gQ47vHNk18CWdUwjDAgr6+J+CeIIzodiVSchrfl30KA8ZaFfWpkceiC7cFgMeS2xK2
kmiKM72DwMllROvwPx8udZ6ioXM8/7H7WJseKfA+N+E9fkXXqrNo45rpxzjbgWwakQE2gzo6
ZPfgaqHC+r3RpeUyzs0znwGdwHmCnWqWZtMp7fgXzRRiWo+Q+h6X71Beam6hiUIc2DuoY6Sj
ZdZOR0dLGvhIMuQSnbTBn60/MX9fy5EUhEwW8z0hElnKGH3so2OlwTko5HMsbHUlt7EVCzPc
7yGopcFghsOI6OATtjEzg1/vCCPqtfGsxLlgyWJvpfUI2+bh+jErdHadEF4wiRPEtvy3udqE
mmIuc9oMhhDoWJm6q7ZYbDD+edCQGhBNnDYs9PiWLxUZ9et6Si/3plh+OzOpGNJs/+Dr9gJL
YBiO1gVFnlYIXhJH1qoJoKId2nDM6MHPM6nTEUJYE9b3uFCJwV6zw5BE5OWSPtq8iUu70Ccw
NBvdXYGhgCONv0K2KrYmnTx07VQQ1NydFv7xpedkVCLVzJct6y8Ht8voL7nrwPZOFg70LGoD
AAbEY5S8KAPo6WRGC77P39q0AZoagIkoWwH4uhKcnPXYKUNcKe0VcQGlRWUbo83Wc1SdQeIQ
lXjqnfGLNS9mwDtoSa3g2VXyqwRl6yuziLOK0u3kCq1x6XwliA4+RCSj9ZIq1foWEFDf3Oks
IpwWJzPqYeNsi4LGS6E/upe6havwWoZLDK1hZt2/lXhGysrMbztaMUmP7OFpoO2LJBgbic16
Om1qXn/18vmEVXXPWR5jBZUwc0asEmEk9SKdpCgw9C3HDxkpTfpR+09RJ+UkgqF2JfK64KYU
hojEqUU2FRYliKi3cg8EmFG0Babf+bL9igvXnu4MoU4YADQOdZV9fF3r9E/n4FfrsphgRYYy
oULRwQZD6zPAzmU/xlrNd1hNIxyPq/JMB2E83OGu37GrISrRIt7kmXS3REl6rKtLtnnR41Fe
326fz6yW2zQY/aFyhcZBP93gk7UPe0vUaZrrIiqnVjn2vF2O/05gK1pjk666bmEhQcBjLFto
0kbdDesXobZK7Oase37NOsejwgT6Fzz0bWdOS18QuJfp8WyYa2F48lgWYhUrDTPHTu3KkKI0
uBcmPYDRi96m2O05d4lg4tMBJuhC7iRer8DYmhXkPpBPKeQvVji1Y508Crif85XovJQUE69t
6HQ6JyqsjAMdHuUwPkqkdE+37JUR/nU3WqZMFiTtSzdr8JN0QcMCX/Xp+LhvrRPN/N+WtHqW
Z5FDT/k843ga30vw1QYt+DM+0fNjiEQJOZx3kHI4fJfS6VilFvv68rDdrf6Uc/trcbWHQts+
nMVugwxw3lNNITGe8waZHucOi0PqCthUUa40VjHQRN5U5Ui3x9ZGNecu84owJjeG60hm9CFc
3UIggMxfiAPVmas8whBe31qVQMoc1Hi59wi/vU4CAhuAI4DLtp+21sINPJtPXA3XiTcr4orj
gZmV4B87L2lfPUsyGGukgkJLOHaa7BKYdJLPIRm1A9mW9c2P0+KrT1bcNWgFSIifLI7eOlC9
N8K3RJ1lC/G2UUmxrixLce2NJEnpYNO9IzS7gVkixx9Dk+miF5e30mPM9ODeA5f+2kCP9e4l
FOBc2kjoHNjaq4R6mPyggTYn70RHJ19EhFLuagFISaggD8ZScsqsAJ5mM8tj3/d0hltcHsyV
7FZWaOrEtWNCJ15sMX3V8xyIy1Gb9NePE2oemdzFE7f+FcDn60iHmUF5z/OPBwCdlMgm+cs5
ZfVSJovxnbxRMHEYkPLO6Jc1ZlSfCa5feVZb4kDpdoVhYKDQix49+Zxe8pTVwlMYxnLqJ0mK
U2nk3ribbChqLUF29r8ahVTvoURMXpKKzYHKopyONZ4duDhzUmIE5FJVFVvbx/ZvlZf4KV+b
gzl47jqbRBZBsxpkJTD3r5ENmOQJ/HWdmw8whw+2do5kq0etIWFMq9p/+1VvtaIDtbnDFGKa
8A33TK5/eXhGER4md3cqkh4BJ/oQckK/gIHJzeRWtsWm2siawrIdngca6ZZ64K7vYgLIqbub
0ZuMNfsy3djpMAbeqyjh9g8pDu7dkSC5L1axQ36EV72ZAPhx3rdlY69V9neWwNgdIyyzjYBl
ASnDCPJRWB/CQbkkt5tHAcgUUIA+tcu+Dl3Z1hyLQ3QaRvmNlAhvXPM10lDDIxhYOy/XfPUQ
3rktcwwZp8cE+WvNM7UFiMeKtnVTkdKTmj17dT9EmYXvDxx8f34CyN42Gm8/7QqVCoVon7Z3
QywpIuryt/eDkzXo7WYcTxlFQ1RHDAbP2XljSuEngx6tCyWuRzB60EBvJrd93BTKqAjIvdFD
X7AAO4dgLofmsVESncgOAajrErtSNrMppl5BZoaHb8HwIFmFLW4oTuy73Fp7kjWcn/aQUB+9
XgwC/2VIcWDmtm8y3ReT24DuHRe8bW78ma0dbNmrLdw+3CmNEommMevZoIQAKHp1j402NRFh
SwE5ZNPyISYINrhfWdTTnNquGRzGHBqXNpeAwVVM0UGo9ELQOOEK+0g5nbP6VjDFACIv9zXE
ic7Ga1t5Nnn59kc2dmu398mjVUFlQBn9fKnBpKxWvRVTrB01Twri+WRMiBXypK9ynVQrZqgZ
WgHYcHRAKbejmSx+XdDiszpVwzL5meJvVFd1hzRx6zTKjqsfbr4KUA6ul0lM00MuZwPzEXUr
qX09Q/8fCUIXz/dPsbJ7T0+gA0udx8m50TFoEMryhq8m8BzSZQk/hSgm4RsifmMvKQXvziPP
gB62Jtxx1kNCDMjeSC+ShaG2Qo+bljCcJKCjdb8PDxIER5Sijomf/RQf4g1bAk2Z9Xw8E+Ca
9r1YUNrKPLlq/LB+0yNVpv7eSfLyZfNkrXYbvNtn4elqi+RIIY4DzgNiUpzJYWSTOlWEDxYa
ub+Y9xLF/qAboY6HE/HgRgbvTRd+ZejGS1GsbZ7yX21XxKQtSU7/QSVZLD1dOiU2rHz0i3tz
KZQPiavJqdX2+4L3NZ/xvO6u+Ij47+XeY7jyEegV5z0fw9ZG9vn3+NCML3yr/E7hqL+jIpZa
ew2NuQW1etBGjtJKfm5L0/VlwFkF/9k2PP4BmMc8GyhawsbK0qxfkQASPLyenNtFwulKQZLZ
VX73Froxjw9Eg2qMUaEKLR5+9gV/nWZIjWt9lcYCLe2dXVEW76hhQXsEQs5auO7koPjAJhU/
iUGSmZLTM4jV5UVtQy3MHY9cefWXnpQyR1hXf79+Q+sWakuib7j9kpozWSlFvt7JjwGm0WHf
g8uQqKTHBgtK61z5FH8DzSNB5qT/mfIAaddLEM5LMLRmZV5AnMJWfzyr3f0gd4jmWFmflnhf
VFdQrD6nF9CUYCiwjwpUaxXh6ayFcX+bdqJGmfiDcA8/f6HjFxoujw0hlnyQat3wNgxWNoAW
Me64gHeugAOjiTLRlBzkaPoe8eFt9vGiEXj3C/3LDxHs0qnGYzPRaF2/jjt2fXEbU9uszl3Z
QOYzYCj/i+6orjXRcq9PLHHCltNOxo/PpvUMVG2RSS6RU7/Q5VrfLJ8cktwRp3h63DE7CQcI
gQ7vraQXn/cu9AXidF6jejRA+e6WEyGX12NcaynFMfns+m/RZk4au6Ff9O/N4BOwThQObs6C
sk6ZWmQgR0yctlRWPqnxmjS77NzjOGJM0KEkAck2uJJVKDKb4SXQH9JfVk4hmFK1qk4lYE48
FyNOsnr2VSeToMgTw9kyiqd+ria+eY/UwGA4S7NjAPzmhW1buMdt/x84LiSLlL+pj4vBaM32
IS4sdFkIZ8iUEs335/FUunEemn8GtBf3Fyw8LpfYAPBVLjlEpmXNV8OOjJZ+941pgQLSsdQA
BvW8jmhntOj63uiJJIcYUKqSKO0rAHeOTw9zRlukZTX5TgHwcqnFCKlVxJ+14wnXTOmuhcvg
1T+0BTgZQDIEsZ82J+rwPie4QrfhfqBlleCfFmFRXXkI5k2tgRT7kkk3LI6a4KRsjWsg90fm
OykpFNlEcBlWvv3uVrr1ivcvPMChH8dtCy4yiKno44ZDIXmwK6o8xEOgVt0IBb9ehsqZZZOx
ZQ5kT1Ax9IZMUpbBxhFL4K3q/MSCEg9Y2/jmy+4wFRalaXn7gWVBOTEjqFMgxppY/N/L1h+s
6Wset9mZhuZ4t8ztSsUepq1hYBpzktImuXoVjccdYvtcVWHV98GWAwsGNwAqlAxdEPgGBRZp
bPEgxv9CqWnRg/9u7hs/eEATBhNisHVxDtJg3InxOnDQ9QNv/4UhWsIddcX0vBIhnvhj/gr0
B7XJcioSGNHR1rZ0VhAnQ+WVVl7lVuVmXEn8/GS+nwudIjvQj6b38IUcztheqPcja1EHvYM9
eYhPn6tqnS+UY9rTs5wCz0/sUGhCqTIqxAyaIYttbIVfhOprYZFMdZMjCYBVQ3kiEBpM34QU
13j22vw6d3c1unU0sPEs2X4t1wEYGDwDr8UDqszg8SYoh5UBXy2I8t64BVLtXajG0V/l+Eme
jloJ4LNYmfq7OaeYDoNvNYbpNNyhfgXpdX/yJ7N+mL1p63Qejjv4879AGEM2r/KC1ANqNgfs
YNdO+DHmTC9rVCzs25G5Xp03hy+WiBoTKf2ySSNlYeWIU+/YHHzKFqpL8Vv6jPL3ajNHcc0c
2QY3yTYY2qZSo+RyKI3kfiEe7HyCp172nNo2iW1zWnJoim81Ur7TV/b278+w1bETuPMzVuTl
1cI5rY4wOGAeHQPZOmyARnGG7IjDGACNXYVoeLyCVid5TaveGz1r6Fd5TY734NxsTAqspcUQ
0E1eBqpA/TSmGbExFtJRqQANrJ2m+8lKK2x85VQXHnC8tA9HSxpLz5bj3SBCzPK1fZEJKdbV
tQdDpdmerRKEwfpwvFNtooBzqDXoKQEJ8m0trGMz/djDnasewNE3/djuGqVa+otWwYLFf8di
mOmKMmTtBbygiAdXy3a4h9GNZaAQxNtIziEKsYUjWvI6dGvLxa9PFrHqThNCj5blXpPQQyab
dPQQe5a/tHYt9lGCa3JpL7hQMgbL1ndf/e0QJcFvUBI7BVXqmsrsmabU31k1l1NjrG3+0s2Q
eHxbdomUvnPI+Op0CIzGiognpNuhRRalshWTR6i6p6PMrVGMSGsI4gL0Y83VI4b6+n2uHtpo
WFiy2ynY5OmgVirDvz7cA5OVS2WU/FWrvV7+BE+33X6N+a72dMrKEngb8Z3dkmuC3wcl2KjA
3S3/JvPHUKiSjXZveWLnX2a1/b0E/p/PhQ+58HvMJlx1k6WV2hb/ECvCW0vc2Av49eSmidyd
ByBYsTLynnwRa+OSfFsrewIq6N6M17uzh9vPCYSPD5UVYMevZ58mc/XWurmx4NM2eEgdJQB0
m3l7IJEo5hcJhgJ3Uakf3wxAkvhi2PltpJOvNtIwlZOAwJZiUWeSD8arvDD+4m99Ca7Xx+0e
9wHSDmoZN1yEXfeeahWn/WsVJCOtYTCI8YfXVY+UaQboExRjWfts+swZCMEjPgGkV6tAVpWj
DhbdTvRWlpHKOmVc2Uo+Op+owGh80xa+ae9scvg4/iwtovNNoKXSCHeERqGDZR/ta4z5xWh8
6Kq/1QrOn4gi1+RoSp7zSedX8xI+/4WdjUnEQHl62fUk3MlunqfGWKNB94blzT1ZzKcpmeMZ
3PBSm2ELUM7bI+MPLCt+SlV7FowY6IiJl2/rUKW71YedXfb1IWBy5a0MVRFygTyeRIob84WT
ZtjK5EY+1bzedWvpfUGrz4NRashTnkblmdwB4/WzdLaby2LNURqomIRDbs3NGMsagj/f6EBY
8H+gAWHn67zwVWSYmW0Jfuso/zLw/IKUyPqdQUn3zw61VW9WrgxUfwCtEK6MV1FE/llkvrMv
m+jcuEaMxAeT7FE2DEG8/gv7D1TBaxpMbKi/xsa+nDB8b/CAyIgJHKgXrjvl2a/zh2lQQD7I
xmBfub5idFJ31QkpN6zv6tMvqYjhsnOhjJjqUFmDxvPQ9RARomMWGvi7DUBR26aJQAA5uGHN
gRJzS+ZN8GfBPWhU11Tyb2xeUTodDRlewGF2i/zV6X0TBGTyLzI9e5iUmW8EMcSBVuEtwava
DruUrAUQSmK1RxaBBaacgTLIiT1dUo2Q0C/e2yt6gWRG8DejmD1H7nOJcmCMxTjRfc9ge7ym
WGBzdpmHUH4+YHaduZBkFuP3dwLd7hrvWsQ0gVVwqMI/NdKu+gGFpTqVeytNGN3ppS+VFChJ
yFsfmnVhih0uwdmS5HNJp/w2Q5UJIGIZath5amaV7IJdIipqgcwIwfJkRazmsH6DdG1LCSQd
1O1CHg9rSdk5spi/E5sepD7linL/0MTtnsfsuuHMpBCltr1TW7g3xF0MAG1NIq7g6iR6Dssz
aks9zwE4VXl+V1LP/Dd+kdUpiXxfi7jssEQIzYsJOW2Bd2B2TclQeq5QhbftQBrEZDGsFTD1
Rzx2FVbWTghbXt6Q50z5rkvPoWU25D+I5Xg0s3nGBNqX8vce4CDLx6ZA8+KVfFvNqMcdkEsj
B9tFNhIQeGZ1b7Tqsr0UXqduIKFMrAbbzMpC7yhbrAxJdNl/f+cG0VTV6mUAc5Qr8XENLlgZ
k3bqe8y2xy3ofbdfv2n6Wn+bntk65vHZ74NYdf9kas3rSuKQZ1TpLCvAK62PJMJBhy4noHwn
6tCMR1ZZeD5243fY+CG3461I82gtuf22Kanwo/K4ikfz3HQch+UfBiiU5UPPc3gMCvV7LixT
6KXl2kZHhjh4sHAE00RiNccOPeWqONOn1ib8ztwd3hCat8Qrfp0DSxxaoe5BaRI3XRZo68oK
p8b/kAx8+0JzaOBV8WdUstTe07dd7ilmuYXjTPRrPxqf3qx7BmkyYKhBS70+/G4HAfC5lcCy
95djTnIsXdNeRb+65NV3EOb18Qd5ys67PBvle3JOPR0AFZRfd+eUm7WhOPXZOq31B6n6nLFj
VTw/f/3MIPK7V8xJ38EMgtPlkbBcOQiPefQlo/Iw/I4PZivo7MKvAFyhIRsQ8q9G+5oACPZj
xOkaq9uiwx28N8KvtkZLwf5v6yNTuZHMI4bvj+a846DVvrkfjdZ8LbnolKAUgJF4+9O1fHi5
eblCq8ZmR6iaiCUs2fj4Jvlbd8zPE/1LrzgankIsUzseuJIaEWvRVb28Rh4DkWyLVxjzLgOQ
BqK3PYGYlvzQ36PPAPQZYJloZRg3KeylOOuM9KuwgNaHxlUdyE4aE2iZTuBlm6dlbOxbXZFX
fQKKJmFIt07/s+GVoym6QSXxxa2+KAGtugod9Vbs1gXsDw+IDuHPV20UmFbRZNLmXHIh1bML
Y2yEUjScQKKRONyPLVVct08WUWUvACyZUJgykErGDO9oNSV9Ul8+LPrNKhKf603bj7gnYhEy
eTfegEzw3vA+KYLafseOdXRTSA5BwWiAFfg79G3suAYJeHeX3MLUezEkhLfLO3z/MlBKENKF
3JWk/C1lBTcm+dgp+YBSLskuOkvxWsg4ARtqSwcZcsZD+6MYJlj4+uAGGI5Q60lzqStobJ8A
vtV74wl5ZLbHEBwEdFkWBpkSKCM/0kwslS8ve4KNWMUNlmMi6NVt/O/PlP2PZIqdFBvsNCDJ
W12cvs9/YppDz/B9v45rHU7gbQzRxVphyQfLyBIBKwZ4SdbsI6Z+eqmkUmcNlZmHb2PfmrUW
xiW2sK2lv3D8Whf1uTwYHeSaEVrXbX9sYwrOIP6wDBqEGcbSkZOp4ZLNNCm+k9RDFLVgOoZZ
iTT4IwvF2/uwyHtOKTYMu8HODurfDQaQuUYaXyKfD703GX6mec5b2I6KkixVqqb5GKUggvaU
QNTw/+RP+lYaJ5x0WKku3YD430YCQVMgYl4BDzobjGSJXoE6ePIBWX+r7AWsX7+VRM4bPUs7
ureks3yZvrrE//+zEUh2x8ofK7QjQcdKEqX1zNhQYgzbwwkF9MhrIRa1VDgojak2727Rva7q
JAIpyEet8KZotXL2/E50KgdGSTA3vLamyY5KeX4WRKlbOoS/OQTTIoSFtsfETfUaFDLT0Idc
9Tkp7gIwypblNITGfDtDCs2Zi57MryW+1lVfQqhFSlyzpDPFwJ2k0QlPgTq4agUpw83nv/Iu
ZJHvOVjMHkTL5NuENxJklLBv5G68dzsKso54DdavdDeRtZ/6ZYqTMo06RFkfjoqHhVTSk/ou
W1VFMR69qTBrYQCl2uVQ/RAx1x/MOBjUGh9nWwRhQu2QLaSObV7c1z9wvsIp6CV++FQZF/UJ
4PJD52WAGKa/1bU88/tdo20x/nXeSegSqD0Ps4/tmkuPzeQ8LEo1jhWIKEWH4ZIIxgkINBQC
mdWizLSbpNH224JxpVkH4xcE18EE58L7nbwKjaNIVW6Hivw2/obi2wnYfzoWrwsr8vqk+6VI
Z1jkUDavt6VnbYBdU4gE0nsA69zwMf9PMrhaMyjlyx6lVTx/KnJvBTPXL2zIQbbdxK1sqSfO
D9rqAwRrJZ65TlFl/wKh1DcWJwSf/HX4Xpifk3G7GglHlYT3gKvbTuVP0kflJxTvfavGlTzf
LcqjcVi72nRqrMEQygb6FWHo6EanC0bhYqj4iHnymlduuNogePkA3B9SvznYJDUByDlHa65q
FZaYbhO9CH7y+wtkYvhT0yew9xL+XD5SMEPgZrxApXM2O9BU8v45fJlNj2OqRTOO4G/LWIuz
GDDCbEhn0XgkXe880wpruTimy0OjpvnHDVgKElwvQBJYOuHejbhJnlp7bSDg/iegNJw87Tyl
KtT9vchjNXenAbC8aTg27I6q2qIx6HcEVaQ0YWcEm3EMTMqjHAr+qZc+OCj2DZdyL2vFBQBl
RCo81gYL0eLTrmkk5k1gSC8H8ZM6cPZGuBRdo0pe6KYkmpltLH9m2aH11ofqp/eSiGSbCJLM
RWQ3Id+q2FOPcSsSmlBPi1oOu/EMUcGoOEaomaz5lYDX/D8vH4Tc5WCBPoWknEZcdRfqTAcd
BQl06gzadZNzXgOazcbwjGCR9QixobJ8ip0yD0E0TXg1MoId83sFDBn4JvW2i9QM49/PeIKw
jPdCgComOvSV/Yu4sAEWBbiOIZZ2kFVzVb7oCEC8FuoA0JMKEU6fgTQanUKwY+obX6vPhX00
QcoSTQwsa+g/1vRI9wuh6BdvUwtd9A3brqHODNwdMR7xmzNI6cHQciS9KkhQKlI6ElVZwaY2
VCTexAhL5YhK9t1XtzWgxK0dGvzafdWL1B1rEt3Hf3lCrsSpu2a0vOQTgwmXx0c8TxgPEJtU
zlu87+lJIeC++fZKvscGgh2GClVEoL90xcFw09drej/1BwUHLWZAoSNp4qjoCHtr3fX9pPZz
N8ptupKmJUL7fXJVRnLn+uWKVXSz08zbF16dC68mTm5aEPWwK247Yd4XNgWCOIC0Ixn3i9Kd
LCeNdhbCrUSOcA5o+jxf9ZeG3UIeQ5aeTcNw4mEqcspyc20JvVhQ7a1v3bArOK7D1HHwPHHU
/Jp/Ixp7/nInAbPPhTvpwuu9Wbhg2E+jIwH1La52TzsnpC//0yufPjsDJ5bQYEPjzjtfrZCl
sehACWqR3P1X2220oK/CuHqmwx0Ic0OorUW8JbISvjs8BIkbjc44mJ6xxflBnRvhKeKaoZlb
l/VCGCssTWXOiAKz4yiC2AelZv6qLuoeS2SElbJIs5noC4eIMavzd+/mSYFPDaBTNg6uLzkF
g3GYybxTZ5UEDoLfa1KTaw35LhETTJLsr85Bm/HdpFWC5NMoZx6EBcszUSUzKUlAu4B0ChsB
7w2X2zkDfOR3iuubZgJaqjBV1f5Jotoerf99Mc4LXvTLNK6Mr85D+WNsusU3oUBfgV4Y1lWq
EKZPU4W/MdosKjeyLNfV/pPDBNQ7kYJkpYs2SVvp5qEPKu6oZi1mVMApGzr0X0O7MnWHPrgT
x87xHdP7EsK/2brKjJrwDpgJAE3dboJR0w3TPXZF/Fbdtiz6Q7nLA16OH3lTpw8BLQyMLUIG
DfnWCRvF/5cG1JEsnhHkmIi3RZURZlJYvzmdIIyQN42cRr895sMtWijCgitZRehODIVJGJ1O
5/ArKcUntdHu0ddMHmgUPs13Y01sB8cR1GWKCs1vNcZqJVmM/i2kRK2Bsv03WhB3IRZXglc7
eyoRByzyaCa3++jVb7Z/PqWqwSyFnX9NhyBX97KtPOojGkFjMLvIXk74+pydz/qulLwWmuyy
Oa7Zf2J2oSyMhB+J9xhP3GndLGSr++pIuRSt/DGMqPK5vfBwbEmmSIhyoHULYot0UMJ+W8bj
AiroE5HHTEF6evbXLqqPPY3Kf0DnaHa3NkuEru8SRq1urHa2nUfF58MVze92F5jZ+Ko4bXMT
ZSLoz9nKxBF7ZI1tnrKNU6pI+OGwDk6hXyt/lS9dtpaq8gI1b9e8SfgdNPx28xl/PY4FcS4q
/H/cTE9p3R2OV1BDGoHZ/zM6LOpnYgJ/EeC/fMtTLNI6D+eX84aKcEj7/H1TVjOj7t0oq3Z2
Ae2nWol4+LXOiNB6kv8GoELowYVK5nv9YUyYLz2ZI1DLGqaQ9Wke/cDRJXtoJC6sk08rTII3
TBPkLLD/Ou81N4oXoB/u9p7gpPEP2CgWhgTPTOINZshgDJKax5gN7zAPrwX7Wu7YmmapNGQl
tEWsC6Ql1zbbzz7VjKYB+pP0rRUAPDv0m18ug4lC+YMz6zdnjh+0wuuLyaxoRPkjvsRQvsJo
oZ29+78Wi5ZnuzvjiJTMdoYn0h09p5Wx6z5FRHsXrlsKJyxTjyGQ8Jd5usz+nJHKWDuvSn+u
THtaipBwtQKuTompx/KMj+WBv114VYGqU+mUCajuexf3F/6E/BiLrs/KOGQoLtCDcsbAp1x2
403bvDpshrbgREByH2IJHuBkFdmI/YqgovRkfz7Lje4Pcs0rwHrxCEz1VjO9W+u7UGgtTG0g
yZ9ZXVCask7oQ/RevyW/WhPqgGBEA586GtCU0358noEqOGMwAC4jnUaUIbSJPuwm3PJj4+fr
DPJytM9RLjA4Qk7fQWcDezWGxMbsHPb7l8O8u6yyrXqDj0wpI4aAvQV3D0ddpmkcopj/3I7v
M59ZN4O7bHBiSitE8G8QrtsxC/OpLmycZXylubWnO7MDg+Afzk4S6pPb+eRFdMtA2WFSlXrv
pkJd275tnCSkVIGew5oH9i7PfqOxmvxbjBD/EY4hUiObvIMTIG1u3uQd/lUsILVWVN9dXAs2
qLFBtTuFky5jX2cIWmWl2UwKDnE/r3NShpSLdHbmAdRGod7qfD8YqkfNCwZ1q3tIVcXbc43J
U20vN9iGJAJW/ai8X2jWczBwDio+S+nRcrA5kUKK4EKFZQPWYUzDrC32LjwjJVx/yr1/QoV9
3CZRL6WCe8UydPTUql/JsGSsYvNXYc2YEdlvHyP17JdwJ2tWXLJWSW272L4626Ehqr4uaaz8
jq4IsqrRmynYNk3jRuWJ0Y1uSGJA4OBYtwgozhurUgZ80zGXhkXWq5U51YBLRKsHVf9elBuC
5cjBRSy08mwFIX7EXM8I7WBv8XrojgRCm1OLo3g/Zi6xauQKtdEgXlL5LgJHjBNtpX0zHm6s
78VoXhjZtvup2k81Imc9Lot0dGLHlrPrw4/Dbm16B2fw6n1Qe1Tl7jvyMsbUeBpWt857a99O
YpxBsDwMY2gRe8awZlxp4mKu2iA/svqDJVPmBhN5S+D3LwO0Gkf8kVHf489ApuCxQCAP+y/t
Cs+o7WsiJ5TeCCO6pOVeSyPWPHEujwruOhUAon3RGiev/R99RL6JibEruAihpR3GpzM9y3CK
HiDSVwp/9nbvhv357auIIoONdgyx3jkLgkzUOemyQJ8ImL8p1sMIEj6dyi4xVCJxEzxyL7AX
LbUko5R6aMaAc97FTojRW4mEEnTBpNq2XGHGSRjsMfb/bCTVi+UqnqSim8J1hIsjNxRA5V8p
AXhRCblGeyzO3OOM4GMVIkcfkE5fWDWviA6q51c91OQvbVQ4lErOz1Fbx2WqP29GLtSeyDVx
L2nOGlmMG8DYt177WSCVnK99OBtQiOM5LcOeIQ+VZafkRbjd8tXJMwXyHrNgkFXPzwTwbWXc
zq1IojYdSGtEeHu9gT/cyN9A5bxJCa3Jfb14TU1QidR6Ba6c93vy8sKonqxl0gxSo8QFnXQr
yvJZ53IiJr2Voe5g7wN+UAc1lnqJrF1o/1RMNy5nkYBjw1wUlfXIDaBFbpd1QSuqXhGZcGhR
XAgd9OxKV78T7d/tIB7V7SW63yLFGilh3MaEloamj/JrEsE8kkuYsXaruKg7ExB5GY8OeJAg
U03idIiBShzLLD7jBk9eWT+N+BBGq3KxvmSrcSKzC0s0qf/BEyFeJ9OkJvlHxFMjuwguvRM3
YLAIWiVo0nyfzPh74SOCUesCR+laJz4BqE+GnEViuVSmrBRC/KpBeUdEW3GWGF3p+nKw7AqO
186qW9vtgEgfOlHJnhattLlD97nyJaRLAlu5azjbxaELenM7TE/kYQUNcqNoDx4b2J+aWplX
EPVVV2CPiFpyzof1yroKRFHQjkAWvJPbgPwsVvlDqddfdyEZDV8gz2U9xL+CYm3+nhH8JCk+
OGqVwzrCQ4jfh+Nv3fHdNPXe1vlbSbxFqfce/fiG41g/qSB/lfIeE13XeOOQWyl4BWbH/hgX
MJMDB2MbBYDWk8rqytSlb0SC1dwTBp8s6CxIrc6cUuq2QqOZ6bvH2NFsa1hKoeTy2CdyDo0C
QrJQHHv8iOLOIp72dTR5weQZLDV5NwtIPlvADbGdCe7eCzLUhXy+bo+NKWAwfJDGthatgsz0
Vvi+kkQJCPgKPhySyNg29MtimCu/A3lA0U/c/4N9IPvAlbaGEpmRDnS5Yd5KDSHWEJ9OvqTN
JfmFK1fjhqw3/V1nOuDvkYWLeTv11IZoR03fjWtsWki9TZvK0ZAZyM8LSzt0gHJobIleRwWO
X+YMOp/PcarSgDlUYLD+0r1LWjK1G65VEIOWqEOOybvU/6fhuLYSNqEEpHRtYgmLBSrXy40z
wjDSflukOA+a4bRPaQnM5P6LBTBbsi4L1sX1AcSJ8EhINVf8Esnuv4Jnvcx+Jaz3NAXaqHBl
uxtjUYyVFhvjGGe1l9EHwAqT49MoUkc9jMNTAhyFEt0AQmWLbTHASUVU2zqObARpdoXCFxrR
vPPxStFwO6r0er1s6bp64Ul45h1xTKFI4CSWya26uz2J//TMwuSELxh3h3XInRJLHH3VBcr3
rXvfudg6kCeJIQmvRPcN8VB5QjHaNt5odEvjtJFgtg2qKLMFv8mHlwaApOc1Rj6Pcs7PyrMv
LL83KB+IE1Jjon1IZVnlKh0Y1U6xvXZFOEpjUixbXuAYGUmKiIhG/+Xj8gB5f2wknml1j9LK
95aZDrNFoykKv0KVZv3w9e2U2dDOtSOvGFHvA3kltjQqKh39aOgvDaBpj7ffvz2xG/fvZpqT
PZUf+gGeiI1qEnPBBBODTAkAz/vmkj+to6p8pT9cxcciN+yInPJjn/fd564hLZyW5kiwLxpj
hNb9/qEqIYFwcZWTOZVTe2XOTQx7Xc3qhiEPRU9Fn9GRJJu1ZjHRrYYHfo8AB1CCZ678DdwV
kCqqVLFmbaewcBQSC6xvUMS3VhtaGdlfsmB/xYFWyfCIQnpIpHHR7Vdi7+VbYR41AfVJXJ4h
8ZhGACDlfJkKuhda/Z2py0Rz0bmqkZG7v3j4iiz1cfr6Iw2l/ZyYyXkVzgl2OZq9gbka+5Wx
OmkaDpcj+e9B2rDmwQwzk4FAZGabMXNtJlLw4EVNoDvFsNAX1/JR696u4PmI4ej7BG4WiCpW
eF2IuRA2M4doWoyUdK7U8EqXlMcokkwJWk0Ed53OStlvtGTP3ZRT3HBbFHtbXS++NDP33JRM
AmP5qIf53HS0WoMW4HLEtdxC5YeVw3iXe71ukZ5a9rTL1TUCyGCWrXnn/1Zvkbbj/RxSTq6X
JDrB8nErMtYSWYqcVnvRpAY1kq6qQhe/teUbGNsYmvZKu3HVwVCt0zSPmeUU+70Uv3cemBMt
TyBt5hPsbI+CprekCgFUHuicXSxB6IN2vr5E0cPmQ6X/TemVvUIg37VX0Oi+uu0TsqtrM5/V
1aohznLKWlB626pIKDcYeszONA2ccgM0iIYv25hv6DxwnP+0Y214VWh/IyjsXrT6sNDXaziK
qVLVSgjgOa68tkJZA3Vq04sJAGRvjPki4P3Z1XDr1SgbMIH4LL/lPb/k5eXEZICtcQMDY8dF
YvQaqd4ymL2NnDOkg/WPLrWEjDI7Q85gmiCr4IERrLgM208qTErBFlL/8vMAhrINzR7JjyBC
1R/y4D2LvXILGVCMmCfbrFQmYnglc1trQduNWu4D6u/oKhfJUU1arhWupoJ5lKRa9VuJz2Ra
N4O0BJ40NDQLIF6aikRWFx9lIe0AAhvrPga+5DJDuFlMnmNBVsTbdtA2I6E+28y0AkXEPBL7
TYYebyAjE9mi90LwvD6BzcqdyhXITQUNWUr6iJDasIESqzrvW2pCzH2S77TYoGh+qXJiUC0O
AY3vT8kMUU6gahk2WhpRqfmNEWia1JfyTvV5TXRZEXt9+szLKzyDSHnkfgoRqS6ia2XwzFOa
h1YVwklG46AipZ/4BQEJhd9yBr4ZqoWPglNUo7009OewyKheJ91ktBcoXT88o+KY5Sg7Bi9Q
7qvn0KaBOiTXK21HaB6dYQH1Amxa8/pNcXqhKRLHEz7yJdf+sqAPQxj+5uXCgLLWFsEmo1L3
l/od2teMXT46GYrYlC27txxS/xW0AbtSeXplvn9vGOPfULvJRhoJ3+GF7MmEDaUnDwBsBOhT
e4hfPbA0yCNjFnxWHDEikOWziJ9O7X4+NAt9jHWyUKJUJiLrN59zhF+pk1mNKJOcbQjftSwW
k4ugWoeeg9KOQTwy4I6dO3iaNAw+ilIFYZLefUQAwhaly3nF9k4EbCNnByeikHL4VPzHb6of
WwFFs+rQws3Ml3A8eKTjvIb3LVuQU9SXttlYVib0WTy9F7TW+QBdcljxzYVxFWqf+SYk0Zbb
jzPRjfswob0s6Qu2R9qIE7hKFUGzLqPNUN/qjRoVLdh1KZHvVHVMAlwO5/MyyfiLNZKP9h5s
/IpdcLrhVBYCf7XHFco0M4axggEUEUhfD7uTa7kgv0OoOrc7Geb6IvrW9aKeWdp7zNUY6bYz
9ee6HBjV5BiWu4Vw0+lSIUUkcRherWt4++8g7+LbB6lGid6bDsA0BVmmMR1PNQJ843tcn32T
K9UK4nbi6Vmpr1giZ0IST2qVGi5f/Sz77+2q2ZZdjbFhJW14nHhvHONSaJsOzafiblmBsGL0
3kkP1I+0xzTJM5E2F7AWFdgs1Kj+el4YxWA9ovSyEKLhMdq09PtVZOQ8DIBevwGJ7oDXbAWt
QP7zeErOHkkgrluhOq8Xy1d4piPiB97Sbf0Sr49yPqqh1sGj12z0ZGflCbejh+JTx8wwKk4W
i8imN2gkauHhu5UUQsCDYIEy/tp5GCdESG/R7Ysp1WP9NRsWe170oNoABNCMth/7a4++7PrL
lhQP+dBfDgOO4az2emRyS3nTgsBkaR0QXIyg7CPmVCtpcnz/VftRbrOxoQXvG26RJ8jOW2cG
BGyJ72CsefEitV+058ybVEwY2fDC4gy4vsowCGRRU76OhSYQHeXl/t5WzqKxFLFYueUozqnh
n62EmaIZ5x2/NCTBeV9gTOjyzwwFtuZYAVYqLmlAMFVBklD09ALjKJDmvYWa3Z264unyj+mS
41as7pwbIkOawX9XTa8tHQ9C10rkSKRwA9NaWVOPgjOLZVz8e0oq1GjTuSAJiSkvZlojAdi/
Vt5c4uU8T96M4TesdqXyd4ae/ZtuEektLldIp67vhcRq/hBnxGIiCKLEQ+8/8sozU5/mVk6M
3w3T+DozkTbb74RktbUXut05sOu4O5xKoPGHODa0aY58UUfFvWwW7l9SUV0fCWX7EQoaO/Qk
fjWNn4LNLxurb+hkRguBDmPeMoNaS78St7vEjjg4NCwVTrl7JjvOCKiLjk7mmlxHsyn1e8iO
KEI7FRZLUpb/aYnuafFdUKoTgCMCnXrRPyWJ/5BO4yle1GrLAPUr6r3UxMKnCAJ9V0R+D/s9
wJ3iUsknC3lfNCB4n4cvhcECTJGMHMtqxkiTina2UtBXL842R5SMZxlAgnx+1XQuyGOoSl0g
1kY5MFj6CyH38BzLnsEoZ5tHcLJclc2+NdmKhMAKB8S0trZ3YdIbffQnLUM2RUxT2b/FA4xl
+EpJN6NVkooHeDHG+6mcKuOvqoedZYe/+MDC7xNkgHyw0RyAKpAIxbIUHpwBWZo4loVh4Awc
ZW9QN0TY4WXNOrETUEhF3sTSWhrgxT0n9IN0u5ZY8oBuM7rrZ5vPXgrxgR9OorfNeP7qkU4N
mkuYeARZeg+BUxPcWkoIl4+3u0zIHNcPIocYLxh5SD/HwsgSk5jLZpaqM58ogZ/AnSQherdH
QTJOstixmRpgp9+pmY/mSLDVxT4Dq2OT/tFgJTr+MIu+ddUcSNxP1P20NEydAPvKcpCtpFAR
b2biL/SpxH2QUZ53eb/JOH3e60Sp/HdRYl+1IiEpbBRJfBM8S0JhnPXCTfjOYWeMyznSQfCH
yHDdBfta32sPcdzsPbs/g7mg4JUTX0g8h6WQK0wjKRUzt6rzIxfNX+hCAEh9WtjcE41ccCRb
fchouUJt+HH6izDCZNewlfSrUu0as2gZPhXsTuXA/C9L3q8NC2i6TyTmqfokPtFogzOhc1lv
qzQKP4f6sLoVqp1rCsL8BYUoXjzfj4GmmmqaAvvClHQH5/W8Gatn2U+QUUfQs8k3UEAu1x2m
ihLbk3Wo8KuVVEoBi0vfffH+J+5eyyoXzHyuYK4Lm+1z1pBOmti21zm2H3g4EJal2zAj96bG
aTfmLriusfLWQBhslNSqxF6Bhzf8oulzJNE/QLzb8NNJHQR99wKijgutceQnFjpavu9Fek2r
qI8UlMGnOHN8nxr07awBWp2YGwYYyKRoKsFAfkTipGazkNTcSMbOGuQxrZh2sxgUmkNFc/4e
nBzZY9PO3UnWmJ9NqdjReROiYIU6ttVU/p3LUXBjaxpJZ4Gh/4CiLAoqlqSEEzjK0HL72KEL
T1NahV4lvWXdqmNlbO51LUZiRI0Tvg0z3FUtvYUWc+HXOj/FFJNFnDIIZyojEooPGgditLFp
v3VHNR+d4f0xFQhdEWUjTBLuhXh0WAj4Y6GHhQe9shLXA+iZ8TZknFZUJYAWdgFLvs/705GR
ekeh5tdquOEEFA9kgUQqC2YlsWxrBF9fwVQvrx/m7OikE9hKLYqtPC1q1xYv8zZKAUbH4x8b
NokdY8DCjyHsjZFqxw4VBJK/kePQkPGGFdLrFEq1Tb0l6DQUXYSFBXPREu+0f2EHZ7+zaV5r
BB7BvuFApp5EakuBM7N4JYFbbiz5EanBMRaEH411IuOiGvEKgjYFd+nIm0soqFupYV7GlBbV
b8t+YpPtfBihvMTkDUwKOJPfa9oaAa2WnIc+fOSpezQq6hCflF52Q68AjH9g92pic6BWQtzc
zB+yzrWTgqIrTGdTZvMA6vjn3GOfE8K9GE5BpwF79xzMHIA0/IIDcwte3Xjp9W68fkioREcL
B1+VLgA517x5wA+Tn7v7G4iKW4DnJx35C2XxsCnlIgwW/cIMMOb2qXc1t9gyGfKNAGv9HXJQ
bLWDdCjxnN5N/MuuDDhow+Cnr5JluJJQRSPw3WmBCXdSYTQr4jt9rqSF+OeUbcCB1jy5sWes
UtdHZzIHlwgUWHv/HBxAPMa3gWqlxkqs6/TGDs93aMJ9SmXVHq4CQpdG86AORtnDOClKQcST
cVM6ybgwJAL5yx4RDHNRW3C5LPMzaqtqwncx0PGInSt84SfSKgXH3y60XJ8pi3x1Xkai1n/A
w0OXa/kIBjZlzwmjtr/dXm3C2qowlIbl8k53eOmlBCqurirnxuw9ZlmoP19pbldIQlC6PgSj
aw58G6R8EWKAo2TPFZ1kU3HGi116jgHLTw01YssRyRw9FJlhCofR0c0K4zzv+PDs4F8jqGRp
mcok+ngtYQaaeZbd3wwm9X8IX4WReempDWfOENZjinqpEVpk8OiZxo2UJTHL/l9qqMwQBP0l
59JQSK6M8YEioNw6WpRo8g5jotYADnEO5M+Prwm+4BWbYbxFf4C7cMdXZ07280/Jagv6GhQL
gGhZKQa96bhvwpCWG9FVlBuEelBtl+QGOj++kpoSYT5jO1ib4awzN67rXQyfvzcgkMmRwaAw
pb6xvKi0SR2ht4Iuym5KjFIhYnI79FNpszAU07+5LqG9SwPltorfpkqURFoGKq8MnTBZFs+v
7W5fPTk5vyJ01eUMuie5jm1Wv/nIZMchQ0nJ0BhSSfcAX2LW4vX93fCyRh7+2FmuVBnCNVJ6
gtZJNL52wQb5ok9kTjUR0ztX+YhqPMJgOEPxHkzwdB/w0zuC0vWL1wzl8/My9tWN6erVezoj
Ki8SLQoNgmfPkObzon681UDwhAdPVPGyLkB2weHKjb6Q7tVJu9ehJUvBPtF/IE6S1rAKldCm
SYRgRatfsxI88JnIX4h9UttFE1c2d+UjuTspaDbujsKKldHazk/VKoP40q0cE81QLnKMfV4A
O8rype29b1du4ysbQm2DGqwcC7l8DQiEt9FHfQXAxs6JxKqbjIrTha67KUksNaNQI8penihE
U3L+j0E/Z+fe2+9YBvXgUPjTVbWN2mH3oQ63Brxn7L5oC3TomFQIpBXXoyfDjaOExnhK/N45
GHkSyicFi1e8ocaGiXwclRHcbxZB+xSuVoRjYp8XpA+5sQOud8YuXPMDR4flTIYx+rZJ3Bj3
/wuNj6SJiwVoRTN19XLgL1QBtbalfjQjO7/1Xkvq5ZPUFTX362+pwR5tPbYWYoE2dHH2zZZ5
45qVgBsSHfLhXRYdsk/qrL37jCaBC1NcH5f8Idnil3UacI59wuNkAEDP4mGk63OHXztRgeIq
ecfdSgP7j/fwNBKf8a6kUsli0ghtebI84MYMk5+XcokW5SgJ2xwW1NhIwFo+gGiUNIjTOGWG
Un9Bij7fi9t2ijBPlbSUE8yeAOLW9GVK/3PaBbgj5BoITxUkfyIF0ZGthfvUSY4a5WhuaxMe
XRGjMZrfOV+M43H/Djd7B/lCJrBqSc43MWWed0/SPqtTIZe12ZhTbOPxeZdvl5LKBKqnYN2e
ZIZClhONaga71xQuV3ffY09TxCN/c+O3hD+2nQbzv2iYhFcnaECNtVU7LBysTHV96uSxrn06
yf2MjxrPrvgFb15whqFJeg6wHproervrKSTV+pgFEyHDXE8UTw35utdnKfKdm7YeyZmO5AHE
WRNL2AjIihJzXbSjnrhAzfza+/57ofO9VkeSA0VcosPZgLl5Mcr7fiTUteeNyNhHOXjWJdQq
WJN7arOXNxxVOUPUD/AuLaeIShe1DtohQJKhhsyOsU/0+rCAN5R4t85MagpLQ8LNONm4qdiJ
GPpzK2HupBE+hacBYfR+1E0psw5LZK+8nJxVHwTkvyfeWCciIrCEamOqXN0C0c2DtAO1DQKM
IrIKW/uw2KIENa7eYRd7hqp1iA7Bvz2jmoPAF6o0cEutvfbEoeJxU8CyDthku9KsH1piMDOA
ar7Z3AtEKXbzYbpfneGxJ+/PpmWL1Jp5E5OyyHl+e37ebh+LezLfFfW6nBZZCDagr7QMM68a
p1P4e2zxCwi6yBSj/jzZOc+QO0Pao5RlczDDOQFQlyV/FxGEOo4gmKjp7Rluj3GaOoh5VmwN
PcUlQ03v+1nSmSamVZXaP455JYxw3wB15lOLp2LCVg41LjapTWPS77tYc58zBQAhegyUyP5u
UXRl5MlMuR58A5cjSVSdmB/8ViZs3hzgF7bCMEqwsq0NivK9IjCBiTb2h0ONHsHuBBzjkQcg
vZbTPE6hPdXyxLGd7QzS444JKS56EsmOFSK7eoxEed7I9+h756vFMG20ae4XUAK/hQkZOv6O
w9YJFAln4eNRxyLM8/WipJ96Wez6TtpjXnJMWLiygfYV/2rx8Rj4n0ncti5S9hFvHR0yPo/v
hfRwQOUJTNxJzfqHbJJegz86fAGixcCdBW+ra3lOqiNt9FtG85Ard4+4DzUlma67sqp6nsDN
RdAPRyroppOAkcpHGlFRf5LXpaGbkfW0+CkxV1LyqNnaNAnxA/erCswk56V6ycuncH4vRMn4
q/Anj4iApMmerEzxD6WDnE7SuXsxMGalm5+3jUcHTE43qhO61p7yKy9Px+EOzlyah6IxbTk9
ecjDlmnvFRElv/8GD/UQwKKFc7O5yLtSltHLbaIbe5k+5+M00cxVJEGGKyHyR/yrSSOzpaoI
65ncQYSJztGBUQx77BjPaJ7gQJ4gY78EsloYHLp8twb8en2/n6Zf9nO6EaZIByPSeymjJzJZ
ZgDk+a+aohrtSUQfQX7HS1RhbcjJrlJ8BmVOnpiIuAHBptu91XTWrd5XOme2BfAIRyS1YY4+
v6KhRNGpB87C242SkcRtCmN0cf47CmHQkNHL+s9hjJ2WCWSi0hbPGNuyYZX5xK37FUuLotfx
w5o71U59RK4hVA0X1IaposTkTiTPjPFSrjbusMGp4kXgxsS+SGp1WqRS5He0Dzmkhi60GfI1
VsFWAS7sqH7IZIsMBf0oEX87phDo9WMPwfqS+OCsnVh0gOkKQxMJ1JGvJPt/G5u7NO9kCH9+
TmfWNmuTgH7GTaT7JI5GsRTnHw3Wj0KXkGek/vEWpn+NKqQmsU3GoAceXzhxkjwJVsN5Rd2w
KS7m4PQG9tFHaCuH6ygrcAMeFaPmsncZZWWJMr9LlDPC5MiWv1u7/gkIWF76Vu2Hhy1RYmhP
sM7J/Id2+e/hjpJ9BVrqVhgqC+2PMeME2G4cSpxnN5RpQvLGscv31a+r2vtQo/kwPLNRng3k
PNJ6fntQQLfWOJGcBudyvUuvZUA1vwNBO62bflRgo1pZZY7V0K89nKAQ6gSG2fPkK4ternVI
UWrgeuwEBUBa6g4J4gasG4q5BZGuoQTZ1gnr5y+VWUZ94MAuSc1FD52f8W9CG9n2v1u3f8/1
ymSVZ836Y4wXFwJyZ/7tm7KmKJVa/2BwUv+XzofMvXhbmu8gzXF3sEqyopXBzDytOsyHAqxs
eheP6OSpzB/jtlv8+8PoKDI4Z0pK8y4hXKGsamjopMHVfP50YaDL6r/+xN+soWi8fTwwRU1r
savSz228jMtv7hy/1PcPincPo0+yYjwgM7IwnEjS5ibhMhrG3i+xcIAn/6bfxpWo1S2K6afv
QVaDnhHbSfy0giDrILNVoKXzLnb5UKF2duuAAf0Cxvz/Zov36Wo3zLseNY3cwvPjoJHq1Hf0
kLi7oxOqO4Yqwax3a9JQfdzZiTpyDDefUk4TKTYcF+OAfiKWTXgV2Hvxwdl8s0RPGO0euidr
LneszMzYG+pumTUFDnMH5gerRiovONotIgdIOSkl1eUl6Yby4FIzZMpySo4JdhIuwBx5UL77
9lAZdzOxpzmmbHQ6QhIcnYERXYoagESjyXR0XtLjYXXN7Hrh4UN38i+niWjgeQsDi1nFRGIz
+m7hLEcae2e73TQspCoQJKOAog5W4W/G/jaZB6qcQMqLbSd9RUGn55XfxfxDY8Gp/O+8pWYX
CImCNZSXf9Z/ipVsr3iBNQrg9HUUjWsQdPfrXBYmK8s8MXOLONpvbz5Jii4UdNE/gfqvn/2+
d0EHw3QMJjIDp+9GfMDHV5olApTykgZHgqvlRzWeLqJmF283n89eI0qH6JaUhKcR+6buzHi4
0+VXKcWoL4xp2sgDcZr8eBbKumKXL5JvUy1Gzy8Rb/HXr2jwOins+mkblIQdpB3v2GKEnOiT
D9vaH167+PGPgI28oHFK3u46FCESkdHOUmnbkTzyN9aJTJIoMv2BcIpmHRBE79Cd0q7lKVN6
2ZvOAuYmH9gMkddomVTzk0Q85IH7GdoQbPA43tqS0gWRU4dtkSEgy9kBbSs29iQbJtqR6vcQ
Ryfzy9ClRfDOfS/Ed1YXe4usFMt86yuwQa4rvrc+iVC0aovfudXrepc6s3lLHd267WE6Lml0
j9RC8EhL708nxyswYpO15TZ3Brgb2iiIGRDUpHBJcQRNegp2wzNsxquUwB4Tmc5J7qMo+uQQ
aCz3m9ZkvmpebOo4vh4UxzddAFYU9AxugYvRjZfGud7n1OhVz/GxL4o3nUCS60j+Z56aB7bD
x2BmBQiAum8zJcpoVNCT7I5965dUEOwk2PW86vb4RxGohTsrLgCTolgPwRKAjk1dAkl+lIPN
WCVGQIMqlHkoNG+jCOLBq+HWMiZzQUTG9w0Jc5f/4sqjEW09bDLEbeu+IZUB1lR+8qP8xDWB
Ve61MlMpH07qVS1MCBuKXK51EswN19fF3XuLvN1eXOtHvN9fj6mp8xCz/tkUxqVzlIqp7SS6
c3e+yZbZ+mVLMWyHNnwPuJ5HcU62bJQlmtte9yIyVouQI/sK7SkfW/hNik51cPE95PBCCRjl
hjhGXIHbC3YpPYYZ1yPcvFxV3aNDygy+pWpAgI8MESl80bYLk+LOY7RrWGIw3XQw12ZGvOut
TAupIuOnJYls6beGGV5QNDT5f7DCmBs59ZKk+6fmJ5pmNXJWpSN0KvjkkkzHKpspAbFbXXBp
gbg/4Ex8+W66j/zcRcgS/eI/VwlhnEVxyHLDxdi5ZS7OOfLDUuQqjBc7q20TPGlPDYQClQxy
o68ZIhkbR08WoCs9WIjfHJwqipT09SL2nuyRcarrCuWf3NLVQSER4WlGOwUyJAXZO+VVp3/+
9/qOvKyLJZcK+SsxWTjSLjzOWsk9TZvBBwRj8e/Os+1vpQ11P/xHFF6qoIxCkJrRCI4pzxKN
8v4ya9qooHuuP6bhwG76xERk6TjAvZCqQWOPv00SaSDFkniRQ2Pq4o4nI+RagslLC1Z4Luxo
4VxF0M9qQwJvdgPWqhgagxqTRcf0S+Jssh9tHdfFQUjfq83PTnM6KtQYH38h7KdaBQhat8vv
n1TW+KV2hbiMxFrnQomdNPzRR/emORVfMEY3dGE8QaLGiZpZlKME3eCLGumXTshs1LxXq+rl
XEMmh4IMDF/ejaqUidAoeQUKDW91nAHDTo8huiylzL8bL+B6mWhgR3PntIa5agxA7LhL4GUz
bJu8Q+ffZ49fRFZ9EuKG+3eeqb/aagZOX84frPsWIi9qNZa/EXntLfF07iaMbZ0w5UNj/Szw
Ymxd7SjjbQ9lBKh0ytMWCNBBmQ18iiWVRDh5bXoUcB4Inc/j8GmQc4ojVTJCqh4zhhXtdOt2
oSMECVLWvq2Qiylvchwa9r2A9iSIW6jSCeB6vtVldndLMSiZssjtsoA6+Xni6Ype0dKE4sVA
OBOUZDVdXwqBF9TyVT0lMhRSfv5YB5Sx6IG+NYfcoQUV0lfgI8Pj+7PaYg7hHZcLcEq12GBu
rWqBoEFIfa3kwdAc9p6AvsADmLSRNNuNn1b28P3yiVEpjZ4atbMpxXtpkyd49RB7krNJVhRT
urn4AAAA2WWl+PNg6zoAAb+MAdj8CqxsJT+xxGf7AgAAAAAEWVo=
--------------020302010809080303070402
Content-Type: text/plain;
 name="CHECK_NOTES"
Content-Disposition: attachment;
 filename="CHECK_NOTES"
Content-Transfer-Encoding: quoted-printable

gettext-runtime
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
All 1 tests passed


gettext-tools
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
1 of 326 tests failed
(18 tests were not run)

   SKIP: gettext-3, -5, -6, -7, -8
   SKIP: msgunfmt-csharp-1
   SKIP: msgunfmt-java-1     (!! but I have gcj !!)
   SKIP: recode-sr-latin-1
   SKIP: recode-sr-latin-2
   SKIP: lang-{objc,clisp,librep,guile,smalltalk}
   SKIP: lang-java           (!! but I have gcj !!)
   SKIP: lang-{csharp,pascal,perl-1,perl-2,php}

   FAIL: lang-tcl

gettext-3: skipped on non-glibc systems
gettext-5: skipped on non-glibc systems
gettext-6: skipped on non-glibc && non MacOS systems
gettext-7: skipped on non-glibc && non MacOS systems
gettext-8: setrlimit does not work
msgunfmt-csharp-1: skipped because csharp not available
msgunfmt-java-1:   skipped because java compiler or jar not found
lang-*:            in general skipped because the relevant compiler
                   is not found.  Exceptions listed below.
lang-java:         I would have expected lang-java to run?
lang-perl-1:       perl package Locale::Messages is not installed
lang-perl-2:       perl package libintl-perl is not installed

lang-tcl:
< =C2=ABVotre commande, s'il vous plait=C2=BB, dit le gar=C3=A7on.
---
> =E2=96=92Votre commande, s'il vous plait=E2=96=92, dit le gar=E2=96=92o=
n.

Perhaps because our tcl is not pure cygwin, but rather win32ish,
and is not built with i18n support?


gettext-tools/gnulib-tests
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
[old note; unverified in the current release]: All tests fail when
--enable-relocation (the tests do not "activate" the relocation
support, but the gnulib library they link to expect it).

When not --enable-relocation (the normal case):
2 of 120 tests failed (3 tests were not run)
but 2 of the passes actually should be failures.

FAIL: test-file-has-acl.sh -- file_has_acl("tmpdir0") returned yes, expec=
ted no
      This is expected on cygwin; all files always have ACLs (there are d=
efault
      ones that can't be removed using cygwin setfacl).

PASS: test-copy-acl.sh     -- but
      coredump at line 205; also 'setfacl -d group:0 tmpfile0
                                  setfacl: illegal acl entries'
PASS: test-copy-file.sh    -- but
      coredump at line 199; also 'setfacl -d group:0 tmpfile0
                                  setfacl: illegal acl entries'

      In both of these cases, I suspect the segfault is due to poor error
      handling when setfacl reports an error.  FWIW, the line numbers
      reported seem to be off:
         test-copy-acl.sh:205   'case $acl_flavor in'
         test-copy-file.sh:199  'case $acl_flavor in'
      I can't see those being the cause of a segfault (in bash?)

SKIP: test-mbrtowc4.sh     -- no transitional chinese locale is supported
SKIP: test-mbsrtowcs4.sh   -- no transitional chinese locale is supported
SKIP: test-mbsstr3.sh      -- no chinese GB18030 locale is supported
FAIL: test-strchrnul.exe   -- segfault (bug fixed in cygwin-1.7.10?)


--------------020302010809080303070402--


From MAILER-DAEMON Thu Aug 18 10:52:55 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu3xn-0005II-VX
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:52:55 -0400
Received: from eggs.gnu.org ([140.186.70.92]:59862)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu3xl-0005HO-Ve
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:52:54 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu3xk-0007WS-DB
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:52:53 -0400
Received: from mail3.vodafone.ie ([213.233.128.45]:6586)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu3xk-0007WL-3n
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:52:52 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBANEmTU5tTcb2/2dsb2JhbAAMNoRLpl4BAQUjDwFGEAsNCwICBRYLAgIJAwIBAgFFBg0BBQIBAbAVkVeBLIF/gg2BEASYPYtM
Received: from unknown (HELO [192.168.1.79]) ([109.77.198.246])
	by mail3.vodafone.ie with ESMTP; 18 Aug 2011 15:52:50 +0100
Message-ID: <4E4D2742.9020904@draigBrady.com>
Date: Thu, 18 Aug 2011 15:52:50 +0100
From: =?UTF-8?B?UMOhZHJhaWcgQnJhZHk=?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Aaron Davies <aaron.davies@gmail.com>
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
	<4E4D1AE0.8070804@draigBrady.com>
	<FAD2C294-C61D-4DFE-80DD-8AF306B15928@gmail.com>
In-Reply-To: <FAD2C294-C61D-4DFE-80DD-8AF306B15928@gmail.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.45
Cc: "coreutils@gnu.org" <coreutils@gnu.org>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:52:54 -0000

On 08/18/2011 03:13 PM, Aaron Davies wrote:
> On Aug 18, 2011, at 10:00 AM, PÃ¡draig Brady <P@draigBrady.com> wrote:
> 
>> On 08/18/2011 04:41 AM, Aaron Davies wrote:
>>> is there a way to access the -h functionality of du/df/ls as a general utility?
>>>
>>> i'd like to write a wrapper for a badly-behaved quota tool that only
>>> uses 1K blocks
>>
>> That might be quite useful.
>> Someone told me recently that `wc -h` would be
>> very useful to them, and I said something more
>> general would be even better.
>>
>> Perhaps a printf format spec?
> 
> yes, that's exactly what I was thinking of. how hard would that be to implement?

Fairly trivial.
With stuff like this, the interface
is the hardest and more important to define.
So let's not jump into it just yet.

cheers,
PÃ¡draig.


From MAILER-DAEMON Thu Aug 18 10:57:44 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu42S-00075k-8c
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 10:57:44 -0400
Received: from eggs.gnu.org ([140.186.70.92]:35902)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu42P-00074s-Jg
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:57:42 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu42O-0008Qt-JL
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:57:41 -0400
Received: from mail3.vodafone.ie ([213.233.128.45]:8343)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1Qu42O-0008Qd-9K
	for coreutils@gnu.org; Thu, 18 Aug 2011 10:57:40 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBAOUnTU5tTcb2/2dsb2JhbAAMNqspAQEEATIBRgULCw0BCgkWDwkDAgECAUUGDQEHAQEFh2gEugCGSASYPYtM
Received: from unknown (HELO [192.168.1.79]) ([109.77.198.246])
	by mail3.vodafone.ie with ESMTP; 18 Aug 2011 15:57:39 +0100
Message-ID: <4E4D2863.6000409@draigBrady.com>
Date: Thu, 18 Aug 2011 15:57:39 +0100
From: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Eric Blake <eblake@redhat.com>
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
	<4E4D1AE0.8070804@draigBrady.com> <4E4D1D08.5010408@redhat.com>
In-Reply-To: <4E4D1D08.5010408@redhat.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.45
Cc: Aaron Davies <aaron.davies@gmail.com>, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 14:57:42 -0000

On 08/18/2011 03:09 PM, Eric Blake wrote:
> On 08/18/2011 08:00 AM, Pádraig Brady wrote:
>>
>> Perhaps a printf format spec?
>> %h is available,
> 
> No it's not.  printf %hx prints a short int, printf %hhx prints a char as an int.

Oops I meant %H.
Even though a capital I discounted it as there are others used:
http://www.pixelbeat.org/programming/gcc/format_specs.html

> Meanwhile, although both the bash builtin and coreutils' printf parse these two formats, they actually still end up widening to int before printing; arguably a bug:
> 
> $ printf %hhx -1
> ffffffffffffffff
> $ echo 'format(%hx,-1)' | m4
> ff
> 

I'd agree that's a bug.
I also notice that neither solaris or freebsd support %h

cheers,
Pádraig.


From MAILER-DAEMON Thu Aug 18 11:08:51 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qu4DD-0001Pw-3Y
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 11:08:51 -0400
Received: from eggs.gnu.org ([140.186.70.92]:33336)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu4DA-0001Nc-LU
	for coreutils@gnu.org; Thu, 18 Aug 2011 11:08:49 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu4D9-0002RZ-3z
	for coreutils@gnu.org; Thu, 18 Aug 2011 11:08:48 -0400
Received: from mx1.redhat.com ([209.132.183.28]:62194)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1Qu4D8-0002RL-PD
	for coreutils@gnu.org; Thu, 18 Aug 2011 11:08:47 -0400
Received: from int-mx12.intmail.prod.int.phx2.redhat.com
	(int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7IF8ffs014735
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Thu, 18 Aug 2011 11:08:41 -0400
Received: from [10.3.113.130] (ovpn-113-130.phx2.redhat.com [10.3.113.130])
	by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7IF8feL028679; Thu, 18 Aug 2011 11:08:41 -0400
Message-ID: <4E4D2AF8.50905@redhat.com>
Date: Thu, 18 Aug 2011 09:08:40 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
Subject: Re: human-readable / block-size as a general utility?
References: <CACQi4XC9qkAZgewjhe1TvSqxb1qrnZb=OEVStkaD4oEqAVhWRA@mail.gmail.com>
	<4E4D1AE0.8070804@draigBrady.com> <4E4D1D08.5010408@redhat.com>
	<4E4D2863.6000409@draigBrady.com>
In-Reply-To: <4E4D2863.6000409@draigBrady.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25
Content-Transfer-Encoding: quoted-printable
X-MIME-Autoconverted: from 8bit to quoted-printable by mx1.redhat.com id
	p7IF8ffs014735
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: Aaron Davies <aaron.davies@gmail.com>, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 15:08:49 -0000

On 08/18/2011 08:57 AM, P=E1draig Brady wrote:
>
> Oops I meant %H.
> Even though a capital I discounted it as there are others used:
> http://www.pixelbeat.org/programming/gcc/format_specs.html

I don't know of anything using %H, so that would indeed be viable, if we=20
wanted to make printf(1) the way to expose conversion of a number into=20
human-readable form.

>
>> Meanwhile, although both the bash builtin and coreutils' printf parse =
these two formats, they actually still end up widening to int before prin=
ting; arguably a bug:
>>
>> $ printf %hhx -1
>> ffffffffffffffff
>> $ echo 'format(%hx,-1)' | m4

Typo - I meant %hhx in this example.

>> ff
>>
>
> I'd agree that's a bug.
> I also notice that neither solaris or freebsd support %h

POSIX does not require %h support in printf(1), only in printf(3).  And=20
gnulib lists which platforms have incomplete printf(3) support,=20
including %h support as one of its tests.

--=20
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Thu Aug 18 18:37:00 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuBCu-0004ns-Ti
	for mharc-coreutils@gnu.org; Thu, 18 Aug 2011 18:37:00 -0400
Received: from eggs.gnu.org ([140.186.70.92]:34248)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuBCs-0004m7-Gc
	for coreutils@gnu.org; Thu, 18 Aug 2011 18:36:59 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuBCr-0000Sn-5A
	for coreutils@gnu.org; Thu, 18 Aug 2011 18:36:58 -0400
Received: from mx1.redhat.com ([209.132.183.28]:49086)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuBCq-0000Sh-Nn
	for coreutils@gnu.org; Thu, 18 Aug 2011 18:36:57 -0400
Received: from int-mx12.intmail.prod.int.phx2.redhat.com
	(int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7IMaeao007844
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Thu, 18 Aug 2011 18:36:40 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7IMactD007350; Thu, 18 Aug 2011 18:36:39 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id EB78B6021B;
	Fri, 19 Aug 2011 00:36:37 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: [PATCH] date: support parsing of ISO-8601-with-"T" dates
Date: Fri, 19 Aug 2011 00:36:37 +0200
Message-ID: <871uwie496.fsf@rho.meyering.net>
Lines: 66
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: "J. T. Conklin" <jtc@acorntoolworks.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 18 Aug 2011 22:37:00 -0000

J. T. Conklin wrote the patch:
  http://thread.gmane.org/gmane.comp.lib.gnulib.bugs/27929
to provide long-awaited support for parsing ISO 8601 "T"-separated
date-time strings.

Here's most of what I'll be adding in coreutils once that goes
into gnulib.  (along with an update to make coreutils use
the latest from gnulib, of course)

>From 9dd3a983f4999c75dc0da94c386e2ef3105ab906 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Fri, 19 Aug 2011 00:29:42 +0200
Subject: [PATCH] date: support parsing of ISO-8601-with-"T" dates

Thanks to an improvement in gnulib's parse-datetime module,
commands like this now succeed (output manually indented):
    $ ./date -u -d 2004-02-29T16:21:42.33+07:00 +%FT%T.%N%z
		   2004-02-29T09:21:42.330000000+0000
* tests/misc/date: Add a test to exercise the new-in-gnulib
parsing of ISO8601-with-"T" dates.
* NEWS (New features): Mention it.
---
 NEWS            |    6 ++++++
 tests/misc/date |    3 +++
 2 files changed, 9 insertions(+), 0 deletions(-)

diff --git a/NEWS b/NEWS
index 6e24f5c..b23ebb1 100644
--- a/NEWS
+++ b/NEWS
@@ -42,6 +42,12 @@ GNU coreutils NEWS                                    -*- outline -*-

 ** New features

+  date now accepts ISO 8601 date-time strings with "T" as the
+  separator.  It has long parsed dates like "2004-02-29 16:21:42"
+  with a space between the date and time strings.  Now it also parses
+  "2004-02-29T16:21:42" and fractional-second and time-zone-annotated
+  variants like "2004-02-29T16:21:42.333-07:00"
+
   md5sum accepts the new --strict option.  With --check, it makes the
   tool exit non-zero for any invalid input line, rather than just warning.
   This also affects sha1sum, sha224sum, sha384sum and sha512sum.
diff --git a/tests/misc/date b/tests/misc/date
index dd72544..6f7a530 100755
--- a/tests/misc/date
+++ b/tests/misc/date
@@ -29,6 +29,7 @@ $ENV{TZ} = 'UTC0';
 my $t0 = '08:17:48';
 my $d0 = '1997-01-19';
 my $d1 = "$d0 $t0 +0";
+my $dT = "${d0}T$t0+0"; # ISO 8601 with "T" separator

 my $ts = '08:17:49'; # next second
 my $tm = '08:18:48'; # next minute
@@ -72,6 +73,8 @@ my @Tests =
      # ['2', "-d '$d1' +'%c'", {OUT=>"Sun Jan 19 $t0 1997"}],

      ['3', "-d '$d1' +'%d_%D_%e_%h_%H'", {OUT=>"19_01/19/97_19_Jan_08"}],
+     ['3T',"-d '$dT' +'%d_%D_%e_%h_%H'", {OUT=>"19_01/19/97_19_Jan_08"}],
+
      ['4', "-d '$d1' +'%I_%j_%k_%l_%m'", {OUT=>"08_019_ 8_ 8_01"}],
      ['5', "-d '$d1' +'%M_%n_%p_%r'", {OUT=>"17_\n_AM_$t0 AM"}],
      ['6', "-d '$d1' +'%s_%S_%t_%T'", {OUT=>"853661868_48_\t_$t0"}],
--
1.7.6.857.gf34cf


From MAILER-DAEMON Fri Aug 19 09:42:13 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuPKv-0004z4-HU
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 09:42:13 -0400
Received: from eggs.gnu.org ([140.186.70.92]:51485)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuPKs-0004u5-9j
	for coreutils@gnu.org; Fri, 19 Aug 2011 09:42:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuPKr-0006iA-DD
	for coreutils@gnu.org; Fri, 19 Aug 2011 09:42:10 -0400
Received: from mx1.redhat.com ([209.132.183.28]:6260)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>)
	id 1QuPKo-0006ey-Gt; Fri, 19 Aug 2011 09:42:06 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JDg4SL004332
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 09:42:04 -0400
Received: from [10.3.113.130] (ovpn-113-130.phx2.redhat.com [10.3.113.130])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JDg35o011424; Fri, 19 Aug 2011 09:42:04 -0400
Message-ID: <4E4E682B.3020500@redhat.com>
Date: Fri, 19 Aug 2011 07:42:03 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jeff liu <jeff.liu@oracle.com>
Subject: Re: [Bug-tar] Improve sparse file scan through extent_scan module
References: <0F57BD13-B1AD-4ABD-9951-C1AD2E156723@oracle.com>
In-Reply-To: <0F57BD13-B1AD-4ABD-9951-C1AD2E156723@oracle.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: bug-gnulib <bug-gnulib@gnu.org>, Coreutils <coreutils@gnu.org>,
	Chris Mason <chris.mason@oracle.com>, bug-tar@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 13:42:11 -0000

[adding coreutils and bug-gnulib]

On 08/18/2011 07:33 AM, Jeff liu wrote:
> Dear developer,
>
> As the fiemap exent-scan module has been added to coreutils for about half year, and looks it works stable in the past few releases.
>
> Is it possible to make use of it to improve the current tar sparse file scan procedure?

We need to migrate the scanner out of coreutils and into gnulib, at 
which point tar can use it.  Also, be aware that the latest 3.1 kernel 
and glibc.git have added support for SEEK_HOLE and SEEK_DATA, and we 
should prefer those higher-level interfaces over the lower-level extent 
scanners, where possible.

> I'd like to work a patch out if you guys like it.

Sure, but it starts on the gnulib side.

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Fri Aug 19 09:59:32 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuPbg-0003rG-ID
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 09:59:32 -0400
Received: from eggs.gnu.org ([140.186.70.92]:50770)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuPbe-0003rA-LB
	for coreutils@gnu.org; Fri, 19 Aug 2011 09:59:31 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuPbd-00020t-P2
	for coreutils@gnu.org; Fri, 19 Aug 2011 09:59:30 -0400
Received: from mail2.vodafone.ie ([213.233.128.44]:60170)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuPbd-00020n-GD
	for coreutils@gnu.org; Fri, 19 Aug 2011 09:59:29 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBAONqTk5tTjRH/2dsb2JhbAAMNYRLpXkBAQUyAUYQCw0LBAUjAg8CRgYNAQcBAa83CJE7gSiEDIEUBIc2kQeLTA
Received: from unknown (HELO [192.168.1.79]) ([109.78.52.71])
	by mail2.vodafone.ie with ESMTP; 19 Aug 2011 14:59:27 +0100
Message-ID: <4E4E6C3E.50606@draigBrady.com>
Date: Fri, 19 Aug 2011 14:59:26 +0100
From: =?GB2312?B?UKiiZHJhaWcgQnJhZHk=?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Jeff Liu <jeff.liu@oracle.com>
Subject: Re: Feature Request for cp(1) utility, consider Btrfs ioctl clone
	range support
References: <4E42500D.3050702@oracle.com>
In-Reply-To: <4E42500D.3050702@oracle.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=GB2312
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.44
Cc: coreutils@gnu.org, chris.mason@oracle.com
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 13:59:31 -0000

On 08/10/2011 10:31 AM, Jeff Liu wrote:
> Hello,
> 
> I just found a cool feature in Btrfs for cloning partially source file
> to the destination by specifying the desired offset and length to be copied.
> 
> The call interface is something like below:
> struct btrfs_clone_range_args cr;
> cr.src_fd = source_desc;
> cr.src_offset = (uint64_t) offset;
> cr.src_length = (uint64_t) length;
> cr.dest_offset = (uint64_t) d_offset;
> ioctl(dest_fd, BTRFS_IOC_CLONE_RANGE, &args);
> 
> cp(1) has already works with "reflink" supported for a long time, IMHO,
> this new feature could improve it to some extent.
> Is it acceptable to add a new option like
> "--reflink-range=src_offset,src_length,dst_offset" to clone partially
> source file?
> In this way, if reflink-range is triggered, cp(1) will try to parse the
> offset and length which are separated by comma,
> then try to clone src_length bytes from src_offset to the destination
> file started at dst_offset.
> if reflink-range failed, just let cp(1) fail with appropriate error info.
> 
> I'd like to implement it if you guys think it does make sense. :-P.

IMHO I don't think this level of control is needed in `cp`.

cheers,
P¨¢draig.


From MAILER-DAEMON Fri Aug 19 10:09:24 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuPlE-0004q5-Rx
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 10:09:24 -0400
Received: from eggs.gnu.org ([140.186.70.92]:45201)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuPlC-0004pd-MP
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:09:23 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuPlB-0003wb-Hf
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:09:22 -0400
Received: from mx1.redhat.com ([209.132.183.28]:49687)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuPlB-0003wT-Ae
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:09:21 -0400
Received: from int-mx01.intmail.prod.int.phx2.redhat.com
	(int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JE9IHl028525
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 10:09:18 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JE9GeT029405; Fri, 19 Aug 2011 10:09:17 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 92853600E2;
	Fri, 19 Aug 2011 16:09:16 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: =?iso-8859-1?Q?P=E1draig?= Brady <P@draigBrady.com>
Subject: Re: Feature Request for cp(1) utility,
	consider Btrfs ioctl clone range support
In-Reply-To: <4E4E6C3E.50606@draigBrady.com> (=?iso-8859-1?Q?=22P=E1draig?=
	Brady"'s message of "Fri, 19 Aug 2011 14:59:26 +0100")
References: <4E42500D.3050702@oracle.com> <4E4E6C3E.50606@draigBrady.com>
Date: Fri, 19 Aug 2011 16:09:16 +0200
Message-ID: <87hb5dbiib.fsf@rho.meyering.net>
Lines: 32
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org, chris.mason@oracle.com
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 14:09:23 -0000

P=E1draig Brady wrote:
> On 08/10/2011 10:31 AM, Jeff Liu wrote:
>> Hello,
>>
>> I just found a cool feature in Btrfs for cloning partially source file
>> to the destination by specifying the desired offset and length to be cop=
ied.
>>
>> The call interface is something like below:
>> struct btrfs_clone_range_args cr;
>> cr.src_fd =3D source_desc;
>> cr.src_offset =3D (uint64_t) offset;
>> cr.src_length =3D (uint64_t) length;
>> cr.dest_offset =3D (uint64_t) d_offset;
>> ioctl(dest_fd, BTRFS_IOC_CLONE_RANGE, &args);
>>
>> cp(1) has already works with "reflink" supported for a long time, IMHO,
>> this new feature could improve it to some extent.
>> Is it acceptable to add a new option like
>> "--reflink-range=3Dsrc_offset,src_length,dst_offset" to clone partially
>> source file?
>> In this way, if reflink-range is triggered, cp(1) will try to parse the
>> offset and length which are separated by comma,
>> then try to clone src_length bytes from src_offset to the destination
>> file started at dst_offset.
>> if reflink-range failed, just let cp(1) fail with appropriate error info.
>>
>> I'd like to implement it if you guys think it does make sense. :-P.
>
> IMHO I don't think this level of control is needed in `cp`.

Thanks for replying.
I agree that this seems unnecessary.


From MAILER-DAEMON Fri Aug 19 10:24:11 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuPzX-00075Q-0d
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 10:24:11 -0400
Received: from eggs.gnu.org ([140.186.70.92]:36246)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuPzU-00074j-Va
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:24:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuPzT-000792-Id
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:24:08 -0400
Received: from acsinet15.oracle.com ([141.146.126.227]:45722)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>)
	id 1QuPzP-00077x-BB; Fri, 19 Aug 2011 10:24:03 -0400
Received: from acsinet21.oracle.com (acsinet21.oracle.com [141.146.126.237])
	by acsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7JENviS025832
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 14:23:59 GMT
Received: from acsmt357.oracle.com (acsmt357.oracle.com [141.146.40.157])
	by acsinet21.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7JENuP2028646
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Fri, 19 Aug 2011 14:23:57 GMT
Received: from abhmt101.oracle.com (abhmt101.oracle.com [141.146.116.53])
	by acsmt357.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7JENpQ3001722; Fri, 19 Aug 2011 09:23:51 -0500
Received: from [192.168.1.100] (/123.119.96.94)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Fri, 19 Aug 2011 07:23:51 -0700
Subject: Re: [Bug-tar] Improve sparse file scan through extent_scan module
Mime-Version: 1.0 (Apple Message framework v1082)
Content-Type: text/plain; charset=GB2312
From: Jeff liu <jeff.liu@oracle.com>
In-Reply-To: <4E4E682B.3020500@redhat.com>
Date: Fri, 19 Aug 2011 22:23:41 +0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <0019FA3F-8155-418D-B7F1-59D4EE58D850@oracle.com>
References: <0F57BD13-B1AD-4ABD-9951-C1AD2E156723@oracle.com>
	<4E4E682B.3020500@redhat.com>
To: Eric Blake <eblake@redhat.com>
X-Mailer: Apple Mail (2.1082)
X-Source-IP: acsinet21.oracle.com [141.146.126.237]
X-Auth-Type: Internal IP
X-CT-RefId: str=0001.0A020201.4E4E71FF.0179:SCFMA922111,ss=1,re=-4.000,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 141.146.126.227
Cc: bug-gnulib <bug-gnulib@gnu.org>, Coreutils <coreutils@gnu.org>,
	Chris Mason <chris.mason@oracle.com>, bug-tar@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 14:24:10 -0000

Hi Eric,

Thanks for your response!

=D4=DA 2011-8-19=A3=AC=CF=C2=CE=E79:42=A3=AC Eric Blake =D0=B4=B5=C0=A3=BA=


> [adding coreutils and bug-gnulib]
>=20
> On 08/18/2011 07:33 AM, Jeff liu wrote:
>> Dear developer,
>>=20
>> As the fiemap exent-scan module has been added to coreutils for about =
half year, and looks it works stable in the past few releases.
>>=20
>> Is it possible to make use of it to improve the current tar sparse =
file scan procedure?
>=20
> We need to migrate the scanner out of coreutils and into gnulib, at =
which point tar can use it.  Also, be aware that the latest 3.1 kernel =
and glibc.git have added support for SEEK_HOLE and SEEK_DATA, and we =
should prefer those higher-level interfaces over the lower-level extent =
scanners, where possible.
Yes, I recalled Jim have also mentioned to put extent scan module to =
gnulib first.

Consider SEEK_HOLE/SEEK_DATA,  I have submitted a patch to coreutils =
which can be found at:
http://lists.gnu.org/archive/html/bug-coreutils/2011-04/msg00106.html

At that time, it was wrote for ZFS only, I'll take a look at the kernel =
and glibc for this stuff later.

In the meantime, could anyone give a review?

 =20
>=20
>> I'd like to work a patch out if you guys like it.
>=20
> Sure, but it starts on the gnulib side.
Thanks,  let's make it present to gnulib first. :)

Regards,
-Jeff
>=20
> --=20
> Eric Blake   eblake@redhat.com    +1-801-349-2682
> Libvirt virtualization library http://libvirt.org



From MAILER-DAEMON Fri Aug 19 10:27:11 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuQ2R-0007Lj-Bx
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 10:27:11 -0400
Received: from eggs.gnu.org ([140.186.70.92]:58897)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ2P-0007J1-L4
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:27:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ2L-0007dp-Ij
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:27:09 -0400
Received: from acsinet15.oracle.com ([141.146.126.227]:33669)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ2L-0007dl-Ch
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:27:05 -0400
Received: from rtcsinet22.oracle.com (rtcsinet22.oracle.com [66.248.204.30])
	by acsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7JER0cJ031781
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 14:27:02 GMT
Received: from acsmt356.oracle.com (acsmt356.oracle.com [141.146.40.156])
	by rtcsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7JEQxaB010182
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Fri, 19 Aug 2011 14:27:00 GMT
Received: from abhmt117.oracle.com (abhmt117.oracle.com [141.146.116.69])
	by acsmt356.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7JEQsAx014462; Fri, 19 Aug 2011 09:26:54 -0500
Received: from [192.168.1.100] (/123.119.96.94)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Fri, 19 Aug 2011 07:26:54 -0700
Subject: Re: Feature Request for cp(1) utility,
	consider Btrfs ioctl clone range support
Mime-Version: 1.0 (Apple Message framework v1082)
Content-Type: text/plain; charset=GB2312
From: Jeff liu <jeff.liu@oracle.com>
In-Reply-To: <4E4E6C3E.50606@draigBrady.com>
Date: Fri, 19 Aug 2011 22:26:45 +0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <78EF093E-C872-4209-B784-A20095D3D44A@oracle.com>
References: <4E42500D.3050702@oracle.com> <4E4E6C3E.50606@draigBrady.com>
To: =?GB2312?Q?P=A8=A2draig_Brady?= <P@draigBrady.com>
X-Mailer: Apple Mail (2.1082)
X-Source-IP: rtcsinet22.oracle.com [66.248.204.30]
X-CT-RefId: str=0001.0A020201.4E4E72B7.0051,ss=1,re=0.000,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 141.146.126.227
Cc: coreutils@gnu.org, chris.mason@oracle.com
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 14:27:10 -0000

Hi P=A8=A2draig,

Thanks for your comments!

> On 08/10/2011 10:31 AM, Jeff Liu wrote:
>> Hello,
>>=20
>> I just found a cool feature in Btrfs for cloning partially source =
file
>> to the destination by specifying the desired offset and length to be =
copied.
>>=20
>> The call interface is something like below:
>> struct btrfs_clone_range_args cr;
>> cr.src_fd =3D source_desc;
>> cr.src_offset =3D (uint64_t) offset;
>> cr.src_length =3D (uint64_t) length;
>> cr.dest_offset =3D (uint64_t) d_offset;
>> ioctl(dest_fd, BTRFS_IOC_CLONE_RANGE, &args);
>>=20
>> cp(1) has already works with "reflink" supported for a long time, =
IMHO,
>> this new feature could improve it to some extent.
>> Is it acceptable to add a new option like
>> "--reflink-range=3Dsrc_offset,src_length,dst_offset" to clone =
partially
>> source file?
>> In this way, if reflink-range is triggered, cp(1) will try to parse =
the
>> offset and length which are separated by comma,
>> then try to clone src_length bytes from src_offset to the destination
>> file started at dst_offset.
>> if reflink-range failed, just let cp(1) fail with appropriate error =
info.
>>=20
>> I'd like to implement it if you guys think it does make sense. :-P.
>=20
> IMHO I don't think this level of control is needed in `cp`.

If you think it became useful to other coreutils stuff in the future, =
please let me know, I would like to work on it.

Regards,
-Jeff
>=20
> cheers,
> P=A8=A2draig.



From MAILER-DAEMON Fri Aug 19 10:32:50 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuQ7u-0000HE-S7
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 10:32:50 -0400
Received: from eggs.gnu.org ([140.186.70.92]:58255)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ7s-0000H5-Qq
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:32:49 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ7r-0000k7-NK
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:32:48 -0400
Received: from rcsinet15.oracle.com ([148.87.113.117]:17731)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1QuQ7r-0000k3-Ev
	for coreutils@gnu.org; Fri, 19 Aug 2011 10:32:47 -0400
Received: from rtcsinet21.oracle.com (rtcsinet21.oracle.com [66.248.204.29])
	by rcsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7JEWghl028066
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 14:32:44 GMT
Received: from acsmt358.oracle.com (acsmt358.oracle.com [141.146.40.158])
	by rtcsinet21.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7JEWebO016664
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Fri, 19 Aug 2011 14:32:40 GMT
Received: from abhmt112.oracle.com (abhmt112.oracle.com [141.146.116.64])
	by acsmt358.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7JEWYfu005909; Fri, 19 Aug 2011 09:32:35 -0500
Received: from [192.168.1.100] (/123.119.96.94)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Fri, 19 Aug 2011 07:32:33 -0700
Subject: Re: Feature Request for cp(1) utility,
	consider Btrfs ioctl clone range support
Mime-Version: 1.0 (Apple Message framework v1082)
Content-Type: text/plain; charset=GB2312
From: Jeff liu <jeff.liu@oracle.com>
In-Reply-To: <78EF093E-C872-4209-B784-A20095D3D44A@oracle.com>
Date: Fri, 19 Aug 2011 22:32:24 +0800
Content-Transfer-Encoding: quoted-printable
Message-Id: <CDD04050-C4A7-4E1D-8449-4DE9596160D9@oracle.com>
References: <4E42500D.3050702@oracle.com> <4E4E6C3E.50606@draigBrady.com>
	<78EF093E-C872-4209-B784-A20095D3D44A@oracle.com>
To: =?GB2312?Q?P=A8=A2draig_Brady?= <P@draigBrady.com>
X-Mailer: Apple Mail (2.1082)
X-Source-IP: rtcsinet21.oracle.com [66.248.204.29]
X-CT-RefId: str=0001.0A090201.4E4E740C.00D8,ss=1,re=0.000,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 148.87.113.117
Cc: ocfs2-devel@oss.oracle.com, Coreutils <coreutils@gnu.org>,
	Chris Mason <chris.mason@oracle.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 14:32:49 -0000

btw, I have posted a patch to make cp --reflink option works for OCFS2 =
too,
http://lists.gnu.org/archive/html/coreutils/2011-05/msg00017.html

Is it acceptable?


Thanks,
-Jeff

> Hi P=A8=A2draig,
>=20
> Thanks for your comments!
>=20
>> On 08/10/2011 10:31 AM, Jeff Liu wrote:
>>> Hello,
>>>=20
>>> I just found a cool feature in Btrfs for cloning partially source =
file
>>> to the destination by specifying the desired offset and length to be =
copied.
>>>=20
>>> The call interface is something like below:
>>> struct btrfs_clone_range_args cr;
>>> cr.src_fd =3D source_desc;
>>> cr.src_offset =3D (uint64_t) offset;
>>> cr.src_length =3D (uint64_t) length;
>>> cr.dest_offset =3D (uint64_t) d_offset;
>>> ioctl(dest_fd, BTRFS_IOC_CLONE_RANGE, &args);
>>>=20
>>> cp(1) has already works with "reflink" supported for a long time, =
IMHO,
>>> this new feature could improve it to some extent.
>>> Is it acceptable to add a new option like
>>> "--reflink-range=3Dsrc_offset,src_length,dst_offset" to clone =
partially
>>> source file?
>>> In this way, if reflink-range is triggered, cp(1) will try to parse =
the
>>> offset and length which are separated by comma,
>>> then try to clone src_length bytes from src_offset to the =
destination
>>> file started at dst_offset.
>>> if reflink-range failed, just let cp(1) fail with appropriate error =
info.
>>>=20
>>> I'd like to implement it if you guys think it does make sense. :-P.
>>=20
>> IMHO I don't think this level of control is needed in `cp`.
>=20
> If you think it became useful to other coreutils stuff in the future, =
please let me know, I would like to work on it.
>=20
> Regards,
> -Jeff
>>=20
>> cheers,
>> P=A8=A2draig.
>=20
>=20



From MAILER-DAEMON Fri Aug 19 12:24:56 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuRsO-0005qQ-Ax
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 12:24:56 -0400
Received: from eggs.gnu.org ([140.186.70.92]:37526)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuRsM-0005ok-5q
	for coreutils@gnu.org; Fri, 19 Aug 2011 12:24:55 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuRsK-0006yX-Vw
	for coreutils@gnu.org; Fri, 19 Aug 2011 12:24:54 -0400
Received: from mx1.redhat.com ([209.132.183.28]:62548)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>)
	id 1QuRsH-0006xi-FN; Fri, 19 Aug 2011 12:24:49 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JGOmem010854
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 12:24:48 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JGOlCC010127; Fri, 19 Aug 2011 12:24:48 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 04042600D5;
	Fri, 19 Aug 2011 18:24:46 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org, bug-findutils@gnu.org
Subject: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories
Date: Fri, 19 Aug 2011 18:24:46 +0200
Message-ID: <87vctt9xo1.fsf@rho.meyering.net>
Lines: 122
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 16:24:55 -0000

[Cc'ing bug-findutils, since it needs the same treatment]

Applied to a directory containing too many entries, tools like rm, du,
chmod, chown, chgrp and chcon would exhaust virtual memory.
At ~1GiB per 4 million entries, you can calculate how many
entries it would take to cause trouble in your environment.

This change updates coreutils to use the just-fixed version
of fts (the dir-traversal code) from gnulib.  With it,
the fts-internal memory utilization is capped at about 30MB.
It also adds a test that is marked as very expensive.

To run just this test, you can do this:

  make check -C tests TESTS=rm/4-million-entry-dir VERBOSE=yes \
    RUN_VERY_EXPENSIVE_TESTS=yes

I'll wait at least a couple hours before pushing this.


>From 0ba576979a10a11e5652fd155266464b1e784892 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Fri, 19 Aug 2011 17:51:45 +0200
Subject: [PATCH] rm, du, chmod, chown, chgrp: use much less memory for large
 directories

For details, see the gnulib commit,
http://git.sv.gnu.org/cgit/gnulib.git/commit/?id=47cb657e
* tests/rm/4-million-entry-dir: New test.
* tests/Makefile.am (TESTS): Add it.
* NEWS (Bug fixes): Mention it.
* gnulib: Update to latest to get the required fts fixes.
---
 NEWS                         |    9 +++++++++
 gnulib                       |    2 +-
 tests/Makefile.am            |    1 +
 tests/rm/4-million-entry-dir |   35 +++++++++++++++++++++++++++++++++++
 4 files changed, 46 insertions(+), 1 deletions(-)
 create mode 100755 tests/rm/4-million-entry-dir

diff --git a/NEWS b/NEWS
index 6e24f5c..b356a03 100644
--- a/NEWS
+++ b/NEWS
@@ -17,6 +17,15 @@ GNU coreutils NEWS                                    -*- outline -*-
   to dst/s/b rather than simply linking dst/s/b to dst/s/a.
   [This bug appears to have been present in "the beginning".]

+  fts-using tools (rm, du, chmod, chgrp, chown, chcon) no longer use memory
+  proportional to the number of entries in each directory they process.
+  Before, rm -rf 4-million-entry-directory would consume about 1GiB of memory.
+  Now, it uses less than 30GB, no matter how many entries there are.
+  [this bug was inherent in the use of fts: thus, for rm the bug was
+  introduced in coreutils-8.0.  The prior implementation of rm did not use
+  as much memory.  du, chmod, chgrp and chown started using fts in 6.0.
+  chcon was added in coreutils-6.9.91 with fts support.  ]
+
   printf '%d' '"' no longer accesses out-of-bounds memory in the diagnostic.
   [bug introduced in sh-utils-1.16]

diff --git a/gnulib b/gnulib
index d2b8ab6..47cb657 160000
--- a/gnulib
+++ b/gnulib
@@ -1 +1 @@
-Subproject commit d2b8ab669f3129ac0d349eead1217adc38d795eb
+Subproject commit 47cb657eca1abf2c26c32c8ce03def994a3ee37c
diff --git a/tests/Makefile.am b/tests/Makefile.am
index eb67512..f0200e1 100644
--- a/tests/Makefile.am
+++ b/tests/Makefile.am
@@ -135,6 +135,7 @@ TESTS =						\
   rm/unread3					\
   rm/unreadable					\
   rm/v-slash					\
+  rm/4-million-entry-dir			\
   chgrp/default-no-deref			\
   chgrp/deref					\
   chgrp/no-x					\
diff --git a/tests/rm/4-million-entry-dir b/tests/rm/4-million-entry-dir
new file mode 100755
index 0000000..23130a6
--- /dev/null
+++ b/tests/rm/4-million-entry-dir
@@ -0,0 +1,35 @@
+#!/bin/sh
+# in coreutils-8.12, this would have required ~1GB of memory
+
+# Copyright (C) 2011 Free Software Foundation, Inc.
+
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+. "${srcdir=.}/init.sh"; path_prepend_ ../src
+print_ver_ rm
+
+very_expensive_
+
+# Put 4M files in a directory.
+mkdir d && cd d || framework_failure_
+seq 4000000|xargs touch || framework_failure_
+
+cd ..
+
+# Restricted to 50MB, rm from coreutils-8.12 would fail with a
+# diagnostic like "rm: fts_read failed: Cannot allocate memory".
+ulimit -v 50000
+rm -rf d || fail=1
+
+Exit $fail
--
1.7.6.857.gf34cf


From MAILER-DAEMON Fri Aug 19 14:18:42 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuTeU-0006aa-KO
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 14:18:42 -0400
Received: from eggs.gnu.org ([140.186.70.92]:57008)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuTeS-0006aU-7u
	for coreutils@gnu.org; Fri, 19 Aug 2011 14:18:41 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuTeQ-0001Ee-Uh
	for coreutils@gnu.org; Fri, 19 Aug 2011 14:18:40 -0400
Received: from mail2.vodafone.ie ([213.233.128.44]:50845)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuTeQ-0001Ch-Pu
	for coreutils@gnu.org; Fri, 19 Aug 2011 14:18:38 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBAPmnTk5tTjRH/2dsb2JhbAAMNqpEAQEBAQMBAi8BRhALDQsJFg8JAwIBAgEWLwYNAQcBARaHW7h9hkgEkQWHOItM
Received: from unknown (HELO [192.168.1.79]) ([109.78.52.71])
	by mail2.vodafone.ie with ESMTP; 19 Aug 2011 19:18:37 +0100
Message-ID: <4E4EA8FC.9000707@draigBrady.com>
Date: Fri, 19 Aug 2011 19:18:36 +0100
From: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: "jeff.liu" <jeff.liu@oracle.com>
Subject: Re: cp/reflink support for OCFS2
References: <4DC01574.40200@oracle.com>
In-Reply-To: <4DC01574.40200@oracle.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.44
Cc: coreutils@gnu.org, Joel Becker <Joel.Becker@oracle.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 18:18:41 -0000

On 05/03/2011 03:47 PM, jeff.liu wrote:
> Hello All,
> 
> I'd like to introduce the ocfs2 reflink support to cp(1) when it was called with
> "--reflink=[WHEN]".
> With this patch, `cp' will try OCFS2 reflink first, if it fails with EEXIST, IMHO, it definitely
> means the user is intended to perform reflink on OCFS2, but the destination file is already exists,
> so set the retval = false and return, or try Btrfs clone again.
> 
> I have done some tests, includes reflink on OCFS2, reflink to an existing file, reflink files
> cross-filesystems, and reflink attributes only, all works fine.
> 
> For the test automation, the existing reflink test are presume the tests running on either file
> systems with Cow support IMO, maybe we can improve them with real filesystems on loop device?
> 
> Also, the old bug ticket for this topic will be closed at:
> http://lists.gnu.org/archive/html/bug-coreutils/2010-04/msg00185.html

Thanks for doing this.

It's a pity we've to try different file system specific CoW methods.
Is there any news on the reflink system call?
https://lkml.org/lkml/2009/9/14/532

I notice that xattrs are copied with REFLINK_ATTR_NONE.
Is that also the case for BTRFS clone?
In any case that's a change I'm not sure is desired, or worth noting at least.

I don't understand this bit...

> +      if (reflink_ok)
> +        {
             ...
> +        }
> +      else
> +        {
> +          /* When the destination file is aready exists on OCFS2, the
> +             above reflink should fails with EEXIST.  If that happens,
> +             we need not try btrfs clone again since it means the user
> +             is definitely want a OCFS2 reflink.  */
> +          if (errno == EEXIST)

Should this not be errno != ENOTSUP
Or why not try to unlink() (dependent on -f, -n etc.).
At least shouldn't we be falling back to a regular copy when --reflink=auto

> +            {
> +              error (0, errno, _("failed to reflink ..."));
> +              return_val = false;
> +              goto close_src_desc;
> +            }

cheers,
Pádraig.


From MAILER-DAEMON Fri Aug 19 15:33:12 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuUoa-0008Gg-JU
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 15:33:12 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47790)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUoY-0008GN-4r
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:33:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUoX-0006Hp-4X
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:33:10 -0400
Received: from mx1.redhat.com ([209.132.183.28]:60618)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUoW-0006FF-S8
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:33:09 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JJX6qO004819
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <coreutils@gnu.org>; Fri, 19 Aug 2011 15:33:06 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JJX4Sk001838
	for <coreutils@gnu.org>; Fri, 19 Aug 2011 15:33:05 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 99738602EA
	for <coreutils@gnu.org>; Fri, 19 Aug 2011 21:33:04 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: ready for coreutils-8.13
Date: Fri, 19 Aug 2011 21:33:04 +0200
Message-ID: <87mxf58adr.fsf@rho.meyering.net>
Lines: 7
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 19:33:10 -0000

Once we have the parse-datetime <date>T<time> patch,
I'll be ready to release coreutils-8.13.
It's been almost 4 months and over 170 commits since 8.12,
so we're overdue.

If anyone can point out reported problems that they'd like to see
addressed first, please let us know.


From MAILER-DAEMON Fri Aug 19 15:38:43 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuUtv-0001hA-S9
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 15:38:43 -0400
Received: from eggs.gnu.org ([140.186.70.92]:39181)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuUtp-0001gF-OD
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:38:43 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuUto-0001SF-Im
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:38:37 -0400
Received: from mx1.redhat.com ([209.132.183.28]:53941)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuUto-0001S9-Ac
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:38:36 -0400
Received: from int-mx10.intmail.prod.int.phx2.redhat.com
	(int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JJcZdG008629
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 15:38:35 -0400
Received: from [10.3.113.130] (ovpn-113-130.phx2.redhat.com [10.3.113.130])
	by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7JJcYLa014691; Fri, 19 Aug 2011 15:38:35 -0400
Message-ID: <4E4EBBBA.4040503@redhat.com>
Date: Fri, 19 Aug 2011 13:38:34 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: Re: ready for coreutils-8.13
References: <87mxf58adr.fsf@rho.meyering.net>
In-Reply-To: <87mxf58adr.fsf@rho.meyering.net>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 19:38:43 -0000

On 08/19/2011 01:33 PM, Jim Meyering wrote:
> Once we have the parse-datetime<date>T<time>  patch,
> I'll be ready to release coreutils-8.13.
> It's been almost 4 months and over 170 commits since 8.12,
> so we're overdue.
>
> If anyone can point out reported problems that they'd like to see
> addressed first, please let us know.

Do we want to wait for the gnulib workaround for broken AIX 7.1 fstatat? 
  That looks like it will be soon in coming.

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Fri Aug 19 15:41:20 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuUwS-0002bl-71
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 15:41:20 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47050)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUwP-0002Zl-Gm
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:41:18 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUwJ-0003Di-HU
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:41:17 -0400
Received: from mx1.redhat.com ([209.132.183.28]:12614)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuUwJ-0003CS-9M
	for coreutils@gnu.org; Fri, 19 Aug 2011 15:41:11 -0400
Received: from int-mx12.intmail.prod.int.phx2.redhat.com
	(int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JJf96R026250
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <coreutils@gnu.org>; Fri, 19 Aug 2011 15:41:09 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7JJf7Pd023512; Fri, 19 Aug 2011 15:41:09 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 2E3B26022D;
	Fri, 19 Aug 2011 21:41:07 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Eric Blake <eblake@redhat.com>
Subject: Re: ready for coreutils-8.13
In-Reply-To: <4E4EBBBA.4040503@redhat.com> (Eric Blake's message of "Fri, 19
	Aug 2011 13:38:34 -0600")
References: <87mxf58adr.fsf@rho.meyering.net> <4E4EBBBA.4040503@redhat.com>
Date: Fri, 19 Aug 2011 21:41:06 +0200
Message-ID: <87hb5d8a0d.fsf@rho.meyering.net>
Lines: 16
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 19:41:18 -0000

Eric Blake wrote:
> On 08/19/2011 01:33 PM, Jim Meyering wrote:
>> Once we have the parse-datetime<date>T<time>  patch,
>> I'll be ready to release coreutils-8.13.
>> It's been almost 4 months and over 170 commits since 8.12,
>> so we're overdue.
>>
>> If anyone can point out reported problems that they'd like to see
>> addressed first, please let us know.
>
> Do we want to wait for the gnulib workaround for broken AIX 7.1
> fstatat? That looks like it will be soon in coming.

Sure.
In any case I'll probably make a snapshot first
and then wait a day or two before the real release.


From MAILER-DAEMON Fri Aug 19 17:21:02 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuWUw-0005nx-5k
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 17:21:02 -0400
Received: from eggs.gnu.org ([140.186.70.92]:52589)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <auerswal@unix-ag.uni-kl.de>) id 1QuWUs-0005lA-FK
	for coreutils@gnu.org; Fri, 19 Aug 2011 17:20:59 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <auerswal@unix-ag.uni-kl.de>) id 1QuWUr-0001KU-Cp
	for coreutils@gnu.org; Fri, 19 Aug 2011 17:20:58 -0400
Received: from mailgw1.uni-kl.de ([131.246.120.220]:45130)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <auerswal@unix-ag.uni-kl.de>)
	id 1QuWUk-0001GX-JY; Fri, 19 Aug 2011 17:20:50 -0400
Received: from sushi.unix-ag.uni-kl.de (sushi.unix-ag.uni-kl.de
	[IPv6:2001:638:208:ef34:0:ff:fe00:65])
	by mailgw1.uni-kl.de (8.14.3/8.14.3/Debian-5+lenny1) with ESMTP id
	p7JLKlDQ015020
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT);
	Fri, 19 Aug 2011 23:20:47 +0200
Received: from sushi.unix-ag.uni-kl.de (ip6-localhost [IPv6:::1])
	by sushi.unix-ag.uni-kl.de (8.14.3/8.14.3/Debian-5+lenny1) with ESMTP
	id p7JLKl4g027609
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Fri, 19 Aug 2011 23:20:47 +0200
Received: (from auerswal@localhost)
	by sushi.unix-ag.uni-kl.de (8.14.3/8.14.3/Submit) id p7JLKlmJ027608;
	Fri, 19 Aug 2011 23:20:47 +0200
Date: Fri, 19 Aug 2011 23:20:47 +0200
From: Erik Auerswald <auerswal@unix-ag.uni-kl.de>
To: Jim Meyering <jim@meyering.net>
Subject: Re: [PATCH] rm, du, chmod, chown, chgrp: use much less memory for
	large directories
Message-ID: <20110819212047.GB26628@sushi.unix-ag.uni-kl.de>
References: <87vctt9xo1.fsf@rho.meyering.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <87vctt9xo1.fsf@rho.meyering.net>
User-Agent: Mutt/1.5.18 (2008-05-17)
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 131.246.120.220
Cc: bug-findutils@gnu.org, coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 21:20:59 -0000

Hi,

there is a typo in the NEWS entry:

On Fri, Aug 19, 2011 at 06:24:46PM +0200, Jim Meyering wrote:
> [...]
> +  fts-using tools (rm, du, chmod, chgrp, chown, chcon) no longer use memory
> +  proportional to the number of entries in each directory they process.
> +  Before, rm -rf 4-million-entry-directory would consume about 1GiB of memory.
> +  Now, it uses less than 30GB, no matter how many entries there are.
                              ^
                              MB

Thanks,
Erik
-- 
I don't want to see the state of the file when I'm editing.
                        -- Ken Thompson


From MAILER-DAEMON Fri Aug 19 17:23:39 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuWXT-0006Sq-I3
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 17:23:39 -0400
Received: from eggs.gnu.org ([140.186.70.92]:44436)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuWXR-0006Rj-7U
	for coreutils@gnu.org; Fri, 19 Aug 2011 17:23:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuWXB-0002hw-Vk
	for coreutils@gnu.org; Fri, 19 Aug 2011 17:23:37 -0400
Received: from mx1.redhat.com ([209.132.183.28]:43627)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <eblake@redhat.com>) id 1QuWXB-0002hH-J3
	for coreutils@gnu.org; Fri, 19 Aug 2011 17:23:21 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JLNKu3031878
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Fri, 19 Aug 2011 17:23:20 -0400
Received: from [10.3.113.130] (ovpn-113-130.phx2.redhat.com [10.3.113.130])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JLNK7D032318; Fri, 19 Aug 2011 17:23:20 -0400
Message-ID: <4E4ED447.1020002@redhat.com>
Date: Fri, 19 Aug 2011 15:23:19 -0600
From: Eric Blake <eblake@redhat.com>
Organization: Red Hat
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110621 Fedora/3.1.11-1.fc14
	Lightning/1.0b3pre Mnenhy/0.8.3 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: Re: ready for coreutils-8.13
References: <87mxf58adr.fsf@rho.meyering.net>
In-Reply-To: <87mxf58adr.fsf@rho.meyering.net>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 21:23:38 -0000

On 08/19/2011 01:33 PM, Jim Meyering wrote:
> Once we have the parse-datetime<date>T<time>  patch,
> I'll be ready to release coreutils-8.13.
> It's been almost 4 months and over 170 commits since 8.12,
> so we're overdue.
>
> If anyone can point out reported problems that they'd like to see
> addressed first, please let us know.

Hmm, as long as we're releasing for an fts improvement, I wonder if it 
would be worth getting du --noatime (and friends) implemented, to take 
advantage of gnulib's FTS_NOATIME.  I mentioned doing that a while ago 
when I made the gnulib change, but guess I haven't gotten to it yet.

-- 
Eric Blake   eblake@redhat.com    +1-801-349-2682
Libvirt virtualization library http://libvirt.org


From MAILER-DAEMON Fri Aug 19 18:05:08 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuXBc-0004FQ-MZ
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 18:05:08 -0400
Received: from eggs.gnu.org ([140.186.70.92]:38951)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuXBZ-00048k-BB
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:05:06 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuXBY-0006Jh-EZ
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:05:05 -0400
Received: from mx1.redhat.com ([209.132.183.28]:9231)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QuXBX-0006IG-Ta
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:05:04 -0400
Received: from int-mx01.intmail.prod.int.phx2.redhat.com
	(int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7JM53Dk008649
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <coreutils@gnu.org>; Fri, 19 Aug 2011 18:05:03 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7JM52qU016302; Fri, 19 Aug 2011 18:05:02 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id BAA5B60170;
	Sat, 20 Aug 2011 00:05:01 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Eric Blake <eblake@redhat.com>
Subject: Re: ready for coreutils-8.13
In-Reply-To: <4E4ED447.1020002@redhat.com> (Eric Blake's message of "Fri, 19
	Aug 2011 15:23:19 -0600")
References: <87mxf58adr.fsf@rho.meyering.net> <4E4ED447.1020002@redhat.com>
Date: Sat, 20 Aug 2011 00:05:01 +0200
Message-ID: <878vqp6os2.fsf@rho.meyering.net>
Lines: 18
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 22:05:06 -0000

Eric Blake wrote:

> On 08/19/2011 01:33 PM, Jim Meyering wrote:
>> Once we have the parse-datetime<date>T<time>  patch,
>> I'll be ready to release coreutils-8.13.
>> It's been almost 4 months and over 170 commits since 8.12,
>> so we're overdue.
>>
>> If anyone can point out reported problems that they'd like to see
>> addressed first, please let us know.
>
> Hmm, as long as we're releasing for an fts improvement, I wonder if it
> would be worth getting du --noatime (and friends) implemented, to take
> advantage of gnulib's FTS_NOATIME.  I mentioned doing that a while ago
> when I made the gnulib change, but guess I haven't gotten to it yet.

There's no hurry to add that, as far as I'm concerned,
but if you want to do it now I won't object.


From MAILER-DAEMON Fri Aug 19 18:45:05 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QuXoH-0007Wb-Lj
	for mharc-coreutils@gnu.org; Fri, 19 Aug 2011 18:45:05 -0400
Received: from eggs.gnu.org ([140.186.70.92]:46446)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuXoE-0007TR-R6
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:45:03 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuXoD-0002Tz-Kw
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:45:02 -0400
Received: from mail2.vodafone.ie ([213.233.128.44]:51200)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QuXoD-0002R7-Ct
	for coreutils@gnu.org; Fri, 19 Aug 2011 18:45:01 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBACPnTk5tTjRH/2dsb2JhbAAMNapFAQEFMgFGEAsNCwkWDwkDAgECAUUGDQEHAQGHcbhGhkgEmD2LTA
Received: from unknown (HELO [192.168.1.79]) ([109.78.52.71])
	by mail2.vodafone.ie with ESMTP; 19 Aug 2011 23:44:57 +0100
Message-ID: <4E4EE769.7080607@draigBrady.com>
Date: Fri, 19 Aug 2011 23:44:57 +0100
From: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: Re: ready for coreutils-8.13
References: <87mxf58adr.fsf@rho.meyering.net>
In-Reply-To: <87mxf58adr.fsf@rho.meyering.net>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.44
Cc: coreutils@gnu.org, andras@dns.net
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 22:45:03 -0000

On 08/19/2011 08:33 PM, Jim Meyering wrote:
> Once we have the parse-datetime <date>T<time> patch,
> I'll be ready to release coreutils-8.13.
> It's been almost 4 months and over 170 commits since 8.12,
> so we're overdue.
> 
> If anyone can point out reported problems that they'd like to see
> addressed first, please let us know.

I'd liked to see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=9321
looked into before release (segfaults in sort)

cheers,
Pádraig.


From MAILER-DAEMON Sat Aug 20 02:16:27 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Quer5-0005Bh-F5
	for mharc-coreutils@gnu.org; Sat, 20 Aug 2011 02:16:27 -0400
Received: from eggs.gnu.org ([140.186.70.92]:36000)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quer2-0005BT-Qm
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:16:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quer1-0006Od-Ec
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:16:24 -0400
Received: from mx1.redhat.com ([209.132.183.28]:64847)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quer1-0006OX-2f
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:16:23 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7K6GMdK005530
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sat, 20 Aug 2011 02:16:22 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7K6GKv9008206; Sat, 20 Aug 2011 02:16:21 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 2344F60036;
	Sat, 20 Aug 2011 08:16:20 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Erik Auerswald <auerswal@unix-ag.uni-kl.de>
Subject: Re: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories
In-Reply-To: <20110819212047.GB26628@sushi.unix-ag.uni-kl.de> (Erik
	Auerswald's message of "Fri, 19 Aug 2011 23:20:47 +0200")
References: <87vctt9xo1.fsf@rho.meyering.net>
	<20110819212047.GB26628@sushi.unix-ag.uni-kl.de>
Date: Sat, 20 Aug 2011 08:16:20 +0200
Message-ID: <87zkj46217.fsf@rho.meyering.net>
Lines: 38
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Aug 2011 06:16:25 -0000

Erik Auerswald wrote:
> there is a typo in the NEWS entry:
>
> On Fri, Aug 19, 2011 at 06:24:46PM +0200, Jim Meyering wrote:
>> [...]
>> +  fts-using tools (rm, du, chmod, chgrp, chown, chcon) no longer use memory
>> +  proportional to the number of entries in each directory they process.
>> +  Before, rm -rf 4-million-entry-directory would consume about 1GiB of memory.
>> +  Now, it uses less than 30GB, no matter how many entries there are.

Thanks!
I've fixed it with this:

>From 423b079f5324b9097d487e752b71a8399b970ba9 Mon Sep 17 00:00:00 2001
From: Erik Auerswald <auerswal@unix-ag.uni-kl.de>
Date: Sat, 20 Aug 2011 08:12:31 +0200
Subject: [PATCH] doc: correct typo in yesterday's NEWS entry: 30GB -> 30MB

* NEWS: s/30GB/30MB/
---
 NEWS |    2 +-
 1 files changed, 1 insertions(+), 1 deletions(-)

diff --git a/NEWS b/NEWS
index b356a03..569c33b 100644
--- a/NEWS
+++ b/NEWS
@@ -20,7 +20,7 @@ GNU coreutils NEWS                                    -*- outline -*-
   fts-using tools (rm, du, chmod, chgrp, chown, chcon) no longer use memory
   proportional to the number of entries in each directory they process.
   Before, rm -rf 4-million-entry-directory would consume about 1GiB of memory.
-  Now, it uses less than 30GB, no matter how many entries there are.
+  Now, it uses less than 30MB, no matter how many entries there are.
   [this bug was inherent in the use of fts: thus, for rm the bug was
   introduced in coreutils-8.0.  The prior implementation of rm did not use
   as much memory.  du, chmod, chgrp and chown started using fts in 6.0.
--
1.7.6.857.gf34cf


From MAILER-DAEMON Sat Aug 20 02:33:40 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Quf7j-0003BU-U9
	for mharc-coreutils@gnu.org; Sat, 20 Aug 2011 02:33:39 -0400
Received: from eggs.gnu.org ([140.186.70.92]:44723)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quf7h-000385-Fv
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:33:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quf7f-00045v-1R
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:33:37 -0400
Received: from mx1.redhat.com ([209.132.183.28]:38875)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Quf7e-00045W-FH
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:33:34 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7K6XUAJ028382
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sat, 20 Aug 2011 02:33:30 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7K6XTcs011143; Sat, 20 Aug 2011 02:33:30 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 60A8F60241;
	Sat, 20 Aug 2011 08:33:29 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: =?iso-8859-1?Q?P=E1draig?= Brady <P@draigBrady.com>
Subject: Re: ready for coreutils-8.13
In-Reply-To: <4E4EE769.7080607@draigBrady.com> (=?iso-8859-1?Q?=22P=E1drai?=
	=?iso-8859-1?Q?g?= Brady"'s message of
	"Fri, 19 Aug 2011 23:44:57 +0100")
References: <87mxf58adr.fsf@rho.meyering.net> <4E4EE769.7080607@draigBrady.com>
Date: Sat, 20 Aug 2011 08:33:29 +0200
Message-ID: <87obzk618m.fsf@rho.meyering.net>
Lines: 15
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org, andras@dns.net
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Aug 2011 06:33:38 -0000

P=E1draig Brady wrote:

> On 08/19/2011 08:33 PM, Jim Meyering wrote:
>> Once we have the parse-datetime <date>T<time> patch,
>> I'll be ready to release coreutils-8.13.
>> It's been almost 4 months and over 170 commits since 8.12,
>> so we're overdue.
>>
>> If anyone can point out reported problems that they'd like to see
>> addressed first, please let us know.
>
> I'd liked to see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D9321
> looked into before release (segfaults in sort)

So would I.  I've just replied there.


From MAILER-DAEMON Sat Aug 20 02:53:12 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QufQe-0005th-C9
	for mharc-coreutils@gnu.org; Sat, 20 Aug 2011 02:53:12 -0400
Received: from eggs.gnu.org ([140.186.70.92]:35940)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QufQc-0005sf-E1
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:53:11 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QufQb-0008CP-AR
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:53:10 -0400
Received: from mx1.redhat.com ([209.132.183.28]:54456)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QufQb-0008CF-28
	for coreutils@gnu.org; Sat, 20 Aug 2011 02:53:09 -0400
Received: from int-mx09.intmail.prod.int.phx2.redhat.com
	(int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7K6r6c8021308
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sat, 20 Aug 2011 02:53:06 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7K6r5Nf032624; Sat, 20 Aug 2011 02:53:05 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id B049E602C9;
	Sat, 20 Aug 2011 08:53:04 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Dmitry Ilyin <idv1985@gmail.com>
Subject: attitude
In-Reply-To: <4E4BBA09.1030707@gmail.com> (Dmitry Ilyin's message of "Wed, 17
	Aug 2011 16:54:33 +0400")
References: <SNT130-W8CFE5697A7B8C43A2AB7DC6290@phx.gbl>
	<4E4BBA09.1030707@gmail.com>
Date: Sat, 20 Aug 2011 08:53:04 +0200
Message-ID: <87ipps60bz.fsf_-_@rho.meyering.net>
Lines: 19
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Aug 2011 06:53:11 -0000

Dmitry Ilyin wrote:
> 16.08.2011 04:18, Marco Tulio Cruz Codina =D0=BF=D0=B8=D1=88=D0=B5=D1=82:
>> hi, sorry to bother you but i need your help, i made a huge mistake, i a=
cidentally deleted the core utilities (/bin) program from my 32gb ipad 2, u=
sing cydia.
>
> 1. Ipad coreutils are from macos or freebsd and not from GNU afaik.
> 2. DO NOT install cydia and other random crap on iPad. Use ONLY stuff fro=
m AppStore.
> 3. Get Android if you want to tinker with your device. Mac devices are fo=
r normal users.
>
> This may help you
...

Thanks for helping.
We were all novices once.
There was a time when each of us didn't even know what "FAQ" meant,
though for some it goes back to before that acronym came into use.

Maintaining a good attitude/environment on lists like this one is
more conducive to efficient productivity (high S/N ratio and no
flame wars here).  It probably also helps to attract contributors.


From MAILER-DAEMON Sun Aug 21 09:48:37 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qv8OD-0003r3-Cq
	for mharc-coreutils@gnu.org; Sun, 21 Aug 2011 09:48:37 -0400
Received: from eggs.gnu.org ([140.186.70.92]:52593)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qv8O9-0003om-ER
	for coreutils@gnu.org; Sun, 21 Aug 2011 09:48:34 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qv8O7-00087p-Jo
	for coreutils@gnu.org; Sun, 21 Aug 2011 09:48:33 -0400
Received: from acsinet15.oracle.com ([141.146.126.227]:63833)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jeff.liu@oracle.com>) id 1Qv8O7-0007uV-Cm
	for coreutils@gnu.org; Sun, 21 Aug 2011 09:48:31 -0400
Received: from rtcsinet22.oracle.com (rtcsinet22.oracle.com [66.248.204.30])
	by acsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7LDmG3M031374
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sun, 21 Aug 2011 13:48:18 GMT
Received: from acsmt357.oracle.com (acsmt357.oracle.com [141.146.40.157])
	by rtcsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7LDmE1i001467
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Sun, 21 Aug 2011 13:48:15 GMT
Received: from abhmt116.oracle.com (abhmt116.oracle.com [141.146.116.68])
	by acsmt357.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7LDm9XU019155; Sun, 21 Aug 2011 08:48:09 -0500
Received: from [192.168.1.101] (/123.119.99.34)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Sun, 21 Aug 2011 06:48:08 -0700
Subject: Re: cp/reflink support for OCFS2
Mime-Version: 1.0 (Apple Message framework v1082)
Content-Type: multipart/alternative; boundary=Apple-Mail-1-619830743
From: Jeff liu <jeff.liu@oracle.com>
In-Reply-To: <4E4EA8FC.9000707@draigBrady.com>
Date: Sun, 21 Aug 2011 21:47:59 +0800
Message-Id: <3B3D747D-D1E5-471C-AF68-B445BAC05706@oracle.com>
References: <4DC01574.40200@oracle.com> <4E4EA8FC.9000707@draigBrady.com>
To: =?GB2312?Q?P=A8=A2draig_Brady?= <P@draigbrady.com>
X-Mailer: Apple Mail (2.1082)
X-Source-IP: rtcsinet22.oracle.com [66.248.204.30]
X-CT-RefId: str=0001.0A090208.4E510CA2.00C8,ss=1,re=-2.300,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 141.146.126.227
Cc: Sunil Mushran <sunil.mushran@oracle.com>, Coreutils <coreutils@gnu.org>,
	Chris Mason <chris.mason@oracle.com>, jlbec@evilplan.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sun, 21 Aug 2011 13:48:35 -0000


--Apple-Mail-1-619830743
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=GB2312


Thanks for your review.

> On 05/03/2011 03:47 PM, jeff.liu wrote:
>> Hello All,
>>=20
>> I'd like to introduce the ocfs2 reflink support to cp(1) when it was =
called with
>> "--reflink=3D[WHEN]".
>> With this patch, `cp' will try OCFS2 reflink first, if it fails with =
EEXIST, IMHO, it definitely
>> means the user is intended to perform reflink on OCFS2, but the =
destination file is already exists,
>> so set the retval =3D false and return, or try Btrfs clone again.
>>=20
>> I have done some tests, includes reflink on OCFS2, reflink to an =
existing file, reflink files
>> cross-filesystems, and reflink attributes only, all works fine.
>>=20
>> For the test automation, the existing reflink test are presume the =
tests running on either file
>> systems with Cow support IMO, maybe we can improve them with real =
filesystems on loop device?
>>=20
>> Also, the old bug ticket for this topic will be closed at:
>> http://lists.gnu.org/archive/html/bug-coreutils/2010-04/msg00185.html
>=20
> Thanks for doing this.
>=20
> It's a pity we've to try different file system specific CoW methods.
> Is there any news on the reflink system call?
> https://lkml.org/lkml/2009/9/14/532

Looks there is no update recently;

Hi Joel and Sunil,
Would you please add some comments in this point.

>=20
> I notice that xattrs are copied with REFLINK_ATTR_NONE.


> xattrs will not copied if call ioctl(2) with REFLINK_ATTR_NONE,
> reflink xattrs only if
> REFLINK_ATTR_PRESERVE is specified, which were shown as following:
>=20
> Firstly, invoking cp(1) without "-p" option:
> jeff@jeff-laptop:~/opensource/coreutils$ setfacl -m user:jeff:rwx =
/ocfs2/test
> jeff@jeff-laptop:~/opensource/coreutils$ ./src/cp --reflink=3Dalways
> /ocfs2/test /ocfs2/test.reflink
>=20
> jeff@jeff-laptop:~/opensource/coreutils$ ls -l /ocfs2/test.reflink
> -rw-r-xr-- 1 jeff jeff 0 2011-08-21 21:16 /ocfs2/test.reflink
>=20
> jeff@jeff-laptop:~/opensource/coreutils$ getfacl /ocfs2/test.reflink
> getfacl: Removing leading '/' from absolute path names
> # file: ocfs2/test.reflink
> # owner: jeff
> # group: jeff
> user::rw-
> group::r-x
> other::r--
>=20
> Next, try to copy xattrs too by specifying "-p":
> --------------------------------------------------------------
> jeff@jeff-laptop:~/opensource/coreutils$ ./src/cp --reflink=3Dalways =
-p
> /ocfs2/test /ocfs2/test.reflink_with_xattr
>=20
> jeff@jeff-laptop:~/opensource/coreutils$ getfacl =
/ocfs2/test.reflink_with_xattr
> getfacl: Removing leading '/' from absolute path names
> # file: ocfs2/test.reflink_with_xattr
> # owner: jeff
> # group: jeff
> user::rw-
> user:jeff:rwx
> group::r--
> mask::rwx
> other::r--
>=20
>  Is that also the case for BTRFS clone?
Btrfs will not try to clone the xattrs by default too.

> In any case that's a change I'm not sure is desired, or worth noting =
at least.
>=20
> I don't understand this bit...
>=20
>> +      if (reflink_ok)
>> +        {
>             ...
>> +        }
>> +      else
>> +        {
>> +          /* When the destination file is aready exists on OCFS2, =
the
>> +             above reflink should fails with EEXIST.  If that =
happens,
>> +             we need not try btrfs clone again since it means the =
user
>> +             is definitely want a OCFS2 reflink.  */
>> +          if (errno =3D=3D EEXIST)
>=20
> Should this not be errno !=3D ENOTSUP

Thanks for pointing this out! I should checking errno !=3D ENOTSUP here, =
then break if "--sparse=3Dalways" was
specified, otherwise, let copy process go ahead.

> Or why not try to unlink() (dependent on -f, -n etc.).
> At least shouldn't we be falling back to a regular copy when =
--reflink=3Dauto
The current patch will fall back to a normal copy if reflink falled in =
both cases(ocfs2, btrfs), if cp(1) was
invoked with "--reflink=3Dauto". :-P.

Thanks,
-Jeff
>=20
>> +            {
>> +              error (0, errno, _("failed to reflink ..."));
>> +              return_val =3D false;
>> +              goto close_src_desc;
>> +            }
>=20
> cheers,
> P=A8=A2draig.


--Apple-Mail-1-619830743
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
	charset=GB2312

<html><head></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space; =
"><br><div><div>Thanks for your review.</div><br =
class=3D"Apple-interchange-newline"><blockquote type=3D"cite"><div>On =
05/03/2011 03:47 PM, jeff.liu wrote:<br><blockquote type=3D"cite">Hello =
All,<br></blockquote><blockquote =
type=3D"cite"><br></blockquote><blockquote type=3D"cite">I'd like to =
introduce the ocfs2 reflink support to cp(1) when it was called =
with<br></blockquote><blockquote =
type=3D"cite">"--reflink=3D[WHEN]".<br></blockquote><blockquote =
type=3D"cite">With this patch, `cp' will try OCFS2 reflink first, if it =
fails with EEXIST, IMHO, it definitely<br></blockquote><blockquote =
type=3D"cite">means the user is intended to perform reflink on OCFS2, =
but the destination file is already exists,<br></blockquote><blockquote =
type=3D"cite">so set the retval =3D false and return, or try Btrfs clone =
again.<br></blockquote><blockquote =
type=3D"cite"><br></blockquote><blockquote type=3D"cite">I have done =
some tests, includes reflink on OCFS2, reflink to an existing file, =
reflink files<br></blockquote><blockquote type=3D"cite">cross-filesystems,=
 and reflink attributes only, all works =
fine.<br></blockquote><blockquote =
type=3D"cite"><br></blockquote><blockquote type=3D"cite">For the test =
automation, the existing reflink test are presume the tests running on =
either file<br></blockquote><blockquote type=3D"cite">systems with Cow =
support IMO, maybe we can improve them with real filesystems on loop =
device?<br></blockquote><blockquote =
type=3D"cite"><br></blockquote><blockquote type=3D"cite">Also, the old =
bug ticket for this topic will be closed at:<br></blockquote><blockquote =
type=3D"cite"><a =
href=3D"http://lists.gnu.org/archive/html/bug-coreutils/2010-04/msg00185.h=
tml">http://lists.gnu.org/archive/html/bug-coreutils/2010-04/msg00185.html=
</a><br></blockquote><br>Thanks for doing this.<br><br>It's a pity we've =
to try different file system specific CoW methods.<br>Is there any news =
on the reflink system call?<br><a =
href=3D"https://lkml.org/lkml/2009/9/14/532">https://lkml.org/lkml/2009/9/=
14/532</a></div></blockquote><br>Looks there is no update =
recently;</div><div><br></div><div>Hi Joel and Sunil,</div><div>Would =
you please add some comments in this point.</div><div><br><blockquote =
type=3D"cite"><div><font class=3D"Apple-style-span" =
color=3D"#000000"><br></font>I notice that xattrs are copied with =
REFLINK_ATTR_NONE.<br></div></blockquote><div><br></div><br><blockquote =
type=3D"cite">xattrs will not copied if call ioctl(2) with =
REFLINK_ATTR_NONE,<br>reflink xattrs only if<br>REFLINK_ATTR_PRESERVE is =
specified, which were shown as following:<br><br>Firstly, invoking cp(1) =
without "-p" option:<br>jeff@jeff-laptop:~/opensource/coreutils$ setfacl =
-m user:jeff:rwx /ocfs2/test<br>jeff@jeff-laptop:~/opensource/coreutils$ =
./src/cp --reflink=3Dalways<br>/ocfs2/test =
/ocfs2/test.reflink<br><br>jeff@jeff-laptop:~/opensource/coreutils$ ls =
-l /ocfs2/test.reflink<br>-rw-r-xr-- 1 jeff jeff 0 2011-08-21 21:16 =
/ocfs2/test.reflink<br><br>jeff@jeff-laptop:~/opensource/coreutils$ =
getfacl /ocfs2/test.reflink<br>getfacl: Removing leading '/' from =
absolute path names<br># file: ocfs2/test.reflink<br># owner: jeff<br># =
group: jeff<br>user::rw-<br>group::r-x<br>other::r--<br><br>Next, try to =
copy xattrs too by specifying =
"-p":<br>--------------------------------------------------------------<br=
>jeff@jeff-laptop:~/opensource/coreutils$ ./src/cp --reflink=3Dalways =
-p<br>/ocfs2/test =
/ocfs2/test.reflink_with_xattr<br><br>jeff@jeff-laptop:~/opensource/coreut=
ils$ getfacl /ocfs2/test.reflink_with_xattr<br>getfacl: Removing leading =
'/' from absolute path names<br># file: =
ocfs2/test.reflink_with_xattr<br># owner: jeff<br># group: =
jeff<br>user::rw-<br>user:jeff:rwx<br>group::r--<br>mask::rwx<br>other::r-=
-<br><br><div>&nbsp;Is that also the case for BTRFS =
clone?<br></div></blockquote>Btrfs will not try to clone the xattrs by =
default too.</div><div><br><blockquote type=3D"cite"><div>In any case =
that's a change I'm not sure is desired, or worth noting at =
least.<br><br>I don't understand this bit...<br><br><blockquote =
type=3D"cite">+ &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if =
(reflink_ok)<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{<br></blockquote> =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;..=
.<br><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<br></blockquote><blockquote =
type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;else<br></blockquote><blockquote =
type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{<br></blockquote><blockquote =
type=3D"cite">+ &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;/* =
When the destination file is aready exists on OCFS2, =
the<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;ab=
ove reflink should fails with EEXIST. &nbsp;If that =
happens,<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;we=
 need not try btrfs clone again since it means the =
user<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;is=
 definitely want a OCFS2 reflink. &nbsp;*/<br></blockquote><blockquote =
type=3D"cite">+ &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if =
(errno =3D=3D EEXIST)<br></blockquote><br>Should this not be errno !=3D =
ENOTSUP<br></div></blockquote><div><br></div>Thanks for pointing this =
out! I should checking errno !=3D ENOTSUP here, then break if =
"--sparse=3Dalways" was</div><div>specified, otherwise, let copy process =
go ahead.</div><div><br><blockquote type=3D"cite"><div>Or why not try to =
unlink() (dependent on -f, -n etc.).<br>At least shouldn't we be falling =
back to a regular copy when --reflink=3Dauto<br></div></blockquote>The =
current patch will fall back to a normal copy if reflink falled in both =
cases(ocfs2, btrfs), if cp(1) was</div><div>invoked with =
"--reflink=3Dauto". =
:-P.</div><div><br></div><div>Thanks,</div><div>-Jeff<br><blockquote =
type=3D"cite"><div><br><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;{<br></b=
lockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;error (0, errno, _("failed to reflink =
..."));<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;return_val =3D false;<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;goto close_src_desc;<br></blockquote><blockquote type=3D"cite">+ =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;}<br></b=
lockquote><br>cheers,<br>P=A8=A2draig.<br></div></blockquote></div><br></b=
ody></html>=

--Apple-Mail-1-619830743--


From MAILER-DAEMON Mon Aug 22 12:09:00 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QvX3c-0006uq-Q6
	for mharc-coreutils@gnu.org; Mon, 22 Aug 2011 12:09:00 -0400
Received: from eggs.gnu.org ([140.186.70.92]:53316)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <sunil.mushran@oracle.com>) id 1QvWpy-0001Uk-F9
	for coreutils@gnu.org; Mon, 22 Aug 2011 11:54:55 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <sunil.mushran@oracle.com>) id 1QvWpx-0003Lo-5x
	for coreutils@gnu.org; Mon, 22 Aug 2011 11:54:54 -0400
Received: from acsinet15.oracle.com ([141.146.126.227]:53466)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <sunil.mushran@oracle.com>) id 1QvWpw-0003LW-RD
	for coreutils@gnu.org; Mon, 22 Aug 2011 11:54:53 -0400
Received: from acsinet21.oracle.com (acsinet21.oracle.com [141.146.126.237])
	by acsinet15.oracle.com (Switch-3.4.4/Switch-3.4.4) with ESMTP id
	p7MFsexB007364
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Mon, 22 Aug 2011 15:54:41 GMT
Received: from acsmt358.oracle.com (acsmt358.oracle.com [141.146.40.158])
	by acsinet21.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id
	p7MFsdYN000195
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO);
	Mon, 22 Aug 2011 15:54:39 GMT
Received: from abhmt111.oracle.com (abhmt111.oracle.com [141.146.116.63])
	by acsmt358.oracle.com (8.12.11.20060308/8.12.11) with ESMTP id
	p7MFsXOP005665; Mon, 22 Aug 2011 10:54:33 -0500
Received: from [192.168.0.139] (/75.61.142.100)
	by default (Oracle Beehive Gateway v4.0)
	with ESMTP ; Mon, 22 Aug 2011 08:54:33 -0700
Message-ID: <4E527BBA.2030907@oracle.com>
Date: Mon, 22 Aug 2011 08:54:34 -0700
From: Sunil Mushran <sunil.mushran@oracle.com>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.18) Gecko/20110617 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jeff liu <jeff.liu@oracle.com>
Subject: Re: cp/reflink support for OCFS2
References: <4DC01574.40200@oracle.com> <4E4EA8FC.9000707@draigBrady.com>
	<3B3D747D-D1E5-471C-AF68-B445BAC05706@oracle.com>
In-Reply-To: <3B3D747D-D1E5-471C-AF68-B445BAC05706@oracle.com>
Content-Type: text/plain; charset=GB2312
Content-Transfer-Encoding: 7bit
X-Source-IP: acsinet21.oracle.com [141.146.126.237]
X-Auth-Type: Internal IP
X-CT-RefId: str=0001.0A020207.4E527BC2.0072:SCFMA922111,ss=1,re=-4.000,fgs=0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 1)
X-Received-From: 141.146.126.227
X-Mailman-Approved-At: Mon, 22 Aug 2011 12:08:59 -0400
Cc: Coreutils <coreutils@gnu.org>, Chris Mason <chris.mason@oracle.com>,
	jlbec@evilplan.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Mon, 22 Aug 2011 15:54:55 -0000

On 08/21/2011 06:47 AM, Jeff liu wrote:
>
> Thanks for your review.
>
>> On 05/03/2011 03:47 PM, jeff.liu wrote:
>>> Hello All,
>>>
>>> I'd like to introduce the ocfs2 reflink support to cp(1) when it was
>>> called with
>>> "--reflink=[WHEN]".
>>> With this patch, `cp' will try OCFS2 reflink first, if it fails with
>>> EEXIST, IMHO, it definitely
>>> means the user is intended to perform reflink on OCFS2, but the
>>> destination file is already exists,
>>> so set the retval = false and return, or try Btrfs clone again.
>>>
>>> I have done some tests, includes reflink on OCFS2, reflink to an
>>> existing file, reflink files
>>> cross-filesystems, and reflink attributes only, all works fine.
>>>
>>> For the test automation, the existing reflink test are presume the
>>> tests running on either file
>>> systems with Cow support IMO, maybe we can improve them with real
>>> filesystems on loop device?
>>>
>>> Also, the old bug ticket for this topic will be closed at:
>>> http://lists.gnu.org/archive/html/bug-coreutils/2010-04/msg00185.html
>>
>> Thanks for doing this.
>>
>> It's a pity we've to try different file system specific CoW methods.
>> Is there any news on the reflink system call?
>> https://lkml.org/lkml/2009/9/14/532
>
> Looks there is no update recently;
>
> Hi Joel and Sunil,
> Would you please add some comments in this point.
>

Last I checked, the syscall was supposed to be called fastcopy(). Probably
with the same arguments, etc. Joel knows more.

My suggestion for: cp --fast . And force users to specify it.


From MAILER-DAEMON Tue Aug 23 03:44:26 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qvles-0002cm-Iu
	for mharc-coreutils@gnu.org; Tue, 23 Aug 2011 03:44:26 -0400
Received: from eggs.gnu.org ([140.186.70.92]:34694)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1Qvleq-0002cb-AE
	for coreutils@gnu.org; Tue, 23 Aug 2011 03:44:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1Qvlep-000302-3x
	for coreutils@gnu.org; Tue, 23 Aug 2011 03:44:24 -0400
Received: from senmx12-mx.siemens-enterprise.com ([62.134.46.10]:58128)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1Qvlen-0002zG-9d; Tue, 23 Aug 2011 03:44:21 -0400
Received: from MCHP064A.global-ad.net (unknown [172.29.37.63])
	by senmx12-mx.siemens-enterprise.com (Server) with ESMTP id
	E9CD023F03F0; Tue, 23 Aug 2011 09:44:18 +0200 (CEST)
Received: from MCHP058A.global-ad.net ([172.29.37.55]) by
	MCHP064A.global-ad.net ([172.29.37.63]) with mapi;
	Tue, 23 Aug 2011 09:44:19 +0200
From: "Voelker, Bernhard" <bernhard.voelker@siemens-enterprise.com>
To: Jim Meyering <jim@meyering.net>, "coreutils@gnu.org" <coreutils@gnu.org>, 
	"bug-findutils@gnu.org" <bug-findutils@gnu.org>
Date: Tue, 23 Aug 2011 09:44:21 +0200
Subject: RE: [PATCH] rm, du, chmod, chown,	chgrp: use much less memory for
	large directories
Thread-Topic: [PATCH] rm, du, chmod, chown,	chgrp: use much less memory for
	large directories
Thread-Index: AcxejIo+iFxG/TO1Ri6osKdva37blgC2s0Kw
Message-ID: <7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
References: <87vctt9xo1.fsf@rho.meyering.net>
In-Reply-To: <87vctt9xo1.fsf@rho.meyering.net>
Accept-Language: de-DE, en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
acceptlanguage: de-DE, en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 62.134.46.10
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Aug 2011 07:44:25 -0000

Jim Meyering wrote:

+++ b/tests/rm/4-million-entry-dir
...
+# Put 4M files in a directory.
+mkdir d && cd d || framework_failure_
+seq 4000000|xargs touch || framework_failure_
+
+cd ..
+
+# Restricted to 50MB, rm from coreutils-8.12 would fail with a
+# diagnostic like "rm: fts_read failed: Cannot allocate memory".
+ulimit -v 50000
+rm -rf d || fail=3D1
+
+Exit $fail

wouldn't this leave behind lots of used inodes in case of a failure?

Additionally, looking at 2 of my (not so big) SLES servers:
most partitions only have <500000 inodes (/ /opt /usr /tmp /var),
so maybe it's worth checking beforehand whether the filesystem
meets the test requirements. What do you think?

Have a nice day,
Berny



From MAILER-DAEMON Tue Aug 23 05:49:22 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qvnbm-0006qm-3N
	for mharc-coreutils@gnu.org; Tue, 23 Aug 2011 05:49:22 -0400
Received: from eggs.gnu.org ([140.186.70.92]:50774)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qvnbi-0006qN-LM
	for coreutils@gnu.org; Tue, 23 Aug 2011 05:49:20 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qvnbh-0007cS-AR
	for coreutils@gnu.org; Tue, 23 Aug 2011 05:49:18 -0400
Received: from mx1.redhat.com ([209.132.183.28]:65535)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>)
	id 1Qvnbf-0007bu-0C; Tue, 23 Aug 2011 05:49:15 -0400
Received: from int-mx01.intmail.prod.int.phx2.redhat.com
	(int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7N9nD5k032504
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Tue, 23 Aug 2011 05:49:14 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7N9nCuk018113; Tue, 23 Aug 2011 05:49:13 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id C63AB60092;
	Tue, 23 Aug 2011 11:49:11 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: "Voelker\, Bernhard" <bernhard.voelker@siemens-enterprise.com>
Subject: Re: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories
In-Reply-To: <7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
	(Bernhard Voelker's message of "Tue, 23 Aug 2011 09:44:21 +0200")
References: <87vctt9xo1.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
Date: Tue, 23 Aug 2011 11:49:11 +0200
Message-ID: <87hb58qwyw.fsf@rho.meyering.net>
Lines: 40
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: "bug-findutils@gnu.org" <bug-findutils@gnu.org>,
	"coreutils@gnu.org" <coreutils@gnu.org>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Aug 2011 09:49:20 -0000

Voelker, Bernhard wrote:

> Jim Meyering wrote:
>
> +++ b/tests/rm/4-million-entry-dir
> ...
> +# Put 4M files in a directory.
> +mkdir d && cd d || framework_failure_
> +seq 4000000|xargs touch || framework_failure_
> +
> +cd ..
> +
> +# Restricted to 50MB, rm from coreutils-8.12 would fail with a
> +# diagnostic like "rm: fts_read failed: Cannot allocate memory".
> +ulimit -v 50000
> +rm -rf d || fail=1
> +
> +Exit $fail
>
> wouldn't this leave behind lots of used inodes in case of a failure?

No, at least I hope not.
The test is run via a framework (tests/init.sh) that creates a temporary
directory in which those commands are run, and it (init.sh) also arranges
to remove that temporary directory upon exit, interrupt, etc.

> Additionally, looking at 2 of my (not so big) SLES servers:
> most partitions only have <500000 inodes (/ /opt /usr /tmp /var),
> so maybe it's worth checking beforehand whether the filesystem
> meets the test requirements. What do you think?

If the setup phase fails (the seq...|xargs touch), then the test fails
with a diagnostic already.  And considering that the test is already
marked as "very expensive", and hence not run by default (you have to have
to set RUN_VERY_EXPENSIVE_TESTS=yes in order to run it), I think we're
ok, since I'd prefer a failure to a skip in that case.

People who take the trouble to run the very expensive tests (I'd be
surprised if there are more than a handful) probably want to know when/if
their test environment is causing test failures.


From MAILER-DAEMON Tue Aug 23 06:25:26 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QvoAg-0003TV-G3
	for mharc-coreutils@gnu.org; Tue, 23 Aug 2011 06:25:26 -0400
Received: from eggs.gnu.org ([140.186.70.92]:44838)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1QvoAe-0003TH-Jj
	for coreutils@gnu.org; Tue, 23 Aug 2011 06:25:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1QvoAd-0000J0-BV
	for coreutils@gnu.org; Tue, 23 Aug 2011 06:25:24 -0400
Received: from senmx12-mx.siemens-enterprise.com ([62.134.46.10]:58523)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <bernhard.voelker@siemens-enterprise.com>)
	id 1QvoAb-0000Ie-1k; Tue, 23 Aug 2011 06:25:21 -0400
Received: from MCHP064A.global-ad.net (unknown [172.29.37.63])
	by senmx12-mx.siemens-enterprise.com (Server) with ESMTP id
	C5D1F23F04B0; Tue, 23 Aug 2011 12:25:19 +0200 (CEST)
Received: from MCHP058A.global-ad.net ([172.29.37.55]) by
	MCHP064A.global-ad.net ([172.29.37.63]) with mapi;
	Tue, 23 Aug 2011 12:25:19 +0200
From: "Voelker, Bernhard" <bernhard.voelker@siemens-enterprise.com>
To: Jim Meyering <jim@meyering.net>
Date: Tue, 23 Aug 2011 12:25:21 +0200
Subject: RE: [PATCH] rm, du, chmod, chown,	chgrp: use much less memory for
	large directories
Thread-Topic: [PATCH] rm, du, chmod, chown,	chgrp: use much less memory for
	large directories
Thread-Index: AcxheexiXs459CJbT1CYUtDrlgL8/gABHYKQ
Message-ID: <7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
References: <87vctt9xo1.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
	<87hb58qwyw.fsf@rho.meyering.net>
In-Reply-To: <87hb58qwyw.fsf@rho.meyering.net>
Accept-Language: de-DE, en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
acceptlanguage: de-DE, en-US
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 62.134.46.10
Cc: "bug-findutils@gnu.org" <bug-findutils@gnu.org>,
	"coreutils@gnu.org" <coreutils@gnu.org>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 23 Aug 2011 10:25:25 -0000

Jim Meyering wrote:

> Voelker, Bernhard wrote:
>=20
> > Jim Meyering wrote:
> >
> > +++ b/tests/rm/4-million-entry-dir
> > ...
> > +# Put 4M files in a directory.
> > +mkdir d && cd d || framework_failure_
> > +seq 4000000|xargs touch || framework_failure_
> > +
> > +cd ..
> > +
> > +# Restricted to 50MB, rm from coreutils-8.12 would fail with a
> > +# diagnostic like "rm: fts_read failed: Cannot allocate memory".
> > +ulimit -v 50000
> > +rm -rf d || fail=3D1
> > +
> > +Exit $fail
> >
> > wouldn't this leave behind lots of used inodes in case of a failure?
>=20
> No, at least I hope not.
> The test is run via a framework (tests/init.sh) that creates a temporary
> directory in which those commands are run, and it (init.sh) also arranges
> to remove that temporary directory upon exit, interrupt, etc.

ok, good to know.

> > Additionally, looking at 2 of my (not so big) SLES servers:
> > most partitions only have <500000 inodes (/ /opt /usr /tmp /var),
> > so maybe it's worth checking beforehand whether the filesystem
> > meets the test requirements. What do you think?

> If the setup phase fails (the seq...|xargs touch), then the test fails
> with a diagnostic already.  And considering that the test is already
> marked as "very expensive", and hence not run by default (you have to hav=
e
> to set RUN_VERY_EXPENSIVE_TESTS=3Dyes in order to run it), I think we're
> ok, since I'd prefer a failure to a skip in that case.

I agree.

> People who take the trouble to run the very expensive tests (I'd be
> surprised if there are more than a handful) probably want to know when/if
> their test environment is causing test failures.

I like such tests ;-)

BTW: Wouldn't this test deserve a proper make target, e.g.
"make check-expensive"?

Have a nice day,
Berny



From MAILER-DAEMON Wed Aug 24 04:49:27 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qw99L-00085b-EI
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 04:49:27 -0400
Received: from eggs.gnu.org ([140.186.70.92]:56541)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qw99I-00083B-Df
	for coreutils@gnu.org; Wed, 24 Aug 2011 04:49:25 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qw99G-00026X-QC
	for coreutils@gnu.org; Wed, 24 Aug 2011 04:49:24 -0400
Received: from mx1.redhat.com ([209.132.183.28]:21158)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>)
	id 1Qw99D-00025m-3Q; Wed, 24 Aug 2011 04:49:19 -0400
Received: from int-mx10.intmail.prod.int.phx2.redhat.com
	(int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7O8nGvr013634
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 24 Aug 2011 04:49:16 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7O8nFmx030692; Wed, 24 Aug 2011 04:49:16 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 212FF6002D;
	Wed, 24 Aug 2011 10:49:15 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: "Voelker\, Bernhard" <bernhard.voelker@siemens-enterprise.com>
Subject: Re: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories
In-Reply-To: <7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
	(Bernhard Voelker's message of "Tue, 23 Aug 2011 12:25:21 +0200")
References: <87vctt9xo1.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
	<87hb58qwyw.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
Date: Wed, 24 Aug 2011 10:49:15 +0200
Message-ID: <87pqjvnqic.fsf@rho.meyering.net>
Lines: 166
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: "bug-findutils@gnu.org" <bug-findutils@gnu.org>,
	"coreutils@gnu.org" <coreutils@gnu.org>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 08:49:25 -0000

Voelker, Bernhard wrote:

> Jim Meyering wrote:
>
>> Voelker, Bernhard wrote:
>>
>> > Jim Meyering wrote:
>> >
>> > +++ b/tests/rm/4-million-entry-dir
>> > ...
>> > +# Put 4M files in a directory.
>> > +mkdir d && cd d || framework_failure_
>> > +seq 4000000|xargs touch || framework_failure_
>> > +
>> > +cd ..
>> > +
>> > +# Restricted to 50MB, rm from coreutils-8.12 would fail with a
>> > +# diagnostic like "rm: fts_read failed: Cannot allocate memory".
>> > +ulimit -v 50000
>> > +rm -rf d || fail=1
>> > +
>> > +Exit $fail
>> >
>> > wouldn't this leave behind lots of used inodes in case of a failure?
>>
>> No, at least I hope not.
>> The test is run via a framework (tests/init.sh) that creates a temporary
>> directory in which those commands are run, and it (init.sh) also arranges
>> to remove that temporary directory upon exit, interrupt, etc.
>
> ok, good to know.
>
>> > Additionally, looking at 2 of my (not so big) SLES servers:
>> > most partitions only have <500000 inodes (/ /opt /usr /tmp /var),
>> > so maybe it's worth checking beforehand whether the filesystem
>> > meets the test requirements. What do you think?
>
>> If the setup phase fails (the seq...|xargs touch), then the test fails
>> with a diagnostic already.  And considering that the test is already
>> marked as "very expensive", and hence not run by default (you have to have
>> to set RUN_VERY_EXPENSIVE_TESTS=yes in order to run it), I think we're
>> ok, since I'd prefer a failure to a skip in that case.
>
> I agree.
>
>> People who take the trouble to run the very expensive tests (I'd be
>> surprised if there are more than a handful) probably want to know when/if
>> their test environment is causing test failures.
>
> I like such tests ;-)
>
> BTW: Wouldn't this test deserve a proper make target, e.g.
> "make check-expensive"?

Yes, good idea.
That would make it easier to run just those test.

However, hard-coding the list of expensive and very-expensive
tests would require doing the same sort of thing as is done
for root_tests (see check-root) in tests/Makefile.am,
where there'd be a hand-maintained list of expensive and very-expensive
tests (in tests/Makefile.am) as well as rules to run them and rules
to cross-check that the lists are complete, as is done in cfg.mk's
sc-root_tests rule.

Back to your inode limitation point, it's a good one.
I realized that we certainly don't need 4M files to demonstrate
the problem.  Since 100,000 is the threshold, I lowered the number
used in the test to just 200,000.  With that, the test runs much
more quickly, of course:

>From 1871225451473d1bae3d41607e62ac02821aa042 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Wed, 24 Aug 2011 10:36:25 +0200
Subject: [PATCH 1/2] tests: adjust the new, very expensive rm test to be less
 expensive

* tests/rm/4-million-entry-dir: Create only 200,000 files, rather
than 4 million.  The latter was overkill, and was too likely to
fail due to inode exhaustion.  Not everyone is using btrfs yet.
Now that this file doesn't take so long, label it as merely
"expensive", rather than "very expensive".  Thanks to
Bernhard Voelker for pointing out the risk of inode exhaustion.
---
 tests/rm/4-million-entry-dir |   19 +++++++++++--------
 1 files changed, 11 insertions(+), 8 deletions(-)

diff --git a/tests/rm/4-million-entry-dir b/tests/rm/4-million-entry-dir
index 23130a6..44855cf 100755
--- a/tests/rm/4-million-entry-dir
+++ b/tests/rm/4-million-entry-dir
@@ -1,5 +1,6 @@
 #!/bin/sh
-# in coreutils-8.12, this would have required ~1GB of memory
+# In coreutils-8.12, rm,du,chmod, etc. would use too much memory
+# when processing a directory with many entries (as in > 100,000).

 # Copyright (C) 2011 Free Software Foundation, Inc.

@@ -17,19 +18,21 @@
 # along with this program.  If not, see <http://www.gnu.org/licenses/>.

 . "${srcdir=.}/init.sh"; path_prepend_ ../src
-print_ver_ rm
+print_ver_ rm du

-very_expensive_
+expensive_

-# Put 4M files in a directory.
+# With many files in a single directory...
 mkdir d && cd d || framework_failure_
-seq 4000000|xargs touch || framework_failure_
+seq 200000|xargs touch || framework_failure_

 cd ..

-# Restricted to 50MB, rm from coreutils-8.12 would fail with a
-# diagnostic like "rm: fts_read failed: Cannot allocate memory".
-ulimit -v 50000
+# Restricted to 40MB, rm from coreutils-8.12 each of these would fail
+# with a diagnostic like "rm: fts_read failed: Cannot allocate memory".
+ulimit -v 40000
+du -sh d || fail=1
+chmod -R 700 d || fail=1
 rm -rf d || fail=1

 Exit $fail
--
1.7.6.677.gb5fca


>From be380bfa8360e0232da7dbee198206dc57023745 Mon Sep 17 00:00:00 2001
From: Jim Meyering <meyering@redhat.com>
Date: Wed, 24 Aug 2011 10:40:51 +0200
Subject: [PATCH 2/2] maint: rename a test

Lesson: do not include details like "4 million" in a file name.
* tests/rm/many-dir-entries-vs-OOM: Renamed from ...
* tests/rm/4-million-entry-dir: ...this.
* tests/Makefile.am (TESTS): Reflect renaming.
---
 tests/Makefile.am                                  |    2 +-
 ...4-million-entry-dir => many-dir-entries-vs-OOM} |    0
 2 files changed, 1 insertions(+), 1 deletions(-)
 rename tests/rm/{4-million-entry-dir => many-dir-entries-vs-OOM} (100%)

diff --git a/tests/Makefile.am b/tests/Makefile.am
index f0200e1..c37cca6 100644
--- a/tests/Makefile.am
+++ b/tests/Makefile.am
@@ -135,7 +135,7 @@ TESTS =						\
   rm/unread3					\
   rm/unreadable					\
   rm/v-slash					\
-  rm/4-million-entry-dir			\
+  rm/many-dir-entries-vs-OOM			\
   chgrp/default-no-deref			\
   chgrp/deref					\
   chgrp/no-x					\
diff --git a/tests/rm/4-million-entry-dir b/tests/rm/many-dir-entries-vs-OOM
similarity index 100%
rename from tests/rm/4-million-entry-dir
rename to tests/rm/many-dir-entries-vs-OOM
--
1.7.6.677.gb5fca


From MAILER-DAEMON Wed Aug 24 05:17:47 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qw9al-0001Ky-A6
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 05:17:47 -0400
Received: from eggs.gnu.org ([140.186.70.92]:35994)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1Qw9aj-0001Jz-BW
	for coreutils@gnu.org; Wed, 24 Aug 2011 05:17:46 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1Qw9ai-0001LS-Fw
	for coreutils@gnu.org; Wed, 24 Aug 2011 05:17:45 -0400
Received: from moutng.kundenserver.de ([212.227.126.187]:61705)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>)
	id 1Qw9ag-0001KT-38; Wed, 24 Aug 2011 05:17:42 -0400
Received: from [192.168.2.108] (p4FF7598B.dip.t-dialin.net [79.247.89.139])
	by mrelayeu.kundenserver.de (node=mrbap3) with ESMTP (Nemesis)
	id 0Mddka-1QbDUW1e3A-00PIkP; Wed, 24 Aug 2011 11:17:32 +0200
Message-ID: <4E54C1AB.9030000@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 11:17:31 +0200
From: Bernhard Voelker <mail@bernhard-voelker.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110616 SUSE/3.1.11 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: make check-expensive [was: [PATCH] rm, du, chmod, chown,	chgrp: use
	much less memory for large directories]
References: <87vctt9xo1.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>	<87hb58qwyw.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
	<87pqjvnqic.fsf@rho.meyering.net>
In-Reply-To: <87pqjvnqic.fsf@rho.meyering.net>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Provags-ID: V02:K0:u7nMW6uyDCkedqCYOAnKkocR1RPm6BQp+yqfYFf756+
	0rZzv99kFMc9X1bvJ8RcX12n1NiUqh63ZU6TX7rF1+TSyNAIz5
	Qm1Ku22kBze/NkXBilb0ZksZbS8Lmh+5OMEY2g+p/fUjZQoeZZ
	LPeEbhKa8k1X7xx9aXW0p4ZpzXHaJiHjZEz+d2aFGOLSdWMLNr
	d8zbxLSTR0G7LJiPSOsC3tw26slQxZs8ODxwoNhaRM=
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 212.227.126.187
Cc: "bug-findutils@gnu.org" <bug-findutils@gnu.org>,
	"coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 09:17:46 -0000

On 08/24/2011 10:49 AM, Jim Meyering wrote:
> Voelker, Bernhard wrote:
>> BTW: Wouldn't this test deserve a proper make target, e.g.
>> "make check-expensive"?
>
> Yes, good idea.
> That would make it easier to run just those test.
>
> However, hard-coding the list of expensive and very-expensive
> tests would require doing the same sort of thing as is done
> for root_tests (see check-root) in tests/Makefile.am,
> where there'd be a hand-maintained list of expensive and very-expensive
> tests (in tests/Makefile.am) as well as rules to run them and rules
> to cross-check that the lists are complete, as is done in cfg.mk's
> sc-root_tests rule.

Wouldn't it be sufficient to add something like the following
to the top-level Makefile.am?

check-expensive:
	env RUN_EXPENSIVE_TESTS=yes make check

check-very-expensive:
	env RUN_VERY_EXPENSIVE_TESTS=yes make check

Berny


From MAILER-DAEMON Wed Aug 24 05:42:29 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qw9yf-00016J-JK
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 05:42:29 -0400
Received: from eggs.gnu.org ([140.186.70.92]:41802)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qw9yc-00016D-M0
	for coreutils@gnu.org; Wed, 24 Aug 2011 05:42:27 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qw9yb-0007k3-3o
	for coreutils@gnu.org; Wed, 24 Aug 2011 05:42:26 -0400
Received: from mx1.redhat.com ([209.132.183.28]:13746)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qw9ya-0007jw-R1
	for coreutils@gnu.org; Wed, 24 Aug 2011 05:42:25 -0400
Received: from int-mx01.intmail.prod.int.phx2.redhat.com
	(int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7O9gKKH008178
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 24 Aug 2011 05:42:20 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7O9gJi4014978; Wed, 24 Aug 2011 05:42:20 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 09CE160134;
	Wed, 24 Aug 2011 11:42:18 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Bernhard Voelker <mail@bernhard-voelker.de>
Subject: Re: make check-expensive [was: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories]
In-Reply-To: <4E54C1AB.9030000@bernhard-voelker.de> (Bernhard Voelker's
	message of "Wed, 24 Aug 2011 11:17:31 +0200")
References: <87vctt9xo1.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
	<87hb58qwyw.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
	<87pqjvnqic.fsf@rho.meyering.net>
	<4E54C1AB.9030000@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 11:42:18 +0200
Message-ID: <87k4a3no1x.fsf@rho.meyering.net>
Lines: 38
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: "coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 09:42:27 -0000

Bernhard Voelker wrote:

> On 08/24/2011 10:49 AM, Jim Meyering wrote:
>> Voelker, Bernhard wrote:
>>> BTW: Wouldn't this test deserve a proper make target, e.g.
>>> "make check-expensive"?
>>
>> Yes, good idea.
>> That would make it easier to run just those test.
>>
>> However, hard-coding the list of expensive and very-expensive
>> tests would require doing the same sort of thing as is done
>> for root_tests (see check-root) in tests/Makefile.am,
>> where there'd be a hand-maintained list of expensive and very-expensive
>> tests (in tests/Makefile.am) as well as rules to run them and rules
>> to cross-check that the lists are complete, as is done in cfg.mk's
>> sc-root_tests rule.
>
> Wouldn't it be sufficient to add something like the following
> to the top-level Makefile.am?
>
> check-expensive:
> 	env RUN_EXPENSIVE_TESTS=yes make check
>
> check-very-expensive:
> 	env RUN_VERY_EXPENSIVE_TESTS=yes make check

That would be sufficient if you don't mind running all of
the other tests, too.  Does a name like "check-expensive",
imply "all regular tests, plus the expensive ones"?
Would you expect "check-very-expensive" also to run the
"merely expensive" tests?  From what I recall, you'd have
to set RUN_EXPENSIVE_TESTS=yes, too, if you want that.

BTW, you don't need "env", and it should use $(MAKE), not "make", e.g.,

check-expensive:
 	$(MAKE) check RUN_EXPENSIVE_TESTS=yes


From MAILER-DAEMON Wed Aug 24 06:06:59 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwAMN-0000PJ-3t
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 06:06:59 -0400
Received: from eggs.gnu.org ([140.186.70.92]:32848)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwAMK-0000P9-6o
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:06:57 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwAMI-00051g-VD
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:06:56 -0400
Received: from moutng.kundenserver.de ([212.227.17.9]:52720)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwAMI-000517-Hx
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:06:54 -0400
Received: from [192.168.2.108] (p4FF7598B.dip.t-dialin.net [79.247.89.139])
	by mrelayeu.kundenserver.de (node=mrbap3) with ESMTP (Nemesis)
	id 0Lo18K-1RT2GS3yum-00g0eM; Wed, 24 Aug 2011 12:06:47 +0200
Message-ID: <4E54CD33.6030404@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 12:06:43 +0200
From: Bernhard Voelker <mail@bernhard-voelker.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110616 SUSE/3.1.11 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: Re: make check-expensive [was: [PATCH] rm, du, chmod, chown,	chgrp:
	use much less memory for large directories]
References: <87vctt9xo1.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>	<87hb58qwyw.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>	<87pqjvnqic.fsf@rho.meyering.net>	<4E54C1AB.9030000@bernhard-voelker.de>
	<87k4a3no1x.fsf@rho.meyering.net>
In-Reply-To: <87k4a3no1x.fsf@rho.meyering.net>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Provags-ID: V02:K0:5UgSoG52kN/DOEZ/wX7DFnFGOnJXUfMFEXVN3KSC+NA
	cf4RRN12+Vol3sOkIscvOejUcj9lmw4UNupIGLPM3Wywr2NfqR
	04Byz4UTLRwpMnrsfj78onUQvpZS4m7cjzi4hkLxztdYSMuQSP
	QOKTDAqHzWJuuVrn+f98YeAiP9nMvYM/qvTNg805p4FlZs6b2i
	XSBGwVH8aAXGYrzBs2XeHd/SYOn6sP2vqsh1j6GErk=
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 212.227.17.9
Cc: "coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 10:06:57 -0000

On 08/24/2011 11:42 AM, Jim Meyering wrote:
> Bernhard Voelker wrote:
>
>> On 08/24/2011 10:49 AM, Jim Meyering wrote:
>>> Voelker, Bernhard wrote:
>>>> BTW: Wouldn't this test deserve a proper make target, e.g.
>>>> "make check-expensive"?
>>>
>>> Yes, good idea.
>>> That would make it easier to run just those test.
>>>
>>> However, hard-coding the list of expensive and very-expensive
>>> tests would require doing the same sort of thing as is done
>>> for root_tests (see check-root) in tests/Makefile.am,
>>> where there'd be a hand-maintained list of expensive and very-expensive
>>> tests (in tests/Makefile.am) as well as rules to run them and rules
>>> to cross-check that the lists are complete, as is done in cfg.mk's
>>> sc-root_tests rule.
>>
>> Wouldn't it be sufficient to add something like the following
>> to the top-level Makefile.am?
>>
>> check-expensive:
>> 	env RUN_EXPENSIVE_TESTS=yes make check
>>
>> check-very-expensive:
>> 	env RUN_VERY_EXPENSIVE_TESTS=yes make check
>
> That would be sufficient if you don't mind running all of
> the other tests, too.  Does a name like "check-expensive",
> imply "all regular tests, plus the expensive ones"?
> Would you expect "check-very-expensive" also to run the
> "merely expensive" tests?  From what I recall, you'd have
> to set RUN_EXPENSIVE_TESTS=yes, too, if you want that.

Actually, such a shortcut would do the same as calling
"env RUN_EXPENSIVE_TESTS=yes make check" today. So yes,
I'd expect the cheaper ones also to be run.

If this is not wanted, i.e. only the expensive tests should
be run for the target check-expensive, then I don't like the
idea to have another list. I'd rather let each test decide
for itself, either calling very_expensive_, expensive_, or
a new function not_expensive_ which would exit if none of
RUN_EXPENSIVE_TESTS and RUN_EXPENSIVE_TESTS are 'yes'.

This'd mean to have to touch all tests ...

> BTW, you don't need "env", and it should use $(MAKE), not "make", e.g.,
>
> check-expensive:
>   	$(MAKE) check RUN_EXPENSIVE_TESTS=yes

thanks.


From MAILER-DAEMON Wed Aug 24 06:24:41 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwAdV-0002cZ-At
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 06:24:41 -0400
Received: from eggs.gnu.org ([140.186.70.92]:54911)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QwAdS-0002cH-RJ
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:24:39 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QwAdR-0001nt-W5
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:24:38 -0400
Received: from mx1.redhat.com ([209.132.183.28]:30031)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QwAdR-0001nk-MT
	for coreutils@gnu.org; Wed, 24 Aug 2011 06:24:37 -0400
Received: from int-mx10.intmail.prod.int.phx2.redhat.com
	(int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7OAOTx0028522
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 24 Aug 2011 06:24:29 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7OAORCm027049; Wed, 24 Aug 2011 06:24:28 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 80AD86015A;
	Wed, 24 Aug 2011 12:24:26 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Bernhard Voelker <mail@bernhard-voelker.de>
Subject: Re: make check-expensive [was: [PATCH] rm, du, chmod, chown,
	chgrp: use much less memory for large directories]
In-Reply-To: <4E54CD33.6030404@bernhard-voelker.de> (Bernhard Voelker's
	message of "Wed, 24 Aug 2011 12:06:43 +0200")
References: <87vctt9xo1.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>
	<87hb58qwyw.fsf@rho.meyering.net>
	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>
	<87pqjvnqic.fsf@rho.meyering.net>
	<4E54C1AB.9030000@bernhard-voelker.de>
	<87k4a3no1x.fsf@rho.meyering.net>
	<4E54CD33.6030404@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 12:24:26 +0200
Message-ID: <8739grnm3p.fsf@rho.meyering.net>
Lines: 52
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.23
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: "coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 10:24:39 -0000

Bernhard Voelker wrote:

> On 08/24/2011 11:42 AM, Jim Meyering wrote:
>> Bernhard Voelker wrote:
>>
>>> On 08/24/2011 10:49 AM, Jim Meyering wrote:
>>>> Voelker, Bernhard wrote:
>>>>> BTW: Wouldn't this test deserve a proper make target, e.g.
>>>>> "make check-expensive"?
>>>>
>>>> Yes, good idea.
>>>> That would make it easier to run just those test.
>>>>
>>>> However, hard-coding the list of expensive and very-expensive
>>>> tests would require doing the same sort of thing as is done
>>>> for root_tests (see check-root) in tests/Makefile.am,
>>>> where there'd be a hand-maintained list of expensive and very-expensive
>>>> tests (in tests/Makefile.am) as well as rules to run them and rules
>>>> to cross-check that the lists are complete, as is done in cfg.mk's
>>>> sc-root_tests rule.
>>>
>>> Wouldn't it be sufficient to add something like the following
>>> to the top-level Makefile.am?
>>>
>>> check-expensive:
>>> 	env RUN_EXPENSIVE_TESTS=yes make check
>>>
>>> check-very-expensive:
>>> 	env RUN_VERY_EXPENSIVE_TESTS=yes make check
>>
>> That would be sufficient if you don't mind running all of
>> the other tests, too.  Does a name like "check-expensive",
>> imply "all regular tests, plus the expensive ones"?
>> Would you expect "check-very-expensive" also to run the
>> "merely expensive" tests?  From what I recall, you'd have
>> to set RUN_EXPENSIVE_TESTS=yes, too, if you want that.
>
> Actually, such a shortcut would do the same as calling
> "env RUN_EXPENSIVE_TESTS=yes make check" today. So yes,
> I'd expect the cheaper ones also to be run.

If you would find some testing-related make shortcut to be useful,
please propose a patch, preferably without modifying all tests ;-)

> If this is not wanted, i.e. only the expensive tests should
> be run for the target check-expensive, then I don't like the
> idea to have another list. I'd rather let each test decide
> for itself, either calling very_expensive_, expensive_, or
> a new function not_expensive_ which would exit if none of
> RUN_EXPENSIVE_TESTS and RUN_EXPENSIVE_TESTS are 'yes'.
>
> This'd mean to have to touch all tests ...


From MAILER-DAEMON Wed Aug 24 07:08:49 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwBKD-0002jb-UY
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 07:08:49 -0400
Received: from eggs.gnu.org ([140.186.70.92]:55047)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwBKA-0002gb-Lj
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:08:47 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwBK9-00057M-JI
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:08:46 -0400
Received: from moutng.kundenserver.de ([212.227.17.8]:58307)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwBK9-000575-5X
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:08:45 -0400
Received: from [192.168.2.108] (p4FF7598B.dip.t-dialin.net [79.247.89.139])
	by mrelayeu.kundenserver.de (node=mrbap1) with ESMTP (Nemesis)
	id 0M5rAH-1RBcdW1SUj-00yK0N; Wed, 24 Aug 2011 13:08:43 +0200
Message-ID: <4E54DBB5.1060100@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 13:08:37 +0200
From: Bernhard Voelker <mail@bernhard-voelker.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110616 SUSE/3.1.11 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: Re: make check-expensive [was: [PATCH] rm, du, chmod, chown,	chgrp:
	use much less memory for large directories]
References: <87vctt9xo1.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>	<87hb58qwyw.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>	<87pqjvnqic.fsf@rho.meyering.net>	<4E54C1AB.9030000@bernhard-voelker.de>	<87k4a3no1x.fsf@rho.meyering.net>	<4E54CD33.6030404@bernhard-voelker.de>
	<8739grnm3p.fsf@rho.meyering.net>
In-Reply-To: <8739grnm3p.fsf@rho.meyering.net>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Provags-ID: V02:K0:EJbuA1Q8YT4FbxvzRLsrqsHiqoW/JMBfhz5+lqb5FSb
	kCc4wblpgJbSqsZdMMmrlor5ZrJleX3oCUddXUyzpCctQgLqQo
	r4KProZKrzW4cRpfQcdXVIfDf+34OCx2sk5eEt8lHoqs5t6VHW
	e0aSABy2X1ZOok0xgv2F2y3lZ846tJ7lKLbMPvNmEJo+cDys9x
	PLWYcr7UJbDNHGaV1+GLqEvpL9hBv6X8sbZep+ak5k=
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 212.227.17.8
Cc: "coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 11:08:47 -0000

On 08/24/2011 12:24 PM, Jim Meyering wrote:
> If you would find some testing-related make shortcut to be useful,
> please propose a patch, preferably without modifying all tests ;-)

 From 4c994ab75a3d0c2eda5aa9246388dccf5058f250 Mon Sep 17 00:00:00 2001
From: Bernhard Voelker <mail@bernhard-voelker.de>
Date: Wed, 24 Aug 2011 13:06:28 +0200
Subject: [PATCH] tests: introduce make targets check-expensive and 
check-very-expensive

* Makefile.am: add shortcuts to run (very) expensive tests.
Use "make check-expensive" to run tests with RUN_EXPENSIVE_TESTS=yes,
use "make check-very-expensive" to run tests with both
RUN_EXPENSIVE_TESTS=yes and RUN_VERY_EXPENSIVE_TESTS=yes.
Non-expensive tests are included in all cases.

Signed-off-by: Bernhard Voelker <mail@bernhard-voelker.de>
---
  Makefile.am |    6 ++++++
  1 files changed, 6 insertions(+), 0 deletions(-)

diff --git a/Makefile.am b/Makefile.am
index f737cf6..556eca5 100644
--- a/Makefile.am
+++ b/Makefile.am
@@ -66,6 +66,12 @@ ALL_RECURSIVE_TARGETS += check-root
  check-root:
         cd tests && $(MAKE) $@ SUBDIRS=

+# Shortcut tests that are (very) expensive.
+check-expensive:
+       $(MAKE) check RUN_EXPENSIVE_TESTS=yes
+check-very-expensive:
+       $(MAKE) check-expensive RUN_VERY_EXPENSIVE_TESTS=yes
+
  # Just prior to distribution, ...
  # transform the automake-generated rule that runs `rm -f rm'.
  # On some systems, that command would fail with a diagnostic like
-- 
1.7.3.4


From MAILER-DAEMON Wed Aug 24 07:18:12 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwBTI-00058t-Af
	for mharc-coreutils@gnu.org; Wed, 24 Aug 2011 07:18:12 -0400
Received: from eggs.gnu.org ([140.186.70.92]:54835)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QwBTF-00058P-Tg
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:18:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QwBTF-0006wN-45
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:18:09 -0400
Received: from m4.master-telecom.ru ([85.193.64.14]:34419)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mitya@m4.master-telecom.ru>) id 1QwBTE-0006w5-KG
	for coreutils@gnu.org; Wed, 24 Aug 2011 07:18:09 -0400
Received: from m4.master-telecom.ru (localhost [127.0.0.1])
	by m4.master-telecom.ru (8.14.4/8.14.4) with ESMTP id p7OBI517062741;
	Wed, 24 Aug 2011 15:18:05 +0400 (MSD)
	(envelope-from mitya@m4.master-telecom.ru)
Received: (from mitya@localhost)
	by m4.master-telecom.ru (8.14.4/8.14.4/Submit) id p7OBI5p0062740;
	Wed, 24 Aug 2011 15:18:05 +0400 (MSD) (envelope-from mitya)
Date: Wed, 24 Aug 2011 15:18:05 +0400
From: Dmitry Sivachenko <mitya@cavia.pp.ru>
To: Roman Rybalko <devel@romanr.name>
Subject: Re: sort --parallel problem?
Message-ID: <20110824111805.GB62632@m4.master-telecom.ru>
References: <20110816112418.GA39255@m4.master-telecom.ru>
	<87liutb6ax.fsf@rho.meyering.net> <4E4B75EA.9090502@romanr.name>
MIME-Version: 1.0
Content-Type: text/plain; charset=koi8-r
Content-Disposition: inline
In-Reply-To: <4E4B75EA.9090502@romanr.name>
WWW-Home-Page: http://mitya.pp.ru/
X-PGP-Key: http://mitya.pp.ru/mitya.asc
User-Agent: Mutt/1.5.21 (2010-09-15)
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 85.193.64.14
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 24 Aug 2011 11:18:11 -0000

On Wed, Aug 17, 2011 at 12:03:54PM +0400, Roman Rybalko wrote:
>    Sometimes happens for me, but with different tools, my own
>    particularly.
>    Seems FreeBSD's pthread_mutex_init does not clear the memory, and then
>    may be possible situation when random mutex data interfere with
>    internal lists.
>    memset(&mutex, 0, sizeof(mutex)) before pthread_mutex_init fixes the
>    problem for me.
>    Using FreeBSD-8.x

I tried to add memset(&mutex, 0, sizeof(mutex)) before each 
pthread_mutex_init in coreutils.

It did not fix the crash.


From MAILER-DAEMON Thu Aug 25 02:50:35 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwTlr-0005D4-2j
	for mharc-coreutils@gnu.org; Thu, 25 Aug 2011 02:50:35 -0400
Received: from eggs.gnu.org ([140.186.70.92]:46904)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwTlp-0005CW-2W
	for coreutils@gnu.org; Thu, 25 Aug 2011 02:50:34 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwTln-00054D-Vh
	for coreutils@gnu.org; Thu, 25 Aug 2011 02:50:33 -0400
Received: from moutng.kundenserver.de ([212.227.17.8]:50634)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <mail@bernhard-voelker.de>) id 1QwTln-000540-I8
	for coreutils@gnu.org; Thu, 25 Aug 2011 02:50:31 -0400
Received: from [192.168.2.108] (p4FF76CEF.dip.t-dialin.net [79.247.108.239])
	by mrelayeu.kundenserver.de (node=mrbap3) with ESMTP (Nemesis)
	id 0M2M3o-1RCmAP3XHw-00s4CT; Thu, 25 Aug 2011 08:50:26 +0200
Message-ID: <4E55F0B0.8000906@bernhard-voelker.de>
Date: Thu, 25 Aug 2011 08:50:24 +0200
From: Bernhard Voelker <mail@bernhard-voelker.de>
User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US;
	rv:1.9.2.18) Gecko/20110616 SUSE/3.1.11 Thunderbird/3.1.11
MIME-Version: 1.0
To: Jim Meyering <jim@meyering.net>
Subject: [PATCH] tests: mention targets check-expensive/check-very-expensive
	in test logs
References: <87vctt9xo1.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D4A0@MCHP058A.global-ad.net>	<87hb58qwyw.fsf@rho.meyering.net>	<7856072A9D04C24B82DFE2B1112FE38A0C2726D5A6@MCHP058A.global-ad.net>	<87pqjvnqic.fsf@rho.meyering.net>	<4E54C1AB.9030000@bernhard-voelker.de>	<87k4a3no1x.fsf@rho.meyering.net>	<4E54CD33.6030404@bernhard-voelker.de>	<8739grnm3p.fsf@rho.meyering.net>
	<4E54DBB5.1060100@bernhard-voelker.de>
In-Reply-To: <4E54DBB5.1060100@bernhard-voelker.de>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Provags-ID: V02:K0:b4IJeG/i6cSZMBvn3+7H9IYdE75ITZrzPCswR7NDIVe
	z6voXbFhc+kfK/Uz+dyMWsTy0BaIGay9DaUmwpZN/sknsWLdKy
	b327JezWbu82pi/A0p4rvDgC99epPm75MEXRQpqfOVPh56k+E0
	ZSK1gQweNLqacGfWOGQgQpbV5rY7fT7QA3iQIpq/P+qk02I/Yp
	5Cq2FAVwSzBJAns5o53kwnKMfuXsKiM+sk7c7PjHX0=
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 212.227.17.8
Cc: "coreutils@gnu.org" <coreutils@gnu.org>, "Voelker,
	Bernhard" <bernhard.voelker@siemens-enterprise.com>
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 25 Aug 2011 06:50:34 -0000

Additionally to the patch proposal yesterday
(Subject: Re: make check-expensive [was:...])
another patch follows to mention the new targets
in the test output.

On 08/24/2011 01:08 PM, Bernhard Voelker wrote:
> On 08/24/2011 12:24 PM, Jim Meyering wrote:
>> If you would find some testing-related make shortcut to be useful,
>> please propose a patch, preferably without modifying all tests ;-)
>
>  From 4c994ab75a3d0c2eda5aa9246388dccf5058f250 Mon Sep 17 00:00:00 2001
> From: Bernhard Voelker <mail@bernhard-voelker.de>
> Date: Wed, 24 Aug 2011 13:06:28 +0200
> Subject: [PATCH] tests: introduce make targets check-expensive and
> check-very-expensive

 From 9593d4da4c01f53cd88bdcd2b8fbc9f62637803a Mon Sep 17 00:00:00 2001
From: Bernhard Voelker <mail@bernhard-voelker.de>
Date: Thu, 25 Aug 2011 08:43:18 +0200
Subject: [PATCH] tests: mention targets 
check-expensive/check-very-expensive in test logs

* tests/init.cfg: (very_expensive_): mention toplevel make target
check-very-expensive, (expensive_): likewise (check-expensive).

Signed-off-by: Bernhard Voelker <mail@bernhard-voelker.de>
---
  tests/init.cfg |    8 ++++++++
  1 files changed, 8 insertions(+), 0 deletions(-)

diff --git a/tests/init.cfg b/tests/init.cfg
index 7e05d0d..023ab9b 100644
--- a/tests/init.cfg
+++ b/tests/init.cfg
@@ -253,6 +253,10 @@ To run it anyway, rerun make check with the 
RUN_VERY_EXPENSIVE_TESTS
  environment variable set to yes.  E.g.,

    env RUN_VERY_EXPENSIVE_TESTS=yes make check
+
+or use the shortcut target of the toplevel Makefile,
+
+  make check-very-expensive
  '
    fi
  }
@@ -266,6 +270,10 @@ To run it anyway, rerun make check with the 
RUN_EXPENSIVE_TESTS
  environment variable set to yes.  E.g.,

    env RUN_EXPENSIVE_TESTS=yes make check
+
+or use the shortcut target of the toplevel Makefile,
+
+  make check-expensive
  '
    fi
  }
-- 
1.7.3.4


From MAILER-DAEMON Thu Aug 25 06:35:33 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QwXHZ-0001FL-11
	for mharc-coreutils@gnu.org; Thu, 25 Aug 2011 06:35:33 -0400
Received: from eggs.gnu.org ([140.186.70.92]:42395)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QwXHW-0001FD-9g
	for coreutils@gnu.org; Thu, 25 Aug 2011 06:35:31 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QwXHV-00085i-0F
	for coreutils@gnu.org; Thu, 25 Aug 2011 06:35:30 -0400
Received: from mail1.vodafone.ie ([213.233.128.43]:12302)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <P@draigBrady.com>) id 1QwXHU-00084W-MG
	for coreutils@gnu.org; Thu, 25 Aug 2011 06:35:28 -0400
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: ApMBAAYkVk5tTnqs/2dsb2JhbAAMNqo4AQEFMgFWCw0EAwECAQkWDwkDAgECAT0IBg0GAgEBh3K7U4ZMBJhEi1E
Received: from unknown (HELO [192.168.1.79]) ([109.78.122.172])
	by mail1.vodafone.ie with ESMTP; 25 Aug 2011 11:35:25 +0100
Message-ID: <4E56256D.6090108@draigBrady.com>
Date: Thu, 25 Aug 2011 11:35:25 +0100
From: =?ISO-8859-1?Q?P=E1draig_Brady?= <P@draigBrady.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
	rv:5.0) Gecko/20110707 Thunderbird/5.0
MIME-Version: 1.0
To: Coreutils <coreutils@gnu.org>
Subject: Re: bug#8938: make timeout and CTRL-C
References: <BANLkTinmYVHcTpZ46KzBKYT2DBxaNXuJtg@mail.gmail.com>	<4E087174.9020402@draigBrady.com>	<4E0A1B2C.7060004@cs.ucla.edu>	<4E0A206E.70902@draigBrady.com>	<4E0A214B.4060607@cs.ucla.edu>	<4E14E39E.6070207@draigBrady.com>
	<4E1584E1.6010008@draigBrady.com> <4E1586F4.3070304@draigBrady.com>
	<4E5620D9.6040000@draigBrady.com>
In-Reply-To: <4E5620D9.6040000@draigBrady.com>
X-Enigmail-Version: 1.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 213.233.128.43
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Thu, 25 Aug 2011 10:35:31 -0000

On 08/25/2011 11:15 AM, Pádraig Brady wrote:
> On 07/07/2011 11:14 AM, Pádraig Brady wrote:
>> I'm also thinking of pushing this as a separate patch,
>> which will set WIFSIGNALED for the timeout process itself.
>> This will make timeout more transparent and when doing
>> Ctrl-C from make for example, printing "[target] Interrupt"
>> rather than "[target] Error 130".
>>
>> diff --git a/src/timeout.c b/src/timeout.c
>> index a686225..ea4af18 100644
>> --- a/src/timeout.c
>> +++ b/src/timeout.c
>> @@ -341,7 +361,19 @@ main (int argc, char **argv)
>>            if (WIFEXITED (status))
>>              status = WEXITSTATUS (status);
>>            else if (WIFSIGNALED (status))
>> -            status = WTERMSIG (status) + 128; /* what sh does at least.  */
>> +            {
>> +              int sig = WTERMSIG (status);
>> +              if (!timed_out)
>> +                {
>> +                  /* exit with the signal flag set, but avoid core files.  */
>> +                  if (setrlimit (RLIMIT_CORE, &(struct rlimit) {0,0}) == 0)
>> +                    {
>> +                      signal (sig, SIG_DFL);
>> +                      raise (sig);
>> +                    }
>> +                }
>> +              status = sig + 128; /* what sh returns for signaled processes.  */
>> +            }
> 
> Seems like it might be safer to revert this,
> as one can't really disable core dumps for a process on linux:
> http://marc.info/?l=linux-kernel&m=131426663119428&w=2
> So abrt would log bugs against coreutils rather than a program
> that `timeout` was monitoring.

I'm committing this revert now...

>From d00c73cf4d6402dbacc7cd587127a16a0e93724c Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?P=C3=A1draig=20Brady?= <P@draigBrady.com>
Date: Thu, 25 Aug 2011 11:25:30 +0100
Subject: [PATCH] timeout: revert signal propagation enhancement

This effectively reverts the unreleased commit 5a647a05

* src/timeout.c (main): Don't propagate signals from the monitored
process, as on Linux /proc/sys/kernel/core_pattern could still
handle them and cause false reports against `timeout`
---
 src/timeout.c |    4 +++-
 1 files changed, 3 insertions(+), 1 deletions(-)

diff --git a/src/timeout.c b/src/timeout.c
index 6a37508..ae89942 100644
--- a/src/timeout.c
+++ b/src/timeout.c
@@ -424,7 +424,9 @@ main (int argc, char **argv)
           else if (WIFSIGNALED (status))
             {
               int sig = WTERMSIG (status);
-#if HAVE_SETRLIMIT && defined RLIMIT_CORE
+/* The following is not used as one cannot disable processing
+   by a filter in /proc/sys/kernel/core_pattern on Linux.  */
+#if 0 && HAVE_SETRLIMIT && defined RLIMIT_CORE
               if (!timed_out)
                 {
                   /* exit with the signal flag set, but avoid core files.  */
-- 
1.7.5.2


From MAILER-DAEMON Sat Aug 27 19:27:10 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QxSHO-0000rp-Q8
	for mharc-coreutils@gnu.org; Sat, 27 Aug 2011 19:27:10 -0400
Received: from eggs.gnu.org ([140.186.70.92]:39097)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <andras@dns.net>) id 1QxSDV-0000gb-B5
	for coreutils@gnu.org; Sat, 27 Aug 2011 19:23:10 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <andras@dns.net>) id 1QxSDT-0004wc-SH
	for coreutils@gnu.org; Sat, 27 Aug 2011 19:23:09 -0400
Received: from server2.gaon.net ([46.4.121.115]:60512)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <andras@dns.net>) id 1QxSDT-0004wK-8o
	for coreutils@gnu.org; Sat, 27 Aug 2011 19:23:07 -0400
Received: from server2.gaon.net (localhost [127.0.0.1])
	by server2.gaon.net (8.14.3/8.14.3) with ESMTP id p7RNMwrX027827;
	Sat, 27 Aug 2011 23:22:58 GMT
Received: (from asalamon@localhost)
	by server2.gaon.net (8.14.3/8.14.3/Submit 0.2) id p7RNMw8f027826;
	Sat, 27 Aug 2011 23:22:58 GMT
Date: Sun, 28 Aug 2011 00:23:12 +0100
From: Andras Salamon <andras@dns.net>
To: Jim Meyering <jim@meyering.net>
Subject: Re: ready for coreutils-8.13
Message-ID: <20110827232312.GA9018@gaon.net>
References: <87mxf58adr.fsf@rho.meyering.net> <4E4EE769.7080607@draigBrady.com>
	<87obzk618m.fsf@rho.meyering.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Disposition: inline
In-Reply-To: <87obzk618m.fsf@rho.meyering.net>
Sender: andras@gaon.net
User-Agent: Mutt/1.5.21 (2010-09-15)
Content-Transfer-Encoding: quoted-printable
X-MIME-Autoconverted: from 8bit to quoted-printable by server2.gaon.net id
	p7RNMwrX027827
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 3)
X-Received-From: 46.4.121.115
X-Mailman-Approved-At: Sat, 27 Aug 2011 19:27:08 -0400
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sat, 27 Aug 2011 23:23:10 -0000

On Sat, Aug 20, 2011 at 08:33:29AM +0200, Jim Meyering wrote:
>P=C3=A1draig Brady wrote:
>> I'd liked to see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D9321
>> looked into before release (segfaults in sort)
>
>So would I.  I've just replied there.

I am seeing no evidence of the problems on another machine, so must
assume this is local to the original hardware.  Please close #9321.

-- Andras Salamon                   andras@dns.net


From MAILER-DAEMON Sun Aug 28 03:01:27 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QxZN1-0007kW-H3
	for mharc-coreutils@gnu.org; Sun, 28 Aug 2011 03:01:27 -0400
Received: from eggs.gnu.org ([140.186.70.92]:60205)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QxZMz-0007jC-HA
	for coreutils@gnu.org; Sun, 28 Aug 2011 03:01:26 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QxZMy-0002dB-Jw
	for coreutils@gnu.org; Sun, 28 Aug 2011 03:01:25 -0400
Received: from mx1.redhat.com ([209.132.183.28]:18182)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QxZMy-0002d4-Bo
	for coreutils@gnu.org; Sun, 28 Aug 2011 03:01:24 -0400
Received: from int-mx12.intmail.prod.int.phx2.redhat.com
	(int-mx12.intmail.prod.int.phx2.redhat.com [10.5.11.25])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7S71IfV002531
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Sun, 28 Aug 2011 03:01:18 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx12.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7S71GGZ031552; Sun, 28 Aug 2011 03:01:17 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 54F516007C;
	Sun, 28 Aug 2011 09:01:16 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: Andras Salamon <andras@dns.net>
Subject: Re: ready for coreutils-8.13
In-Reply-To: <20110827232312.GA9018@gaon.net> (Andras Salamon's message of
	"Sun, 28 Aug 2011 00:23:12 +0100")
References: <87mxf58adr.fsf@rho.meyering.net>
	<4E4EE769.7080607@draigBrady.com> <87obzk618m.fsf@rho.meyering.net>
	<20110827232312.GA9018@gaon.net>
Date: Sun, 28 Aug 2011 09:01:16 +0200
Message-ID: <87zkiuow8z.fsf@rho.meyering.net>
Lines: 23
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.25
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coreutils@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Sun, 28 Aug 2011 07:01:26 -0000

Andras Salamon wrote:
> On Sat, Aug 20, 2011 at 08:33:29AM +0200, Jim Meyering wrote:
>>P=E1draig Brady wrote:
>>> I'd liked to see http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D9321
>>> looked into before release (segfaults in sort)
>>
>>So would I.  I've just replied there.
>
> I am seeing no evidence of the problems on another machine, so must
> assume this is local to the original hardware.  Please close #9321.

Thanks for letting us know.  I've closed it and tagged it "notabug".

FYI, you could have closed it yourself by sending this message
to 9321-done@debbugs.gnu.org.

An alternative (what I did) is to reply to the thread and to Bcc
the bug-tracking control address, control@debbugs.gnu.org
including these lines at the top of the message:

tags 9321 + notabug
close 9321
thanks


From MAILER-DAEMON Tue Aug 30 17:58:35 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1QyWKJ-00064j-QP
	for mharc-coreutils@gnu.org; Tue, 30 Aug 2011 17:58:35 -0400
Received: from eggs.gnu.org ([140.186.70.92]:51429)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QyWKH-0005yy-2L
	for coreutils@gnu.org; Tue, 30 Aug 2011 17:58:34 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QyWKF-0005fH-Jj
	for coreutils@gnu.org; Tue, 30 Aug 2011 17:58:33 -0400
Received: from mx1.redhat.com ([209.132.183.28]:12677)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1QyWKF-0005fB-Ci
	for coreutils@gnu.org; Tue, 30 Aug 2011 17:58:31 -0400
Received: from int-mx09.intmail.prod.int.phx2.redhat.com
	(int-mx09.intmail.prod.int.phx2.redhat.com [10.5.11.22])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7ULwUEF028376
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <coreutils@gnu.org>; Tue, 30 Aug 2011 17:58:30 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx09.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP
	id p7ULwSXV005027
	for <coreutils@gnu.org>; Tue, 30 Aug 2011 17:58:29 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id 9E2E0600A7
	for <coreutils@gnu.org>; Tue, 30 Aug 2011 23:58:28 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: snapshot tomorrow, preparing for coreutils-8.13
Date: Tue, 30 Aug 2011 23:58:28 +0200
Message-ID: <87mxeqmuij.fsf@rho.meyering.net>
Lines: 14
MIME-Version: 1.0
Content-Type: text/plain
X-Scanned-By: MIMEDefang 2.68 on 10.5.11.22
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Tue, 30 Aug 2011 21:58:34 -0000

I plan to push these parse-datetime.y changes to gnulib:

    http://thread.gmane.org/gmane.comp.lib.gnulib.bugs/27929/focus=27953

(doc changes can wait a few days, if needed)
and then the corresponding change to make coreutils use it,
add a test and to note the improvement in NEWS:

    http://thread.gmane.org/gmane.comp.gnu.coreutils.general/1518

That should happen tomorrow.

Then I'll make a snapshot, which we'll let settle for at least a
couple of days before releasing coreutils-8.13 some time next week.


From MAILER-DAEMON Wed Aug 31 15:40:17 2011
Received: from list by lists.gnu.org with archive (Exim 4.71)
	id 1Qyqe1-0004lW-EA
	for mharc-coreutils@gnu.org; Wed, 31 Aug 2011 15:40:17 -0400
Received: from eggs.gnu.org ([140.186.70.92]:47879)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qyqdx-0004iw-Ac
	for coreutils@gnu.org; Wed, 31 Aug 2011 15:40:15 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <jim@meyering.net>) id 1Qyqdu-0006hB-Ov
	for coreutils@gnu.org; Wed, 31 Aug 2011 15:40:13 -0400
Received: from mx1.redhat.com ([209.132.183.28]:25927)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <jim@meyering.net>)
	id 1Qyqdu-0006h3-7N; Wed, 31 Aug 2011 15:40:10 -0400
Received: from int-mx01.intmail.prod.int.phx2.redhat.com
	(int-mx01.intmail.prod.int.phx2.redhat.com [10.5.11.11])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p7VJe8iq031002
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK);
	Wed, 31 Aug 2011 15:40:08 -0400
Received: from mx.meyering.net (ovpn01.gateway.prod.ext.phx2.redhat.com
	[10.5.9.1])
	by int-mx01.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p7VJe7LI013872; Wed, 31 Aug 2011 15:40:08 -0400
Received: from rho.meyering.net (localhost.localdomain [127.0.0.1])
	by rho.meyering.net (Acme Bit-Twister) with ESMTP id E95D1600A2;
	Wed, 31 Aug 2011 21:40:06 +0200 (CEST)
From: Jim Meyering <jim@meyering.net>
To: coreutils@gnu.org
Subject: new snapshot available: coreutils-8.12.178-df9cd
Date: Wed, 31 Aug 2011 21:40:06 +0200
Message-ID: <87ei01id49.fsf@rho.meyering.net>
Lines: 386
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.11
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
	recognized.
X-Received-From: 209.132.183.28
Cc: coordinator@translationproject.org, platform-testers@gnu.org
X-BeenThere: coreutils@gnu.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: GNU coreutils General Discussion <coreutils.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/coreutils>
List-Post: <mailto:coreutils@gnu.org>
List-Help: <mailto:coreutils-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/coreutils>,
	<mailto:coreutils-request@gnu.org?subject=subscribe>
X-List-Received-Date: Wed, 31 Aug 2011 19:40:15 -0000

Wow.  There have been nearly 1000 commits in *gnulib* since coreutils-8.12.
With 178 in coreutils proper, that is well above average[*].
If all goes well, I'll release coreutils-8.13 early next week,
so please beat this up (i.e., test) on a whatever systems you can.

A first for this snapshot, I've Cc'd the brand new platform-testers
mailing list: https://lists.gnu.org/mailman/listinfo/platform-testers


coreutils snapshot: (.gz files are here, too)
  http://meyering.net/cu/coreutils-ss.tar.xz      4.8 MB
  http://meyering.net/cu/coreutils-ss.tar.xz.sig
  http://meyering.net/cu/coreutils-8.12.178-df9cd.tar.xz

There are .gz and .sig files here, too:
  http://people.redhat.com/meyering/cu/coreutils-ss.tar.xz
  http://people.redhat.com/meyering/cu/coreutils-8.12.178-df9cd.tar.xz


Here's the NEWS, followed by git-shortlog output, followed
by a summary of commits per release since 6.9.
I've omitted the 969 lines of gnulib's shortlog output.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

** Bug fixes

  chown and chgrp with the -v --from=3D options, now output the correct own=
er.
  I.E. for skipped files, the original ownership is output, not the new one.
  [bug introduced in sh-utils-2.0g]

  cp -r could mistakenly change the permissions of an existing destination
  directory.  [bug introduced in coreutils-6.8]

  cp -u -p would fail to preserve one hard link for each up-to-date copy
  of a src-hard-linked name in the destination tree.  I.e., if s/a and s/b
  are hard-linked and dst/s/a is up to date, "cp -up s dst" would copy s/b
  to dst/s/b rather than simply linking dst/s/b to dst/s/a.
  [This bug appears to have been present in "the beginning".]

  fts-using tools (rm, du, chmod, chgrp, chown, chcon) no longer use memory
  proportional to the number of entries in each directory they process.
  Before, rm -rf 4-million-entry-directory would consume about 1GiB of memo=
ry.
  Now, it uses less than 30MB, no matter how many entries there are.
  [this bug was inherent in the use of fts: thus, for rm the bug was
  introduced in coreutils-8.0.  The prior implementation of rm did not use
  as much memory.  du, chmod, chgrp and chown started using fts in 6.0.
  chcon was added in coreutils-6.9.91 with fts support.  ]

  pr -T no longer ignores a specified LAST_PAGE to stop at.
  [bug introduced in textutils-1.19q]

  printf '%d' '"' no longer accesses out-of-bounds memory in the diagnostic.
  [bug introduced in sh-utils-1.16]

  split --number l/... no longer creates extraneous files in certain cases.
  [bug introduced in coreutils-8.8]

  timeout now sends signals to commands that create their own process group.
  timeout is no longer confused when starting off with a child process.
  [bugs introduced in coreutils-7.0]

  unexpand -a now aligns correctly when there are spaces spanning a tabstop,
  followed by a tab.  In that case a space was dropped, causing misalignmen=
t.
  We also now ensure that a space never precedes a tab.
  [bug introduced in coreutils-5.3.0]

** Changes in behavior

  chmod, chown and chgrp now output the original attributes in messages,
  when -v or -c specified.

  cp -au (where --preserve=3Dlinks is implicit) may now replace newer
  files in the destination, to mirror hard links from the source.

** New features

  md5sum accepts the new --strict option.  With --check, it makes the
  tool exit non-zero for any invalid input line, rather than just warning.
  This also affects sha1sum, sha224sum, sha384sum and sha512sum.

  split accepts a new --filter=3DCMD option.  With it, split filters output
  through CMD.  CMD may use the $FILE environment variable, which is set to
  the nominal output file name for each invocation of CMD.  For example, to
  split a file into 3 approximately equal parts, which are then compressed:
    split -n3 --filter=3D'xz > $FILE.xz' big
  Note the use of single quotes, not double quotes.
  That creates files named xaa.xz, xab.xz and xac.xz.

  timeout accepts a new --foreground option, to support commands not started
  directly from a shell prompt, where the command is interactive or needs to
  receive signals initiated from the terminal.

** Improvements

  cp and ls now support HP-UX 11.11's ACLs, thanks to improved support
  in gnulib.

  df now supports disk partitions larger than 4 TiB on MacOS X 10.5
  or newer and on AIX 5.2 or newer.

  join --check-order now prints "join: FILE:LINE_NUMBER: bad_line" for an
  unsorted input, rather than e.g., "join: file 1 is not in sorted order".

  shuf outputs small subsets of large permutations much more efficiently.
  For example `shuf -i1-$((2**32-1)) -n2` no longer exhausts memory.

  stat -f now recognizes the GPFS, MQUEUE and PSTOREFS file system types.

  timeout now supports sub-second timeouts.

** Build-related

  Changes inherited from gnulib address a build failure on HP-UX 11.11
  when using /opt/ansic/bin/cc.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Beno=EEt Knecht (6):
      doc: note date's %k, %l are space-padded and equivalent to %_H and %_I
      doc: note that cp -l creates _hard_ links
      doc: don't terminate SEE ALSO sections with a period
      dircolors: highlight .webm multimedia files
      doc: note the order in which wc counts are printed
      doc: describe the file permissions set by mktemp

Bernhard Voelker (6):
      chmod: output the original mode in verbose mode
      tests: improve init.sh by removing w2_
      tests: cp/sparse-fiemap: use "head -n99" in place of "head -99"
      tests: stat-free-color: do not count stat calls before main
      maint: fix warning 'possible use of "=3D" where "=3D=3D" was intended'
      maint: remove empty statement after jump label

Bruno Haible (1):
      doc: mention the restrictions for stdbuf more prominently

Eric Blake (2):
      build: update to latest gnulib
      build: list makeinfo 4.13 as a build-from-git requirement

Erik Auerswald (1):
      doc: correct typo in yesterday's NEWS entry: 30GB -> 30MB

Ivan Sichmann Freitas (2):
      maint: fix comment typos in df.c
      doc: add a vim indentation example

James Youngman (2):
      maint: use stat-size module from gnulib
      maint: typo: insert omitted word in test comment

Jeff Liu (1):
      copy: correct misuse of quote in diagnostic

Jim Meyering (89):
      post-release administrivia
      tests: write skip explanation from perl scripts also to outer stderr
      tests: remove useless test: misc/pwd-unreadable-parent
      tests: distribute new file, CuSkip.pm
      maint: adjust split.c formatting to conform
      build: avoid bootstrap failure when $GZIP is set
      copy: fix my typo
      doc: remove a name from THANKS.in that is derived from git log
      maint: remove unnecessary listing of update-copyright in Makefile.am
      maint: remove use of gnulib's obsolete strtol module
      build: update gnulib submodule to latest
      tests: test split's new --filter=3DCMD option
      doc: document split's new --filter=3DCMD option
      tests: don't fail the split --filter=3DCMD test if xz is not available
      maint: tail: mark a global variable as static
      maint: remove syntax-checking sc_tight_scope rule
      build: update gnulib submodule to latest
      maint: use <unistd.h>, not "group-member.h"
      ls: allow stat-free use of --color
      tests: use skip_test_, not skip_
      maint: add new syntax-check rule to prohibit use of skip_
      maint: avoid syntax-check failure due to long line
      maint: correct typos involving misuse of "a" and "an"
      doc: fix a formatting nit in od's texinfo documentation
      tests: fix typo in tac-continue
      doc: describe how kernel inotify support affects tail -f
      maint: avoid trivial syntax-check failure
      touch: placate static analyzers: no NULL-deref is possible
      doc: make README-hacking slightly more generic
      maint: accommodate gnulib's newer tight_scope rule
      tests: ls/stat-free-color: fix unwarranted failure on a 32-bit system
      shred: placate coverity and fix a comment
      maint: env.c: remove unnecessary use of strchr
      maint: enforce cpp indentation policy
      maint: accommodate gcc's -Wstrict-overflow option
      build: --enable-gcc-warnings: enable -Wstrict-overflow in src/
      tests: move tests/misc/split-* into tests/split/...
      maint: remove useless (off_t) cast of lseek arg
      ls: placate gcc-4.7.0's -Wstrict-overflow
      maint: placate -Wsign-compare when it's non-invasive
      maint: remove unnecessary gnulib .diff file
      tail: fix an inconsequential bug spotted by coverity
      tests: stat-free-color: accommodate stat of /selinux on rawhide
      maint: remove now-spurious curly braces
      build: require at least 2-year old autoconf-2.64 (was 2.62)
      tests: inotify-rotate: avoid false positive under heavy load
      tests: avoid sort-spinlock-abuse false positive under heavy load
      doc: add NEWS items for recent gnulib fixes
      init.sh: accommodate shells for which 1>&$stderr_fileno_ fails
      maint: revert previous commit
      init.sh: sync from gnulib
      tests: accommodate HP-UX and ksh-derived shells
      tests: use printf, not echo in init.sh's warn_ function
      tests: make init.sh's warn_ emit to both the tty and the log file
      tests: remove skip_test_ function; use new skip_ instead
      tests: avoid sort-spinlock-abuse false positive under heavy load
      maint: use modules/tempname.diff file, not a replacement; update gnul=
ib
      tests: sort-debug-keys: fix a bug with translated diagnostics
      stdbuf: fix automake variable name to work with cutting edge automake
      maint: update THANKS.in
      tests: init.sh: use "sed 1q" in place of "head -1"
      build: bootstrap: remove obsolete gettext-related file exclusions
      maint: don't use gnulib's pathmax module; define PATH_MAX if needed
      doc: clarify an improvement from coreutils-7.0
      doc: improve ls --help grammar
      buffer_lcm: declare with _GL_ATTRIBUTE_CONST
      maint: use "const" and "pure" function attributes where possible
      stat: recognize GPFS as a file system type
      tests: exercise md5sum's new --strict option
      maint: add syntax-check rule to prohibit "."-terminated "SEE ALSO"
      build: update gnulib submodule to latest
      df: support partitions larger than 4 TiB on MacOS >=3D 10.5 & AIX >=
=3D5.2
      build: update gnulib to fix a build warning/error in a test program
      cp -up: preserve all hard links
      maint: use consistent style in C and test scripts
      doc: mention cp's dir-permissions fix
      build: update gnulib, for "make syntax-check" fix
      build: require gnulib's fclose module
      maint: accommodate old-NEWS update
      maint: prevent accidental future use of the old shell function name
      maint: add copyright notice to init.cfg
      maint: use xcalloc rather than xmalloc+memset (no semantic change)
      join: with --check-order print offending file name, line number and d=
ata
      tests: avoid lack-of-support du test failure on HP-UX 11.31
      maint: use gnulib's new largefile modulue
      rm, du, chmod, chown, chgrp: use much less memory for large directori=
es
      tests: adjust the new, very expensive rm test to be less expensive
      maint: rename a test
      date: support parsing of ISO-8601-with-"T" dates

Karl Berry (1):
      maint: README-hacking clarifications

Karl Heuer (1):
      split: accept new output --filter=3DCMD option

Marek Polacek (1):
      yes.c: do not use exit after error

Mike Frysinger (1):
      dircolors: add screen.Eterm terminal type

Patrick Schoenfeld (1):
      md5sum, sha1sum, etc: accept new option: --strict

Paul Eggert (18):
      * doc/coreutils.texi (sort invocation): I/0 -> I/O (sr#107504)
      * src/fiemap.h (struct fiemap.fm_extents): Change size to 1.
      * src/dd.c: Remove obsolete comments re POSIX.
      csplit: don't prematurely terminate cleanup (Bug#9076)
      dd: port to NonStop (Bug#9076)
      ls: port to NonStop (Bug#9076)
      timeout: port to NonStop (Bug#9077)
      * src/timeout.c (main): Use waitpid, not wait (Bug#9098).
      Fix capiTalization in comments.
      timeout: treat seconds counts like 'sleep' does
      timeout: add regression test (Bug#9098)
      * NEWS: Mention fix for Bug#9098.
      dd, shred: use fdatasync only if declared
      cp: don't mishandle existing dir dest permissions (Bug#9170)
      * NEWS: Say that 6.12 preserved ns-resolution timestamps.
      mktemp: stir in enough entropy (Bug#6683)
      bootstrap: use latest gnulib bootstrap, gettext
      pathchk: port to hosts where mbstate_t is replaced

P=E1draig Brady (39):
      df: fix crash in mem exhaustion edge case
      sort: fix a contradictory --debug warning
      maint: remove -Wmissing-field-initializers workarounds
      shuf: use memory more efficiently when returning a subset
      tests: refactor more tests to use mkfifo_or_skip_
      doc: mention that ls time ordering is newest first
      printf: fix an out-of-bounds memory access
      doc: improve tail -f vs. inotify description and advice
      split: fix cases where -n l/... creates extraneous files
      split: fix an edge case where -n l/... creates an extra file
      split: return success even if a --filter exits
      split: exit when we can no longer write to a --filter
      split: diagnose when --filter is used with a chunk number
      maint: split: remove --filter specific code from other paths
      maint: fix a -Wstrict-overflow build failure with gcc 4.5
      chown,chgrp: output the correct ownership in -v messages
      chown,chgrp: output the original ownership in -v messages
      doc: add examples to date --help
      maint: remove unneeded includes
      tests: avoid a false failure on HPUX systems
      maint: remove duplicate names from THANKS
      maint: avoid a false positive syntax check
      stat: recognize MQUEUE and PSTOREFS file systems
      doc: detail the effect of disabling input buffering with stdbuf
      timeout: add --foreground to support interactive commands
      timeout: support cascaded timeouts
      timeout: handle signals more transparently
      doc: list all new file system types recognized by stat -f
      build: avoid a fiemap compile failure on some systems
      build: avoid a st_blksize compile failure on some systems
      unexpand: fix misalignment when spaces span a tabstop
      maint: remove a redundant call to gl_CLOCK_TIME
      timeout: support sub-second timeouts
      tests: cp/preserve-link: test all relevant paths
      maint: copy: refactor hard link creation
      doc: mention the new mirroring behavior of cp -au
      pr: fix so that LAST_PAGE is honored with -T
      timeout: revert signal propagation enhancement
      build: heap.c: make possible gnulib candidate c89 compatible

Stefano Lattarini (5):
      maint: fix typo in comment in configure.ac
      tests: make test runner a script, not a shell function
      tests: avoid extra forks in the testsuite
      tests: remove obsolete 'error_' shell function
      tests: complete the renaming framework_failure -> framework_failure_

St=E9phane Raimbault (1):
      doc: add a missing space in timeout --help

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
* gnulib a81348d...9926b90 (969):
...<969 lines elided>...

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Wondering about average commits per release, I wrote this tiny script:

#!/bin/sh
prev=3D
{ git tag | grep '^v' | sort -V; echo HEAD; } | \
  while read v; do
    printf $v
    test -z $prev && { echo; prev=3D$v; continue; }
    n=3D$(git rev-list $prev..$v|wc -l)
    printf "\t%3d\n" $n
    prev=3D$v
  done
exit

----------------------

Here's its output for coreutils:

    v6.9
    v6.9.89 381
    v6.9.90  68
    v6.9.91  15
    v6.9.92  27
    v6.10    12
    v6.11   201
    v6.12   112
    v7.0    226
    v7.1    195
    v7.2     90
    v7.3     72
    v7.4     11
    v7.5    135
    v7.6     82
    v8.0     66
    v8.1    130
    v8.2     39
    v8.3     59
    v8.4     15
    v8.5    103
    v8.6    200
    v8.7     37
    v8.8     83
    v8.9     14
    v8.10    81
    v8.11    74
    v8.12    21
    HEAD    178

So, yes, "178" is above the average (for the above subset) of 97.4.


