On Wed, Jan 6, 2016 at 3:05 PM Brendan Moloney <moloney at ohsu.edu> wrote:
> Its important to keep in mind the main benefit of scandir is you don't
> have to do ANY stat call in many cases, because the directory listing
> provides some subset of this info. On Linux you can at least tell if a path
> is a file or directory. On windows there is much more info provided by the
> directory listing. Avoiding subsequent stat calls is also nice, but not
> nearly as important due to OS level caching.
>
+1 - this was one of the two primary motivations behind scandir. Anything
trying to reimplement a filesystem tree walker without using scandir is
going to have sub-standard performance.
If we ever offer anything with "find like functionality" related to
pathlib, it *needs* to be based on scandir. Anything else would just be
repeating the convenient but untrue limiting assumptions of os.listdir:
That the contents of a directory can be loaded into memory and that we
don't mind re-querying the OS for stat information that it already gave us
but we threw away as part of reading the directory.
-gps
>>> Brendan Moloney
> Research Associate
> Advanced Imaging Research Center
> Oregon Health Science University
> *From:* Python-ideas [python-ideas-bounces+moloney=ohsu.edu at python.org]
> on behalf of Guido van Rossum [guido at python.org]
> *Sent:* Wednesday, January 06, 2016 2:42 PM
> *To:* Random832
>> *Cc:* Python-Ideas
> *Subject:* Re: [Python-ideas] find-like functionality in pathlib
> I couldn't help myself and coded up a prototype for the StatCache design I
> sketched. See http://bugs.python.org/issue26031. Feedback welcome! On my
> Mac it only seems to offer limited benefits though...
>>> _______________________________________________
> Python-ideas mailing list
>Python-ideas at python.org>https://mail.python.org/mailman/listinfo/python-ideas> Code of Conduct: http://python.org/psf/codeofconduct/-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20160111/6a70fac7/attachment-0001.html>