[Python-ideas] find-like functionality in pathlib

Gregory P. Smith greg at krypto.org
Mon Jan 11 13:57:43 EST 2016


On Wed, Jan 6, 2016 at 3:05 PM Brendan Moloney <moloney at ohsu.edu> wrote:

> Its important to keep in mind the main benefit of scandir is you don't
> have to do ANY stat call in many cases, because the directory listing
> provides some subset of this info. On Linux you can at least tell if a path
> is a file or directory.  On windows there is much more info provided by the
> directory listing. Avoiding subsequent stat calls is also nice, but not
> nearly as important due to OS level caching.
>

+1 - this was one of the two primary motivations behind scandir.  Anything
trying to reimplement a filesystem tree walker without using scandir is
going to have sub-standard performance.

If we ever offer anything with "find like functionality" related to
pathlib, it *needs* to be based on scandir.  Anything else would just be
repeating the convenient but untrue limiting assumptions of os.listdir:
That the contents of a directory can be loaded into memory and that we
don't mind re-querying the OS for stat information that it already gave us
but we threw away as part of reading the directory.

-gps


>
>
> Brendan Moloney
> Research Associate
> Advanced Imaging Research Center
> Oregon Health Science University
> *From:* Python-ideas [python-ideas-bounces+moloney=ohsu.edu at python.org]
> on behalf of Guido van Rossum [guido at python.org]
> *Sent:* Wednesday, January 06, 2016 2:42 PM
> *To:* Random832
>
> *Cc:* Python-Ideas
> *Subject:* Re: [Python-ideas] find-like functionality in pathlib
> I couldn't help myself and coded up a prototype for the StatCache design I
> sketched. See http://bugs.python.org/issue26031. Feedback welcome! On my
> Mac it only seems to offer limited benefits though...
>
>
> _______________________________________________
> Python-ideas mailing list
> Python-ideas at python.org
> https://mail.python.org/mailman/listinfo/python-ideas
> Code of Conduct: http://python.org/psf/codeofconduct/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20160111/6a70fac7/attachment-0001.html>


More information about the Python-ideas mailing list