It's likely here that "pwd" is the shell's builtin version, rather than
coreutils'.
Here what I see when calling /bin/pwd explicitly:
$ rmdir -v $(/bin/pwd)
rmdir: removing directory, /tmp/not-here
$ /bin/pwd
/bin/pwd: cannot get current directory: No such file or directory
I'd agree that this discrepancy between shell builtin and coreutil is
somewhat confusing.