cmd/go: list the Go resources in a physical directory

[nim-nim]

go 1.11/1.12

A lot of Go projects have been using the historical unpacked filesystem property of GOPATH to mix Go source files with other things (human documentation md files, non-Go resource files, etc).

This mixing does not make sense in module mode, since the Go compiler is the only thing that is smart enough to locate and access the content of module zip files.

Therefore there is a need to inspect existing Go project trees, to separate Go project source files from other things. And you have a bootstrapping problem, because GOPATH is not used in module mode, and the whole point of the inspection is to sort what must end up in the zip files, and what should end up elsewhere, so at this point the project is no longer in GOPATH but not in a zip module yet.

Is there a way to ask Go
"tell me what part of this directory is useful to the builder and should end up in a zip module, and what part needs to be exposed some other way?"

Aside from calling exec.Command("go", "list", "-f"…, ".") recursively that is?

(Of course one could just zip brutally the whole tree and look what breaks afterwards, but that is not a very efficient way to switch to modules)

[bcmills]

I suspect that the command you're looking for is:

go list -f '{{.Dir}}' $(dirname $(go env GOMOD))/...

[bcmills]

Hmm, that's not strictly sufficient, though: it won't tell you what testdata will be included, for example.

CC @jayconrod @ianthehat @matloob

[jayconrod]

Related #28835

[nim-nim]

Hum, unless I'm missing something:

• one can not use GOMOD because the project has not been transformed in a module yet
• go list -f '{{.Dir}}' will give you the package list but won't sort what files in the package directories should end up in the modules and what files should not

So you probably need to switch to the module directory root (because otherwise go list can inspect something else than the target directory) and use something like

 go list -f '{{$d := .Dir}}{{range $f := .GoFiles}}{{printf "%s/%s\n" $d $f}}{{end}}}{{range $f := .CgoFiles}}{{printf "%s/%s\n" $d $f}}{{end}}{{range $f := .CFiles}}{{range $f := .CXXFiles}}{{printf "%s/%s\n" $d $f}}{{end}}{{printf "%s/%s\n" $d $f}}{{end}}{{range $f := .TestGoFiles}}{{printf "%s/%s\n" $d $f}}{{end}}' ./...

which is not terribly convenient (and it is not even complete, there are other kinds of source files to add)

And having to os.exec go list from a Go program is not terribly elegant either

[seankhliao]

seems like nobody else needs this, and i believe zip contents need to be ~everything to match modules sums.