Skip to content
This repository has been archived by the owner on Dec 5, 2019. It is now read-only.

saveAsTextFile() + -getmerge returning empty file #565

Open
rafrombrc opened this issue Jun 16, 2017 · 0 comments
Open

saveAsTextFile() + -getmerge returning empty file #565

rafrombrc opened this issue Jun 16, 2017 · 0 comments
Assignees
Labels
Milestone

Comments

@rafrombrc
Copy link
Member

From https://bugzilla.mozilla.org/show_bug.cgi?id=1373633

Sequence of events:
In Spark:
serialized_beta_full[1].saveAsTextFile("s3://net-mozaws-prod-us-west-2-pipeline-analysis/ekr/serialized-beta-full.out")

In hadoop:
hadoop fs -getmerge s3://net-mozaws-prod-us-west-2-pipeline-analysis/ekr/serialized-beta-full.out serialized-beta-full.out

This claims to copy a lot of files, but the result is 0-length.

@rafrombrc rafrombrc added this to the m4 milestone Jun 22, 2017
@rafrombrc rafrombrc modified the milestones: m5, m4 Jul 20, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

2 participants