4.1.0 Release #85

qlquanle · 2017-09-05T02:02:29Z

notes to follow

…lides (#72) * #62 reorganize repo * #62 add provenance * #62 allow provenance to check missing files * #72 response to PR and comments * #72 small name change

* #67 add code to fake lg dataset, add lg to gitignore * #67 add lg protocol to readme.md * Update constants.yaml * #67 blow up data file to do large release * #67 change hist in default stata code to limit number of pins * #67 delete old logs * #67 readme change * #67 manually copy new analysis files to paper input

* #61 first pass * #61 second pass * #61 switch to single quote * #93 aux first pass * #93 first pass * #93 second pass

* #61 first pass * #61 second pass * #61 switch to single quote * #61 rm config_template * add instruction on switching required softwares

* #66 revise stata scripts * #66 modify README * #66 small change in readme * #66 add note in README

* #64 add examples for python stata matlab R, mute everything except python * #64 add example of latex * #64 modify dependencies * #64 turn on git-lfs * #64 response to PR * #64 update readme and modify sample code

* #63 add builder check * #63 add autimatic config scripts * #63 response to PR * #63 change the default to not upgrade * #63 force installing of gslab_python * #63 small change per PR * #63 small change

* first pass on template * add in size warning for paper dir * fix bugs * add in option for git attributes * add in paper dir * Pull request for documenting and organizing debrief (#81) * #69 first pass * implement PR * small edits * small edits

* gslab-econ/gslab_python#99 switch to scons local * gslab-econ/gslab_python#99 delete scons local, lfs track .zip * gslab-econ/gslab_python#99 commit scons-local-2.5.1 * gslab-econ/gslab_python#99 scons python scripts for each sub * gslab-econ/gslab_python#99 remove top-level scons.zip * #83 gslab-econ/gslab_python#99 update commands in readme. * 83 gslab-econ/gslab_python#99 symlink to scons.py * #83 gslab-econ/gslab_python#83 scons.py -> run.py, mention global scons in readme * #83 gslab-econ/gslab_python#99 arg in main call

* #82 readme for 4.1.0, fix scons in paper_slides, build_anything in analysis * #82 update data download procedure * #82 add jupyter notebooks to .gitignore * #82 build_anything demonstration * #82 output * #82 uncomment builder * #84 #82 instructions to connect analysis and paper_slides * #84 #82 respond to PR * #84 #82 more PR

qlquanle · 2017-09-05T18:12:15Z

Template 4.1.0 Release Notes

Compatibility with gslab_python v4.1.0.
misc.scons_debrief()'s only argument is now args. See example in SConstruct:

template/analysis/SConstruct

Line 64 in e5659df

atexit.register(gs.misc.scons_debrief, args = debrief_args)
debrief_args are now stored in config_global.yaml instead of SConstruct.
SConstruct files formerly specifying env['PATHS'] must switch to specifying env['CONFIG'].

Features

We now create a config_user.yaml (if missing) from a boilerplate file stored in config/. (Complete MG points 1-5 #96)
We now support creating a file listing provenance of input in ./release.
We now support two SCons subdirectories: analysis and paper_slides. (Separate sub-directory for analysis and paper/slides #62)
We reduced software dependencies to shell, Python 2.7, git, and LyX. (Make current dependencies optional #63, Explore solutions for automatic (simpler) dependency installation. #65)
We have scripts to help you install package dependencies. (Make current dependencies optional #63)
We added demonstration scripts in analysis. Currently we have Stata, R, MATLAB, Python, and a demonstration of the "Anything" builder. (Port example scripts to multiple languages #64)

Misc

Update our raw data storage and release protocol to include state_of_input (Raw data storage and transfer protocol #59 Raw data provenance.log and revision checks #60)
No more hyphens in code and file names, we're team-underscores now. (Replace hyphens with underscores everywhere #68)
We now require installing gslab_stata when calling Stata from our template (Force integration with gslab_stata #66)

* #86 incorporate external logging from gslab-econ/gslab_python#131 * #87 #86 PR * #132 #131 delete stray file

* #88 allow inputs specificed as str or dict * #88 fix sconscript after flatten input in config_global

* #90 store pythonpath * #90 remove stray pythonpath definition

) * #92 turn off logging on dry run, uses gslab-econ/gslab_python#141 * #93 #92 move dry-run checking for logs into gslab_python

* #95 switch to scons 3 * .#96 update to new builders and config and rerun * #96 drop _ before anything builder * #98 #96 rerun with new builders * #98 #96 typo in README * #98 #96 better advertise package dependencies in config scripts * #98 #96 mention reset config_user in README FAQ

arosenbe · 2018-03-02T19:29:17Z

@stanfordquan, I think this is ready to go. Do you want to make the pull?

yuchuan2016 and others added 20 commits August 22, 2017 16:28

Pull request for #62: Separate sub-directory for analysis and paper/s…

c4a7a0e

…lides (#72) * #62 reorganize repo * #62 add provenance * #62 allow provenance to check missing files * #72 response to PR and comments * #72 small name change

rerun paper-slides

a6be180

Pull request: move top level logs to release (#75)

7394b5e

* #61 first pass * #61 second pass * #61 switch to single quote * #93 aux first pass * #93 first pass * #93 second pass

Pull request for #61: restructure YAML in template (#74)

91f3990

* #61 first pass * #61 second pass * #61 switch to single quote * #61 rm config_template * add instruction on switching required softwares

rm unused config_user_template

9c2c109

#97 testing anything template

ee7e080

gslab-python#97 demonstration scripts

7fdf605

Pull Request for #66: Force integration with gslab_stata (#77)

99197e5

* #66 revise stata scripts * #66 modify README * #66 small change in readme * #66 add note in README

Merge branch '4.1.0' into gslab-python#97-anything

599cc7a

gslab-python#97 change generator syntax

7702fee

gslab-python#97 respond to PR

a319c42

Pull Request for #64: Port example scripts to multiple languages (#76)

7529e71

* #64 add examples for python stata matlab R, mute everything except python * #64 add example of latex * #64 modify dependencies * #64 turn on git-lfs * #64 response to PR * #64 update readme and modify sample code

solve conflict after merge

221ca5c

rm accidental commit of local scripts

7dfbad4

Pull Request for #63: Make current dependencies optional (#78)

8bf1ac9

* #63 add builder check * #63 add autimatic config scripts * #63 response to PR * #63 change the default to not upgrade * #63 force installing of gslab_python * #63 small change per PR * #63 small change

change template

8d588ad

qlquanle added this to the 4.1.0 milestone Sep 5, 2017

qlquanle mentioned this pull request Sep 5, 2017

Prepare for 4.1.0 release. gslab-econ/gslab_python#101

Closed

arosenbe added 2 commits September 7, 2017 14:59

Pull request for #86: Integrate make_provenance into SConstruct (#87)

c987b97

* #86 incorporate external logging from gslab-econ/gslab_python#131 * #87 #86 PR * #132 #131 delete stray file

#87 #86 comment out some builders in analysis/SConstruct

e5659df

This was referenced Sep 12, 2017

MG: Review 4.1.0 gslab-econ/gslab_python#134

Closed

JMS: Review 4.1.0 gslab-econ/gslab_python#135

Closed

arosenbe and others added 3 commits October 2, 2017 13:08

Pull request for #88: Grab all paths when recording inputs (#89)

14cc148

* #88 allow inputs specificed as str or dict * #88 fix sconscript after flatten input in config_global

pep8 e713 change

0112334

Pull request for #90: Load PYTHONPATH in SCons ENV (#91)

7c2c178

* #90 store pythonpath * #90 remove stray pythonpath definition

arosenbe and others added 9 commits December 20, 2017 10:51

Fix location of sconstruct.log.

36a6355

Capitalization in readme

43b9f14

Pull request for #92: Turn off default logging during SCons dry-run (#93

ccfee4e

) * #92 turn off logging on dry run, uses gslab-econ/gslab_python#141 * #93 #92 move dry-run checking for logs into gslab_python

Fix typo in readme

6c5c9d0

#95 switch to scons 3 (#97)

53029e3

Update SCons local version in README

860fc91

practice task

c2b8b28

realized my mistake and reverting

d764443

qlquanle merged commit a820bdf into master Mar 3, 2018

yuchuan2016 deleted the 4.1.0 branch March 3, 2018 00:37

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

4.1.0 Release #85

4.1.0 Release #85

qlquanle commented Sep 5, 2017

qlquanle commented Sep 5, 2017 •

edited

Loading

arosenbe commented Mar 2, 2018

4.1.0 Release #85

4.1.0 Release #85

Conversation

qlquanle commented Sep 5, 2017

qlquanle commented Sep 5, 2017 • edited Loading

Template 4.1.0 Release Notes

Features

Misc

arosenbe commented Mar 2, 2018

qlquanle commented Sep 5, 2017 •

edited

Loading