4.1.0 Release #125

qlquanle · 2017-09-05T02:03:11Z

notes to follow

…lder (#104) * #92 rm config checking of stata exec, unless stata packages are checked * #92 edit the messages

* #98 first pass * #98 edits

* switch name to config_user.yaml * #61 more switchs

* #96 add latex builder * #96 write test for latex builder * #96 change to 4.0.2 * #96 small edit * #96 delete log files * #96 add nonstop option in latex builde

* #93 first pass * #93 second pass * #93 add carriage return

* #95 first pass * #95 second pass after testing * fix PR * small edits

* #108 update test_build_stata * #108 fix test_configuration_tests * #108 fix test_log * #108 fix test_build_r * #108 change build_r and tests * #108 modify test_build_r * #108 fix some checks after adding check_targets * #108 comment out target check in build_tables

* #111 fix * #111 edit readme * #111 fix PR

* #97 write anything builder * #97 change log_file to log_ext mechanism * #97 new version, builder generator * #97 add pretty comments * #97 fix comment indent * #97 respond to PR * #97 warning edits

* #94 allow folders to be exluded from search * #94 add argument to upper level function * #94 fix syntax

* LB Edits for latex tablefill * #102 small edits and re-run tests * #102 update python and re-run * #102 update tests for tablefill latex * #102 edit gitignore

* first pass * edit readme * adding test

* #60 provenance.py mockup * template#60 formatting * #60 add pretty comments * #60 add release mechanism * template#60 respond to pr * template#60 release PR * gslab-econ/template#60 fix bug * #60 respond to PR

* #60 provenance.py mockup * template#60 formatting * #60 add pretty comments * #60 add release mechanism * template#60 respond to pr * template#60 release PR * gslab-econ/template#60 fix bug * #60 respond to PR * gslab-econ/template#60 add non-default sig * gslab-econ/template#60 add external provenance option for release * gslab-econ/template#60 pr * gslab-econ/template#60 fix syntax

* #91 first pass * #91 improve warning message * #91 second pass * fix bug * fix more bugs * fix bugs and third pass * fix bugs * add in comments and options for path of git attributes * first pass on debrief * fix PR * miss one file_name * fix pr * small edits * implement debrief PR * small edits

…th installation methods (#123) * #122 test what pip does * #122 cut some old code * #122 abs path in setup.py * #122 fix abs apth * #122 Force uninstallation of all gslab tools at install time * #123 #122 import site

… args (#124) * Allow version and readme args in function call instead of sysagrv, update docs * respond to PR

* #126 hit all checks, no documentation * #126 fix overwrite of scons_local_path * #126 docs * #127 #126 small readme changes for PR * #126 small fixes * #127 #126 abstract text search, better config checks * #127 #126 search dir not output for SConstruct

* #128 binding file limit on directory walk * #131 purge provenance * #131 first pass dir recording system * #131 an SCons -> a SCons * #131 change default log location * #131 better naming, load into __init__, better prereq check * #131 change default name for log * #132 #131 change default log name * #132 #131 gslab-econ/template#87 new log headding * #132 #131 better path checks, fix walk-break rule, new path names * #132 #131 fix heading creation of heading with hash

qlquanle · 2017-09-11T22:22:37Z

gslab_scons/misc.py

@@ -11,39 +11,42 @@
 import _exception_classes
 from size_warning import issue_size_warnings

-def scons_debrief(target, env):
-    '''Execute functions after SCons has built all targets'''
+def scons_debrief(args):


This introduce backward incompatibility, since the user has to modify SConstruct. @Shun-Yang I don't have a great grasp on this function and you were the last one to touch it, can you add a quick fix?

^ Comment as part of #130 #133

We can change args['log'] back into the function argument as log = 'state_of_repo.log' but the reason we moved it is that this looks more compact and natural.

We had a discussion in the lab just now. Our solution is to provide a user-advisory that you cannot pass env and log to the function any longer and have to pass args, at which point we point to the current SConstruct in template. So we're fine with both 1) backward incompatibility and 2) coupled gslab_python/template for this particular problem.

…#133) * #130 fix log.py uncoupling * #130 missing slash

qlquanle · 2017-09-12T02:26:47Z

gslab_python 4.1.0 Release Notes

Features

We added a LaTeX builder and an "Anything"-builder. (Write LaTeX builder #96 Write Anything builder #97)
We added code to reconfigure the SCons cache (Add cache reconfiguration code #99)
We add a target-checker after a builder has run (Builders should check whether specified targets exist post-run #95)
gslab_scons features now use a local version of SCons by default (Fix release.py for the new top level structure #111 Fix lingering issues with release.py #126)
We add a feature to produce state_of_inputs (Change provenance to state_of_inputs #131)
gslab_python installation now delete old local versions (Delete old local gslab_python versions upon both installation methods #122)
We have unified framework to check for prerequisites (Do gslab_python side of MG review for 4.1.0 #144).

Misc

We move top-level logs to release/. or a user-specified location (Move top-level logs to release/ #93)
We allow suffixes to the name of builder logs (Address concerns about builder logs and SCons targeting #94)
We updated R syntax (Determine the syntax of R command line call #98) and Stata-executable searching behavior (Change executable-finding behavior in Stata builder #92)
We use abstract classes and overriding methods to construct our builders (Do gslab_python side of MG review for 4.1.0 #144).
We do a better job of handling default and user-specified executables (Do gslab_python side of MG review for 4.1.0 #144).

* change log exclusion syntax to proune * #138 respond to pr

* gslab-econ/template#88 recursive fun to flatten dicts * #88 PR, don't clobber repeated keys * #88 cleaner string manipulation in flatten_dict

* #142 avoid collisions with sha1 hash of path * #143 #142 fix source file removal

* #140 remove superfluous assett upload * #140 swap order of git and scons check; note behavior in readme * #140 format readme * #141 #140 split up up_to_date, raise error if not up-to-date * #141 #140 put elif after if * #141 #140 output -> log * #141 #140 add function to determine if scons is a dry run * #140 try some logging stuff * #141 #140 loggers get own files, toggle on scons dry-run

) * #144 gslab-econ/template#96 working versions of clean builders * #144 fix recursive cases when checking vers and multiple cuaght exception * #144 small adjustments to anything builder * #145 #144 switch order of args in builders * #145 #144 cleaner access to default stata executable * #145 #144 docstrings in prereq checks * #145 #144 unscramble more target/source args in the builders

arosenbe · 2018-03-02T19:29:36Z

@stanfordquan, I think this is ready to go. Do you want to make the pull?

Quan and others added 26 commits August 22, 2017 14:51

Pull request for #92: Change executable-finding behavior in Stata bui…

0e15cbd

…lder (#104) * #92 rm config checking of stata exec, unless stata packages are checked * #92 edit the messages

#92 fix conditional block for default exec

102100d

Merge branch '4.1.0' of github.com:gslab-econ/gslab_python into 4.1.0

22e6234

#92 fix conditional block in build_stata after merge

a35eb8b

Fix missing paren

45f7afa

Pull request for #98: R command line syntax (#103)

183bb89

* #98 first pass * #98 edits

Pull request: Switch user_config.yaml to config_user.yaml (#106)

556a0b7

* switch name to config_user.yaml * #61 more switchs

Pull Request for #96: Write LaTeX builder (#105)

bf7b5f0

* #96 add latex builder * #96 write test for latex builder * #96 change to 4.0.2 * #96 small edit * #96 delete log files * #96 add nonstop option in latex builde

Pull request for #93: add moving top level log to end_log (#107)

3e7281e

* #93 first pass * #93 second pass * #93 add carriage return

Pull request for #95: Check target files after each building step (#110)

216719f

* #95 first pass * #95 second pass after testing * fix PR * small edits

Pull request for #111: Fix release.py (#113)

1c765dc

* #111 fix * #111 edit readme * #111 fix PR

Pull request for #97: Anything builder (#114)

b538233

* #97 write anything builder * #97 change log_file to log_ext mechanism * #97 new version, builder generator * #97 add pretty comments * #97 fix comment indent * #97 respond to PR * #97 warning edits

Pull request for #94: allow folders to be excluded from search (#115)

46efbce

* #94 allow folders to be exluded from search * #94 add argument to upper level function * #94 fix syntax

Pull request: Bug in tablefill for latex (#102)

b6fd255

* LB Edits for latex tablefill * #102 small edits and re-run tests * #102 update python and re-run * #102 update tests for tablefill latex * #102 edit gitignore

move import SCons.builder to builder instead of generator

8a59370

Merge branch '4.1.0' of github.com:gslab-econ/gslab_python into 4.1.0

59bcc1a

move import Scons.Builder outside action and into builder generator

cd0efa1

Pull request for migrating gencat (#116)

3579287

* first pass * edit readme * adding test

uploading test

631bdf0

fix test log

b28abe7

Pull request for gslab-econ/template#60: Provenance (#120)

37e5b72

* #60 provenance.py mockup * template#60 formatting * #60 add pretty comments * #60 add release mechanism * template#60 respond to pr * template#60 release PR * gslab-econ/template#60 fix bug * #60 respond to PR

Pull request for template#60: update Provenance docs, update function…

e3fe833

… args (#124) * Allow version and readme args in function call instead of sysagrv, update docs * respond to PR

qlquanle mentioned this pull request Sep 5, 2017

Prepare for 4.1.0 release. #101

Closed

arosenbe added 2 commits September 6, 2017 16:44

qlquanle commented Sep 11, 2017

View reviewed changes

Pull request for #130: Uncouple directory structure from gslab_python (…

f0166e9

…#133) * #130 fix log.py uncoupling * #130 missing slash

This was referenced Sep 12, 2017

MG: Review 4.1.0 #134

Closed

JMS: Review 4.1.0 #135

Closed

Quan Le and others added 7 commits September 11, 2017 22:46

#133 add log.py optional argument

b8d2020

#126 fix issue (#137)

6c6ac9e

Pull request for 4.1.0: Change log exclusion syntax to prune (#138)

ab0f47f

* change log exclusion syntax to proune * #138 respond to pr

gslab-econ/template#88 recursive fun to flatten dicts (#139)

d09a277

* gslab-econ/template#88 recursive fun to flatten dicts * #88 PR, don't clobber repeated keys * #88 cleaner string manipulation in flatten_dict

Pull request for #142: Allow parallelization in MATLAB builder (#143)

456315f

* #142 avoid collisions with sha1 hash of path * #143 #142 fix source file removal

qlquanle merged commit bdce68d into master Mar 3, 2018

yuchuan2016 deleted the 4.1.0 branch March 3, 2018 00:37

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

4.1.0 Release #125

4.1.0 Release #125

qlquanle commented Sep 5, 2017

qlquanle Sep 11, 2017

qlquanle Sep 11, 2017

Shun-Yang Sep 11, 2017

qlquanle Sep 11, 2017

qlquanle commented Sep 12, 2017 •

edited

Loading

arosenbe commented Mar 2, 2018

4.1.0 Release #125

4.1.0 Release #125

Conversation

qlquanle commented Sep 5, 2017

qlquanle Sep 11, 2017

Choose a reason for hiding this comment

qlquanle Sep 11, 2017

Choose a reason for hiding this comment

Shun-Yang Sep 11, 2017

Choose a reason for hiding this comment

qlquanle Sep 11, 2017

Choose a reason for hiding this comment

qlquanle commented Sep 12, 2017 • edited Loading

gslab_python 4.1.0 Release Notes

Features

Misc

arosenbe commented Mar 2, 2018

qlquanle commented Sep 12, 2017 •

edited

Loading