Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

merge latest #1

Merged
merged 76 commits into from
Apr 26, 2019
Merged

merge latest #1

merged 76 commits into from
Apr 26, 2019

Conversation

SwanseaLeo
Copy link
Owner

No description provided.

smoitra-g and others added 30 commits August 30, 2018 19:09
@smoitra-g @psc-g
Update snakecase to camelcase for certain variables.
c154865 
PiperOrigin-RevId: 210592195
@psc-g
Fix docstring, as it is not returning is_episode_over.
37fa491 
PiperOrigin-RevId: 210983763
@smoitra-g
BEGIN: Add "apt-get update" to install instructions.
e97a3cd 
PiperOrigin-RevId: 211382454
@psc-g
Add a .gitignore file.
98ef0f5 
PiperOrigin-RevId: 211460953
@psc-g
Add Machado et al. reference to main README, and update some referenc…
2664814 
…es to their published links.

PiperOrigin-RevId: 211953206
@psc-g
Update install instructions for tensorflow with GPU support.
46222d7 
PiperOrigin-RevId: 212782732
@psc-g
Add support for in-iteration Tensorboard reporting.
fb3f376 
PiperOrigin-RevId: 213423885
@psc-g
Add a What's New section to the main README and include the latest in…
a59d5d6 
…-iteration change.

PiperOrigin-RevId: 213449527
@tlwillke
Update utils.py
11b435f 
Typo
@psc-g
Removed redundant target q-value computation and added option for dou…
7d7828d 
…ble dqn.

PiperOrigin-RevId: 213507746
@psc-g
Add visibility for IQN double-DQN functionality to the README.
70b81a1 
PiperOrigin-RevId: 213597916
@psc-g
Observation shape can be a tuple, Circular memory buffer's logging sh…
94e1850 
…ould allow for this.

PiperOrigin-RevId: 213686185
@psc-g
Add explicit unit tests for get_range().
aaf334b 
PiperOrigin-RevId: 213818042
@psc-g
Fixed quantile reshaping bug and set terminal_on_life_loss = True f…
2de70a4 
…or the ICML gin config file.

PiperOrigin-RevId: 214080101
@psc-g
Update JSON files, links and colab utils to use the IQN runs after th…
29661e3 
…e bug-fix.

PiperOrigin-RevId: 217402619
@psc-g
Update colabs to use new IQN data.
5259379 
PiperOrigin-RevId: 217561622
@psc-g
update the assertion clause in Runner
38b1fd2 
PiperOrigin-RevId: 218741713
@psc-g
Provide the graph definition to Tensorboard.
4be166d 
PiperOrigin-RevId: 219163382
@psc-g
Add download links for each of the individual checkpoints, to avoid h…
6665652 
…aving to download all of them as a single .tar.gz file.

PiperOrigin-RevId: 219607104
@psc-g
Merge branch 'master' into patch-1
e5d8465
@psc-g
Merge pull request #32 from tlwillke/patch-1
7a58561 
Fix typo in utils.py
@psc-g
internal
688a7e2 
PiperOrigin-RevId: 219810600
@tlwillke @psc-g
internal merge of PR #32
7ca1f2d 
PiperOrigin-RevId: 220686551
@psc-g
internal
bea54bb 
PiperOrigin-RevId: 221077222
@psc-g
Generalize agent constructors to accept different specifications of o…
8d6cbb3 
…bservation shape/type, and the stack size.

PiperOrigin-RevId: 221138027
@psc-g
Add a thin wrapper around Gym environments to make them conformant to…
292f797 
… the API expected by Dopamine.

PiperOrigin-RevId: 221243592
@psc-g
internal.
4eec4a8 
PiperOrigin-RevId: 221268516
@psc-g
internal.
32d23e1 
PiperOrigin-RevId: 221311567
@psc-g
Remove TF dependency in setup and increase version number.
1f54124 
PiperOrigin-RevId: 221502319
@psc-g
Generalize observation_shape specification, to allow for non-square s…
0d9afcf 
…hapes.

PiperOrigin-RevId: 221709966
psc-g and others added 29 commits January 31, 2019 12:32
@psc-g
Add rainbow support for cartpole and acrobot.
206c57d 
PiperOrigin-RevId: 230914146
@psc-g
Finish migration of Dopamine to using discrete_domains instead of atari.
034e0ab 
PiperOrigin-RevId: 231432169
@psc-g
Remove useless lines.
eb4b102 
PiperOrigin-RevId: 231517673
@jingconan @psc-g
Fix the the dopamine circular_replay_buffer for case in which reward …
b658c5e 
…is a vector

PiperOrigin-RevId: 231540267
@psc-g
Set reasonable default settings for rainbow on cartpole and acrobot.
f3653b5 
PiperOrigin-RevId: 231598699
@psc-g
Tidy up documentation for Dopamine 2.0.
19b0348 
PiperOrigin-RevId: 231661808
@psc-g
Update api_docs for Dopamine 2.0.
11dee79 
PiperOrigin-RevId: 231771911
@psc-g
Add agents using Fourier basis and linear Q function approximation
202fa9e 
PiperOrigin-RevId: 232039653
@psc-g
Adding a colab demonstrating how to train agents on Cartpole.
9dbd94a 
PiperOrigin-RevId: 232073385
@psc-g
Remove unused debug_mode flag and update documentation.
753a243 
PiperOrigin-RevId: 232074103
@psc-g
removed the comment regarding the time limit, as it's wrong
e873d7c 
PiperOrigin-RevId: 232499569
@psc-g
Remove atari-py and cmake installs for cartpole colab.
5fad7e9 
PiperOrigin-RevId: 232524026
@psc-g
Make default number of checkpoints saved consistent between dqn_agent…
53d3450 
… and checkpointer.

PiperOrigin-RevId: 232544723
@smoitra-g @psc-g
Fix docstring
4799c3a 
PiperOrigin-RevId: 232547295
@psc-g
Update Cartpole configuration files and colab to match default Gym ma…
79b024f 
…x episode length.

PiperOrigin-RevId: 232791515
@psc-g
Update the agents colab to the new Dopamine 2.0 interface.
d7049fe 
PiperOrigin-RevId: 233077734
@psc-g
internal.
349261c 
PiperOrigin-RevId: 233593997
@psc-g
Update documentation to support Python 3.6.
0ce0709 
PiperOrigin-RevId: 234139600
@smoitra-g @psc-g
Update create_agent docstring.
711e188 
PiperOrigin-RevId: 234151608
@psc-g
Add close method to AtariPreprocessing.
00a5b32 
PiperOrigin-RevId: 235068759
@psc-g
Adding a comment to clarify why Rainbow uses the same data structure …
33c4f61 
…for both replay schemes

PiperOrigin-RevId: 237079830
@psc-g
Update DQNAgent's eval_mode. Allow setting it in constructor and remo…
2639e7d 
…ve it from the bundle.

PiperOrigin-RevId: 238107489
@psc-g
Remove unused dependency on tf.slim in agents
75fc33a 
PiperOrigin-RevId: 238608544
@psc-g
Changing CartPole/Acrobot observation type to match what is returned …
f6dc339 
…by Gym

PiperOrigin-RevId: 241769847
@psc-g
Fix bug whereby batches of size larger than 1000 would never get
2435916 
PiperOrigin-RevId: 242851617
@psc-g
Propagating observation dtype to the replay buffer in RainbowAgent si…
2ce82ea 
…milarly to DQNAgent.

PiperOrigin-RevId: 243108947
@psc-g
Fix ValueError issue when reloading baselines and increase minor vers…
834c4b8 
…ion number for new release.

PiperOrigin-RevId: 243803145
@psc-g
Fix remaining instance of ValueError when numerics not cast as float6…
01abb82 
…4s, and increase minor version number for new release.

PiperOrigin-RevId: 243966695
@psc-g
Only load training runs, as the colab uses TrainRunner, which doesn't…
826f172 
… generate eval curves.

PiperOrigin-RevId: 244255414
@SwanseaLeo SwanseaLeo merged commit 897d3e4 into SwanseaLeo:master Apr 26, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
8 participants
@SwanseaLeo @zafarali @psc-g @jayboyY1 @eikafatih94 @smoitra-g @tlwillke @jingconan