Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#119: speed up #974

Merged
merged 8 commits into from
Jun 17, 2014
Merged

Conversation

benfitzpatrick
Copy link
Contributor

The work on the #119 branch introduced some new bottlenecks into
the main daemon thread and in cylc validate for large suites.

This pull request contains some fixes for those bottlenecks and
a couple of minor tweaks in non-cycling-affected code that were
spotted along the way.

The main loop non-sleep CPU time is now halved compared to
the current HEAD of the iso branch for a busy suite like this one:

https://gist.github.com/benfitzpatrick/7874308

This equates to 30% better than current HEAD of master.

For a suite that hangs around like this one:
https://gist.github.com/benfitzpatrick/7875481
then the main loop CPU time is halved compared to the current
HEAD of the iso branch, but approximately the same as master.

@arjclark, please review - @hjoliver, please take a look if you
get any spare time!

@benfitzpatrick benfitzpatrick added this to the cylc-6 milestone Jun 16, 2014
@@ -669,6 +672,23 @@ def remove_suiciding_tasks( self ):
self.remove( itask, 'suicide' )


def _get_earliest_unsatisfied_cycle_point( self ):
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The move to this function doesn't speed anything up, but it helped
profile this code block - I think we'll may need to look at this in the
future.

@arjclark
Copy link
Contributor

Looks good to me. Tests now passing in my environment.

arjclark added a commit that referenced this pull request Jun 17, 2014
@arjclark arjclark merged commit 4f8763f into cylc:119.iso8601-cycling Jun 17, 2014
@benfitzpatrick benfitzpatrick deleted the iso.speedup branch August 20, 2014 10:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants