Project Meeting 2016.10.21

#Task 1 Project Management

• OSG's budget has been re-allocated to RSG for Task 10 Full Model Run
• What's the status of SANDAG funding some additional work later this year?
• Bill to see if an email NTP is ok for moving Task 8 to next year and using the budget for Task 10
• Will check the budget at the end of the month since we're almost out of funds

#Task 10 Full Model Run

• Sped up cdap_rank calculation by replacing slow groupby.rank function with lower-level version.
• Rewrote interaction_simulate for improved performance by streamlining the usage of the underlying pandas data structures.
• Recoded _check_for_variability for improved performance. _check_for_variability reminds the user that some variables in expressions are all the same right now since they are not implemented (such as mode choice logsums).
• non_mandatory_tour_frequency runtime reduced from 6 hours 43 mins to 1 hour 49 mins due to revised interaction_simulate
• Full model run completed successfully in 9 hours and 25 minutes on modelling server with chunk size of 100K. (2,732,722 households, 7,053,334 persons); this was single threaded
• Eventually we'll need to explore how best to thread and/or distribute these models
• Next steps:
  • remove NA alternatives before calculating probabilities
  • Update documentation for revised approach to CDAP model