Skip to content
This repository has been archived by the owner on Sep 27, 2023. It is now read-only.

Parallel validation can cause intermittent validation errors #1056

Closed
catzzz opened this issue Jan 5, 2022 · 1 comment · Fixed by #1077
Closed

Parallel validation can cause intermittent validation errors #1056

catzzz opened this issue Jan 5, 2022 · 1 comment · Fixed by #1077
Assignees
@dchassin
Labels
bug Request a fix or change to the code
Milestone
HiPAS Patch Release

Comments

@catzzz
Copy link
Contributor

catzzz commented Jan 5, 2022

Problem description

make install in ./install.sh causes python installation error in latter validation.

Steps to reproduce

./install.sh -v -t --parallel

In later validation, the errors appear.
ERROR [INIT] : /usr/local/src/gridlabd/gldcore/autotest/test_inline_python.glm error unexpected, code 5 (simulation failed) in 0.0 seconds
ERROR [INIT] : /usr/local/src/gridlabd/gldcore/autotest/test_python_property.glm error unexpected, code 5 (simulation failed) in 0.0 seconds

System information

  • GridLAB-D version: gridlabd --version=4.2.28-211105-master
  • Operating system: Any Linux
@catzzz catzzz added the bug Request a fix or change to the code label Jan 5, 2022
catzzz pushed a commit that referenced this issue Jan 5, 2022
@JimmyLeu76
fix make install causes pyhton validation error fix #1056
63f3d0a
@catzzz catzzz mentioned this issue Jan 6, 2022
Merged
12 tasks
dchassin pushed a commit that referenced this issue Jan 6, 2022
@catzzz
Update setup-Linux-centos-8.sh file (#1057)
e860c93 
* fix make install causes pyhton validation error fix #1056
* fix missing  when using --parallel option #1044
* update python3.9.6 and necessary packages
* update mono installation
* fix numpy and matrix version not the latest version issue. #1045
* repair test_matrix_random,#assert  == '1.22.0'
* remove test Dockerfile'
* modify  in test_matrix_*.glm
* add test Dockerfile
* test success, remove Dockerfile
* update test_matrix.glm #assert !  '<' '1.21.0'
* add python package
* add test Dockerfile
* test and validate success, remove Dockerfile
Co-authored-by: JimmyLeu76 <jimmyleu@slac.stanford.edu>
Co-authored-by: David P. Chassin <david.chassin@me.com>
dchassin added a commit that referenced this issue Jan 9, 2022
@catzzz @JimmyLeu76 @dchassin
Update setup-Linux-debian-10.sh (#1069)
64953eb 
* fix make install causes pyhton validation error fix #1056
* fix missing  when using --parallel option #1044
* update python3.9.6 and necessary packages
* update mono installation
* fix numpy and matrix version not the latest version issue. #1045
* repair test_matrix_random,#assert  == '1.22.0'
* remove test Dockerfile'
* temporary Dockerfile. one validation error : ERROR    [2000-01-01 00:00:00 EST] : on_exit 0 'test  == CURRENT' command failed (return code 2)
* fix test_violation_record.glm. sh: 1: test: CURRENT: unexpected operatordone)...; I should try on centos to check if this test valid
* update
* add test Dockerfile
* add temporary test Dockerfile for debian
* updat python3.9.6 installation
* update build toos for gridlabd
* try the final test
* update installation dependencies
* remove merge confic
* add test Dockerfile of debian 10
* final test and validation pass. remove Dockerfile
* Remove deltamode failure tests
* Remove more unneeded deltamode error tests

Co-authored-by: JimmyLeu76 <jimmyleu@slac.stanford.edu>
Co-authored-by: David P. Chassin <david.chassin@me.com>
@dchassin
Copy link
Member

dchassin commented Jan 9, 2022

The root cause is likely that a number of validation test use the same temporary files for intermediate results and output. This is a general problem in the autotests and needs to be address by changing how autotests that generate files name those files.

@dchassin dchassin changed the title make install in install.sh causes python validation error Parallel validation can cause intermitten validation errors Jan 9, 2022
@dchassin dchassin changed the title Parallel validation can cause intermitten validation errors Parallel validation can cause intermittent validation errors Jan 9, 2022
@dchassin dchassin added this to the HiPAS 4.2 Final Release milestone Jan 10, 2022
@dchassin dchassin mentioned this issue Jan 11, 2022
Merged
6 tasks
@dchassin dchassin linked a pull request Jan 12, 2022 that will close this issue
Fix parallel validation errors #1077
Merged
6 tasks
aivanova5 added a commit that referenced this issue Feb 16, 2022
@catzzz @JimmyLeu76 @aivanova5
Update setup-Linux-debian-11.sh (#1090)
14a87f4 
* fix make install causes pyhton validation error fix #1056

* fix missing  when using --parallel option #1044

* update python3.9.6 and necessary packages

* update mono installation

* fix numpy and matrix version not the latest version issue. #1045

* repair test_matrix_random,#assert  == '1.22.0'

* remove test Dockerfile'

* add setup-Linux-debian-11.sh

* copy debian10 content to debian11

* add  --enable-share  in debian 11

* temporary test file

* add --enable-shared , remove unnecessary dependencies for test

* set localtime from America/Los_Angeles

* passs installation and validation

* merge from previous change about

* add determine timezone condition

* modify bash if condifion

* remove temporary Dockerfile and restore install docemnts dependencies

* temperory file for windows wsl test

* pass installation and validation in docker and windows/wsl

* add install idalog -y

* fix shell arrow key broken

* add get timezone from web. if the httpcode is not 200, set default timezone as UTC/GMT

* add update pip

* remove Dockerfile, pass installation and validation in Docker debian:11 and Windows/WSL/Debian

* remove dupliacte install curl

* add config tzdata

* check /etc/timezone exist

Co-authored-by: JimmyLeu76 <jimmyleu@slac.stanford.edu>
Co-authored-by: Alyona Teyber <Ivanova.alyona5@gmail.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@dchassin dchassin

Labels
bug Request a fix or change to the code
Projects
None yet
Milestone
HiPAS Patch Release
Development

Successfully merging a pull request may close this issue.

Fix parallel validation errors arras-energy/gridlabd-old
2 participants
@catzzz @dchassin