OpenFast Regression tests

Discuss field testing of turbines and structural testing of components.

Moderator: Bonnie.Jonkman

Romain.Pinguet
Posts: 7
Joined: Tue Aug 16, 2016 9:37 am
Organization: Mines Paristech
Location: France

OpenFast Regression tests

Postby Romain.Pinguet » Tue Feb 27, 2018 6:03 am

Dear all,
I just installed OpenFast on My MacOS. I tried to execute the regression tests as described in the manual. Most of the tests passed however all the tests using HydroDyn fail. I have very high values of the infinity norms for some channels when it is compared to the baseline results.
Do you have any idea why ?

Thank you for your help,

Romain

Jason.Jonkman
Posts: 4347
Joined: Thu Nov 03, 2005 4:38 pm
Location: Boulder, CO
Contact:

Re: OpenFast Regression tests

Postby Jason.Jonkman » Tue Feb 27, 2018 6:37 am

Dear Romain,

Could this be related to the following open issues in OpenFAST?:
Best regards,
Jason Jonkman, Ph.D.
Senior Engineer | National Wind Technology Center (NWTC)

National Renewable Energy Laboratory (NREL)
15013 Denver West Parkway | Golden, CO 80401
+1 (303) 384 – 7026 | Fax: +1 (303) 384 – 6901
nwtc.nrel.gov

Romain.Pinguet
Posts: 7
Joined: Tue Aug 16, 2016 9:37 am
Organization: Mines Paristech
Location: France

Re: OpenFast Regression tests

Postby Romain.Pinguet » Thu Mar 01, 2018 12:00 pm

Dear Jason,

It is probably the problem. I did not see your posts on GitHub. Thank you for that.
However, When I write RanLux as keyword for the WaveSeed, I have got an error : Invalid numerical input for file.
Do I have to modify the code somewhere else ?

Thank you very much,

Romain

Jason.Jonkman
Posts: 4347
Joined: Thu Nov 03, 2005 4:38 pm
Location: Boulder, CO
Contact:

Re: OpenFast Regression tests

Postby Jason.Jonkman » Thu Mar 01, 2018 12:04 pm

Dear Romain,

The OpenFAST issue #89 (https://github.com/OpenFAST/openfast/issues/89) is an enhancement that I've proposed be implemented in HydroDyn to resolve the problem you and others have reported. However, this enhancement has not yet been implemented in source code. It is proposed future work.

Best regards,
Jason Jonkman, Ph.D.
Senior Engineer | National Wind Technology Center (NWTC)

National Renewable Energy Laboratory (NREL)
15013 Denver West Parkway | Golden, CO 80401
+1 (303) 384 – 7026 | Fax: +1 (303) 384 – 6901
nwtc.nrel.gov

Romain.Pinguet
Posts: 7
Joined: Tue Aug 16, 2016 9:37 am
Organization: Mines Paristech
Location: France

Re: OpenFast Regression tests

Postby Romain.Pinguet » Thu Mar 01, 2018 12:53 pm

Dear Jason,

All right, I understand. Thank you for the help.
Regards,

Romain

Juan.Cueto
Posts: 4
Joined: Thu Nov 23, 2017 9:47 am
Organization: EDPr
Location: Spain

Re: OpenFast Regression tests

Postby Juan.Cueto » Sat Jul 07, 2018 2:07 pm

Dear all,

I'm trying to run some of the Regression Tests with OpenFAST on Cygwin64, e.g. for the 5MW_OC4Jckt_DLL_WTurb_WavesIrr_MGrowth test, but i keep getting the same error: Segmentation fault (`core' generado), without changing any input file. Could someone help me please?

I'll leave a screenshot so you can see in more detail.

Thank you very much.

Juan
Attachments
OpenFAST.jpg
OpenFAST.jpg (187.4 KiB) Viewed 9827 times

Jason.Jonkman
Posts: 4347
Joined: Thu Nov 03, 2005 4:38 pm
Location: Boulder, CO
Contact:

Re: OpenFast Regression tests

Postby Jason.Jonkman » Sat Jul 07, 2018 11:45 pm

Dear Juan,

I'm not familiar enough with Cygwin to know the answer to your question. I suggest posting your question on OpenFAST github issues (https://github.com/OpenFAST/openfast/issues) to ensure that it is read by others on the OpenFAST team who may not check this forum regularly.

Best regards,
Jason Jonkman, Ph.D.
Senior Engineer | National Wind Technology Center (NWTC)

National Renewable Energy Laboratory (NREL)
15013 Denver West Parkway | Golden, CO 80401
+1 (303) 384 – 7026 | Fax: +1 (303) 384 – 6901
nwtc.nrel.gov

Juan.Cueto
Posts: 4
Joined: Thu Nov 23, 2017 9:47 am
Organization: EDPr
Location: Spain

Re: OpenFast Regression tests

Postby Juan.Cueto » Sun Jul 08, 2018 3:26 am

Dear Jason,

Ok, thank you very much for the quick response. I'll post it there as you say.

Best Regards.

Juan.Cueto
Posts: 4
Joined: Thu Nov 23, 2017 9:47 am
Organization: EDPr
Location: Spain

Re: OpenFast Regression tests

Postby Juan.Cueto » Sun Jul 08, 2018 9:50 am

Dear Jason,

I'm trying to run the test by other means, different from using it on Cygwin64, but now the simulation doesn't end. It just stays in the "Timestep: 0 of 60 seconds." step of the simulation. Can you help me please?

Thank you.
Attachments
FAST.jpg
FAST.jpg (231.46 KiB) Viewed 9815 times

Jason.Jonkman
Posts: 4347
Joined: Thu Nov 03, 2005 4:38 pm
Location: Boulder, CO
Contact:

Re: OpenFast Regression tests

Postby Jason.Jonkman » Sun Jul 08, 2018 1:12 pm

Dear Juan,

I'm not familiar with OpenFAST simply "hanging" at time zero. Perhaps the controller is not loading properly and is causing the simulation to hang? Can you run the simulation without the controller by setting CompServo = 0 in the FAST primary input file and GenDOF = False in the ElastoDyn primary input file?

Best regards,
Jason Jonkman, Ph.D.
Senior Engineer | National Wind Technology Center (NWTC)

National Renewable Energy Laboratory (NREL)
15013 Denver West Parkway | Golden, CO 80401
+1 (303) 384 – 7026 | Fax: +1 (303) 384 – 6901
nwtc.nrel.gov

Juan.Cueto
Posts: 4
Joined: Thu Nov 23, 2017 9:47 am
Organization: EDPr
Location: Spain

Re: OpenFast Regression tests

Postby Juan.Cueto » Mon Jul 09, 2018 4:35 am

Dear Jason,

I've just done what you suggested, running the simulation without the controller, but now I encounter this problem (In attached). I guess I have to add those parameters that FAST can't allocate to the Hydrodyn input file, but where? I've been inspecting the Hydrodyn file but I still can't figure it out.

Best regards.
Attachments
FAST2.png
FAST2.png (73.5 KiB) Viewed 9802 times

Jason.Jonkman
Posts: 4347
Joined: Thu Nov 03, 2005 4:38 pm
Location: Boulder, CO
Contact:

Re: OpenFast Regression tests

Postby Jason.Jonkman » Mon Jul 09, 2018 11:31 pm

Dear Juan,

Your screenshot is reporting an error about "allocating space", which is a question that has recently been answered in the following forum topic: viewtopic.php?f=13&t=2097&p=11433.

Best regards,
Jason Jonkman, Ph.D.
Senior Engineer | National Wind Technology Center (NWTC)

National Renewable Energy Laboratory (NREL)
15013 Denver West Parkway | Golden, CO 80401
+1 (303) 384 – 7026 | Fax: +1 (303) 384 – 6901
nwtc.nrel.gov

Ruben.Gonzalez
Posts: 3
Joined: Wed Jul 10, 2019 8:10 am
Organization: Public University of Navarre
Location: Spain

Re: OpenFast Regression tests

Postby Ruben.Gonzalez » Thu Jul 18, 2019 11:04 am

Dear all,

I recently installed OpenFAST on Ubuntu 18.04. I followed the first example to build OpenFAST and the test suite present in: https://openfast.readthedocs.io/en/master/source/testing/regression_test.html#regression-test-example. The command ‘make install’ appeared to go correctly. However, after executing ‘ctest’, 18 of the 37 tests failed. I also made sure that the three DISCON controllers for the NREL 5MW turbine where present (in the documentation the folder assigned to contain them is ‘ServoDyn’, but I guess it is actually ‘ServoData’, since there isn’t any folder named ‘ServoDyn’ in '5MW_Baseline'). There is a file attached with the results of ctest and after checking the results with the information in the ‘CtestList.make’ file, the majority of the tests that failed used aerodyn15 (but not all). I have not been able to find a reason why so many tests failed. Does anyone know what could have happened or a way to find out?

Thank you for your help,

Rubén
Attachments
ctest_results.txt
(5.69 KiB) Downloaded 22 times

Rafael.Mudafort
Posts: 2
Joined: Fri Mar 30, 2018 3:51 pm
Organization: NREL NWTC
Location: Boulder, CO

Re: OpenFast Regression tests

Postby Rafael.Mudafort » Mon Jul 22, 2019 5:39 pm

Hi Ruben,

Thanks for pointing out the bug in the docs, I've opened an issue on GitHub here: https://github.com/OpenFAST/openfast/issues/309. If you notice any more bugs, please feel free to open an issue about it. On that note, this question fits well within the conversations that happen on the GitHub issues, so if you open a new one I'll copy this response there so that many more people can find it. Here's the link to create a new issue: https://github.com/OpenFAST/openfast/issues/new/choose.

The fact that 19 tests passed means that openfast was compiled fine, but there could be some differences in your system which caused the tests to fail. These tests could have failed for a variety of reasons as they are very sensitive to your environment. For example, using a different version of the compiler or math library than the one used to generate the baseline is a common cause. My suggestion is to plot the results and visually inspect the failing cases.

Since you've already run the cases, you can just generate the plots with this python script located in openfast/reg_tests:

Code: Select all

python3 manualRegressionTest.py ../build/glue-codes/openfast/openfast Linux GNU 1e-5 -n -p


The -n means don't run the case and -p means generate the plots. By the way, you need matplotlib installed for this to work. After it finishes successfully, you'll have a html file in openfast/build/reg_tests which you can open in any browser and navigate through the failed test cases.

We are working on making this plotting feature more robust and ready for general use. Once its "finished", I'll be sure to add documentation about it.


Return to “Testing”

Who is online

Users browsing this forum: No registered users and 1 guest