Complete Datapoint Failure After Updating to PAT 3.5.1 on Windows 11 #252

GFlechas · 2023-02-24T16:37:42Z

Summary:
I keep getting a Complete Datapoint Failure when trying to run PAT simulations using the local server on Windows 11 (see the below screenshot). Simulations were running fine on PAT 3.3.0. The seed model from the below-linked project was created with OpenStudio Application 1.5.0 and does simulate fine in the application. I've tried some older PAT projects as well and still get the datapoint failure.

Troubleshooting Steps I've Taken:
I've tried doing a full uninstall, reboot, install, and then another reboot before running PAT just to make sure I didn't have anything hanging around.

I moved my project folders to the base of the C-Drive to make sure I wasn't having a file path issue.

It's not clear if it's a bug related to windows 11 or PAT. I also can't rule out if it's something weird I've done in setting things up.

I've uploaded my project folder to OneDrive here if that will help to isolate the issue.

GFlechas · 2023-08-03T15:56:17Z

Hi there, I apologize for not getting back to you sooner. I have not yet tried the new version of PAT to know if the issue is fixed. That said, I downgraded my PAT version to 3.3.0 where I wasn't having the problem. I run OpenStudio server in Docker on another computer and use that as my "cloud" computer with the recent version of OS server installed. I'm sure there's cases where incompatibility may arise, but I have not yet encountered them. So in essence I generate the cases in the old version of PAT but then they get simulated in the newer version of OpenStudio in a cloud instance which seems to work well enough for the time being.

…

On Mon, Apr 3, 2023 at 8:20 PM Ib1ken0b1 ***@***.***> wrote: Have you had any developments with this bug? I've also experienced it and can't figure out a solution. — Reply to this email directly, view it on GitHub <#252 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJRHX4ZZI3BNTJWUY3UAXEDW7OAPVANCNFSM6AAAAAAVHDFV3M> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- Gabriel

MColeman2021 · 2023-10-26T20:30:21Z

Just wanted to check in to see if this issue has been resolved. I have tried using the newer version of PAT (3.6.1) and this is still the case. Is there any way to address this?

brianlball · 2023-10-26T20:35:50Z

3.6.1-1 ?

brianlball · 2023-10-26T20:40:17Z

also, in the console log, PAT outputs the commands its using to run the analysis. 'run analysis command'
copy that command and run it in a terminal or powershell and add the '--verbose --debug' after run_analysis.
that will get you more info.

GFlechas · 2023-10-27T19:16:00Z

Hi @brianlball, I'm still seeing this as well. I just ran a PAT project from the command prompt using PAT 3.6.1-1 and got the following output:

C:\Users\gabri>"C:\ParametricAnalysisTool-3.6.1\pat\ruby\bin\ruby.exe" "C:\ParametricAnalysisTool-3.6.1\pat\OpenStudio-server\bin\openstudio_meta" run_analysis   --ruby-lib-path="C:\ParametricAnalysisTool-3.6.1\pat\OpenStudio\Ruby" "C:\PAT Projects\PatTesting/PatTesting.json" "http://localhost:8080" --verbose --debug
D, [2023-10-27T13:08:31.325665 #8912] DEBUG -- : Set Logger log level to DEBUG
D, [2023-10-27T13:08:31.326414 #8912] DEBUG -- : Environment is: {"ALLUSERSPROFILE"=>"C:\\ProgramData", "APPDATA"=>"C:\\Users\\gabri\\AppData\\Roaming", "ChocolateyInstall"=>"C:\\ProgramData\\chocolatey", "ChocolateyLastPathUpdate"=>"133387502157095701", "CommonProgramFiles"=>"C:\\Program Files\\Common Files", "CommonProgramFiles(x86)"=>"C:\\Program Files (x86)\\Common Files", "CommonProgramW6432"=>"C:\\Program Files\\Common Files", "COMPUTERNAME"=>"GABRIEL_TAB_P8", "ComSpec"=>"C:\\WINDOWS\\system32\\cmd.exe", "DriverData"=>"C:\\Windows\\System32\\Drivers\\DriverData", "EFC_21044"=>"1", "GEM_HOME"=>"C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems", "GEM_PATH"=>"C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems;C:/ParametricAnalysisTool-3.6.1/pat/OpenStudio-server/gems/bundler/gems", "HOME"=>"C:/Users/gabri", "HOMEDRIVE"=>"C:", "HOMEPATH"=>"\\Users\\gabri", "LOCALAPPDATA"=>"C:\\Users\\gabri\\AppData\\Local", "MSMPI_BENCHMARKS"=>"C:\\Program Files\\Microsoft MPI\\Benchmarks\\", "MSMPI_BIN"=>"C:\\Program Files\\Microsoft MPI\\Bin\\", "NUMBER_OF_PROCESSORS"=>"8",  "OPENMODELICAHOME"=>"C:\\Program Files\\OpenModelica1.20.0-64bit\\", "OS"=>"Windows_NT", "Path"=>"C:\\Program Files\\Microsoft MPI\\Bin\\;C:\\Program Files\\Python310\\Scripts\\;C:\\Program Files\\Python310\\;C:\\Program Files\\Python39\\Scripts\\;C:\\Program Files\\Python39\\;C:\\WINDOWS\\system32;C:\\WINDOWS;C:\\WINDOWS\\System32\\Wbem;C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\;C:\\WINDOWS\\System32\\OpenSSH\\;C:\\Program Files\\PuTTY\\;C:\\Program Files\\Microsoft VS Code\\bin;C:\\Program Files\\Git\\cmd;C:\\Program Files\\dotnet\\;C:\\Program Files\\Calibre2\\;C:\\Program Files\\MATLAB\\R2022b\\bin;C:\\ProgramData\\chocolatey\\bin;C:\\Ruby27-x64\\bin;C:\\Users\\gabri\\AppData\\Local\\Microsoft\\WindowsApps;C:\\Users\\gabri\\AppData\\Local\\GitHubDesktop\\bin;C:\\Program Files (x86)\\Nmap;C:\\Users\\gabri\\AppData\\Roaming\\Amazon", "PATHEXT"=>".COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.PY;.PYW;.RB;.RBW", "PROCESSOR_ARCHITECTURE"=>"AMD64", "PROCESSOR_IDENTIFIER"=>"Intel64 Family 6 Model 140 Stepping 1, GenuineIntel", "PROCESSOR_LEVEL"=>"6", "PROCESSOR_REVISION"=>"8c01", "ProgramData"=>"C:\\ProgramData", "ProgramFiles"=>"C:\\Program Files", "ProgramFiles(x86)"=>"C:\\Program Files (x86)", "ProgramW6432"=>"C:\\Program Files", "PROMPT"=>"$P$G", "PSModulePath"=>"C:\\Program Files\\WindowsPowerShell\\Modules;C:\\WINDOWS\\system32\\WindowsPowerShell\\v1.0\\Modules", "PUBLIC"=>"C:\\Users\\Public", "RUBYOPT"=>"-Eutf-8", "SESSIONNAME"=>"Console", "SystemDrive"=>"C:", "SystemRoot"=>"C:\\WINDOWS", "TEMP"=>"C:\\Users\\gabri\\AppData\\Local\\Temp", "TMP"=>"C:\\Users\\gabri\\AppData\\Local\\Temp", "windir"=>"C:\\WINDOWS", "ZES_ENABLE_SYSMAN"=>"1", "__PSLockDownPolicy"=>"0"}
D, [2023-10-27T13:08:31.326749 #8912] DEBUG -- : Input ARGV is ["run_analysis", "--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.326932 #8912] DEBUG -- : Executing requires
D, [2023-10-27T13:08:31.327242 #8912] DEBUG -- : Requiring tmpdir
D, [2023-10-27T13:08:31.363034 #8912] DEBUG -- : Requiring optsparse
D, [2023-10-27T13:08:31.371141 #8912] DEBUG -- : Requiring timeout
D, [2023-10-27T13:08:31.377737 #8912] DEBUG -- : Requiring json
D, [2023-10-27T13:08:31.378027 #8912] DEBUG -- : Required initial gems successfully
I, [2023-10-27T13:08:31.378195 #8912]  INFO -- : Executing argv: ["run_analysis", "--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]I, [2023-10-27T13:08:31.378361 #8912]  INFO -- : CLI Parsed Inputs: [] "run_analysis" ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.378527 #8912] DEBUG -- : Main arguments are []
D, [2023-10-27T13:08:31.378714 #8912] DEBUG -- : Sub-command is run_analysis
D, [2023-10-27T13:08:31.378898 #8912] DEBUG -- : Sub-arguments are ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.379252 #8912] DEBUG -- : Invoking command class: RunAnalysis ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"]
D, [2023-10-27T13:08:31.379513 #8912] DEBUG -- : sub_argv = ["--ruby-lib-path=C:\\ParametricAnalysisTool-3.6.1\\pat\\OpenStudio\\Ruby", "C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080", "--debug"] in RunAnalysis execute
D, [2023-10-27T13:08:31.379714 #8912] DEBUG -- : Requiring gems for RunAnalysis
D, [2023-10-27T13:08:31.379859 #8912] DEBUG -- : Requiring zip gem
D, [2023-10-27T13:08:31.669623 #8912] DEBUG -- : Requiring os-analysis gem
Top level ::CompositeIO is deprecated, require 'multipart/post' and use `Multipart::Post::CompositeReadIO` instead!
Top level ::Parts is deprecated, require 'multipart/post' and use `Multipart::Post::Parts` instead!
OpenStudio did not load, but most functionality is still available. Will continue...
D, [2023-10-27T13:08:37.932242 #8912] DEBUG -- : Requiring os-aws gem
D, [2023-10-27T13:08:41.210044 #8912] DEBUG -- : Successfully required all gems for RunAnalysis
D, [2023-10-27T13:08:41.245777 #8912] DEBUG -- : RunAnalysis command: ["C:\\PAT Projects\\PatTesting/PatTesting.json", "http://localhost:8080"] {:debug=>true, :dencity=>false, :zip_file=>nil, :analysis_type=>"batch_datapoints"}
new project created with ID: 03b1b7cb-adff-48bf-ba28-092edc518dbe
asked to create analysis with 8223aa63-6351-470b-90a4-d7a4c00bec13
options[:push_to_dencity] = false
new analysis created with ID: 8223aa63-6351-470b-90a4-d7a4c00bec13
Successfully uploaded ZIP file
Run analysis is configured with {"analysis_action":"start","without_delay":false,"analysis_type":"batch_datapoints","simulate_data_point_filename":"simulate_data_point.rb","run_data_point_filename":"run_openstudio_workflow_monthly.rb"}
Received request to run analysis 8223aa63-6351-470b-90a4-d7a4c00bec13
Run analysis is configured with {"analysis_action":"start","without_delay":false,"analysis_type":"batch_run","simulate_data_point_filename":"simulate_data_point.rb","run_data_point_filename":"run_openstudio_workflow_monthly.rb"}
Received request to run analysis 8223aa63-6351-470b-90a4-d7a4c00bec13

brianlball · 2023-10-27T19:49:23Z

that looks like the data point was submitted correctly. the next step would be to look the /temp_data directory in your PAT project folder. this has the analysis and datapoint directories for the simulations that are trying to run. Look in the datapoint directory for any energyplus .err files or other log info

GFlechas · 2023-10-27T20:31:16Z

It looks like the run folders are all basically empty. There is a single run.log file in each, however they're all empty files.

brianlball · 2023-10-27T21:22:45Z

zip up your pat project folder and i'll try and reproduce

GFlechas · 2023-10-27T22:05:36Z

Sure thing @brianlball, see attachment here: PatTesting_2.zip

brianlball · 2023-10-29T14:46:50Z

I think I found the culprit. The weather file was not set in the design alternatives, resulting in a NULL value for the weather file. Once I selected a weather file it ran.

I found this by looking at the simulate data point log which can be found in a few locations:

or in the server localhost:8080 webpage

GFlechas · 2023-10-30T15:15:46Z

I've added the weather file to each of the design alternatives, however, each point still fails. It doesn't have any information for sdp_log_file either:

I've rezipped the project with the updated design alternatives here:PatTesting_2_update.zip

brianlball · 2023-10-30T16:13:52Z

I just ran your project in PAT 3.6.1-1 with the project at c:\PatTesting_2_update and it ran successfully.

GFlechas · 2023-10-30T16:29:02Z

Are you running it on Windows 11?

…

On Mon, Oct 30, 2023 at 10:14 AM Brian Ball ***@***.***> wrote: I just ran your project in PAT 3.6.1-1 with the project at c:\PatTesting_2_update and it ran successfully. [image: image] <https://user-images.githubusercontent.com/2235296/279124653-110007b2-4a31-4d92-9979-0eefe38c94f1.png> — Reply to this email directly, view it on GitHub <#252 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJRHX4YK5FC7JSW5NBS6463YB7G4ZAVCNFSM6AAAAAAVHDFV3OVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTOOBVGU2TSMZUGQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- Gabriel

brianlball · 2023-10-30T16:30:14Z

windows 10

GFlechas · 2023-10-31T19:49:43Z

I am also able to run the project on a Windows 10 computer. However, if I try to run the project on my Windows 11 Laptop with PAT 3.6.1-1 I get the datapoint failure. That's what's lead me to think the issue is Win 11 specific.

brianlball · 2023-10-31T19:59:09Z

gotcha, will the OSMs that are generated on the windows 10 computer, and/or the OSW workflow with measures run on the Windows 11 machine with the openstudio CLI?

GFlechas · 2023-11-02T15:29:11Z

Yes. I called one of the workflows generated by PAT located in the temp_data folder from the openstudio CLI (version 3.6.0). It fully simulated and ran its reporting measures.

brianlball · 2023-11-02T15:35:20Z

did you use the openstudio that ships with PAT? For example, at C:\ParametricAnalysisTool-3.6.1\pat\openstudio\bin\openstudio.exe
it would be great to know if the openstudio that PAT is using works

GFlechas · 2023-11-02T16:08:05Z

I just tried and yes, it will also simulate using the version of openstudio shipping with PAT.

brianlball · 2023-11-08T13:50:48Z

we are working on getting a windows 11 VM so we can replicate the issue

MColeman2021 · 2024-01-31T16:07:09Z

I've also run into this issue and am running on Windows 11. Has there been any progress with this? I've also been using version 3.6.1 and the newly released 3.7.0, and the same error happens in both.

brianlball · 2024-01-31T16:11:07Z

We are still waiting on our IT to release an approved windows 11 VM for us so we can include windows 11 in our testing.
3.7.0 is getting re-released soon with a fix for the wrong E+ version #272
@wenyikuang

brianlball · 2024-02-08T17:31:21Z

@MColeman2021 PAT 3.7.0 was re-released with the correct version of E+ https://github.com/NREL/OpenStudio-PAT/releases/tag/v3.7.0
Please let us know if you are still having problems after that.

Safari-2024 · 2024-05-13T21:19:27Z

Hi, has this issue been resolved? I am getting the same datapoint failure issue- I am using v3.7.0 for PAT and I have Windows 11 Version 23H2 (x64).

wenyikuang · 2024-05-13T21:27:51Z

I may need to try to re-produce it in other platform and see how it works... Probably not issue in E+?

brianlball · 2024-05-13T21:41:07Z

NREL/OpenStudio-server#737
The datapoint logs were blank, but I fixed it server side, so the openstudio datapoint log will get populated. This will make it easier to debug. Probably have to retry in 3.8.0
It also would be helpful to have an updated minimal reproducible example

mekiolivier · 2024-07-10T16:14:05Z

Please I am facing same challenges, i have the latest version of PAT 3.7.0 using windows 10, but simulation still fail. I want to downgrade it to 3.6.1 but i couldn't find. kindly ; Your help will be appreciated.

brianlball · 2024-07-10T16:20:07Z

The 3.6.1-1 release can be found here
We are working on the 3.8.0 release which will have improved logging to help with debugging failed datapoints.

mekiolivier · 2024-07-10T16:33:17Z

Thank You very much. let me give it a try. i really appreciate

mekiolivier · 2024-07-10T17:00:11Z

Hello Sir,
Please , I downloaded but still getting failure as shown in the image. Thanks again for your assistance.

brianlball · 2024-07-11T12:43:19Z

what about the logs in the PAT project folder?

mekiolivier · 2024-07-12T13:36:03Z

Hello Sir,
thanks for the feeedback. in the PAT project folder log ; it shows those files , which i copied top messages to paste here :
delayed Job : [17:49:48.671505 INFO] 2024-07-10T17:49:48+0100: [Worker(delayed_job.server host:DESKTOP-H8ODB4J pid:3320)] Error while reserving job: IOError: closed stream (for 127.0.0.1:27017 (no TLS)) (on 127.0.0.1:27017, connection 1:1
dj_server : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead!
dj_worker : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead!
mongo : {"t":{"$date":"2024-07-10T17:49:14.738+01:00"},"s":"I", "c":"CONTROL", "id":23285, "ctx":"main","msg":"Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'"}
{"t":{"$date":"2024-07-10T17:49:14.750+01:00"},"s":"W", "c":"ASIO", "id":22601, "ctx":"main","msg":"No TransportLayer configured during NetworkInterface startup"}
{"t":{"$date":"2024-07-10T17:49:14.752+01:00"},"s":"I", "c":"NETWORK", "id":4648602, "ctx":"main","msg":"Implicit TCP FastOpen in use."}
rail : Top level ::CompositeIO is deprecated, require 'multipart/post' and use Multipart::Post::CompositeReadIO instead!

Kindly , look at it and please if you can advise to solve the issue. Once again thank you i appreciate.

brianlball · 2024-07-12T13:41:37Z

That past is not helpful. Is there anything in the localresults or other log files that looks like something we can debug? something that says error
how about posting your project so we can try and replicate? We need a minimally reproducible example in order to really debug

mekiolivier · 2024-07-12T14:14:57Z

Thank you Sir.
here is the project. In the log no error is shown.
Project.zip

brianlball · 2024-07-12T14:51:16Z

Thats an openstudio model. I want the PAT project.
Does that openstudio model run correctly?

mekiolivier · 2024-07-12T14:56:48Z

Yes Sir, It ran successfully.
PAT.zip

brianlball · 2024-07-13T15:04:52Z

there are no measures or design alternatives to run in that pat project, so I cant replicate what you are seeing

mekiolivier · 2024-07-15T18:52:25Z

Hello Sir ,
Sorry for delay. I was without my laptop. Thanks for your feeddback. There are 2 measures and two alternatives as well. let me reattach and sent to you to check. I really appreciate your effort for helping me sorting out this issue.
file simulated.zip
PAT file.zip

Complete Datapoint Failure After Updating to PAT 3.5.1 on Windows 11 #252

Complete Datapoint Failure After Updating to PAT 3.5.1 on Windows 11 #252

Comments

GFlechas commented Feb 24, 2023

GFlechas commented Aug 3, 2023 via email

MColeman2021 commented Oct 26, 2023

brianlball commented Oct 26, 2023

brianlball commented Oct 26, 2023

GFlechas commented Oct 27, 2023

brianlball commented Oct 27, 2023

GFlechas commented Oct 27, 2023

brianlball commented Oct 27, 2023

GFlechas commented Oct 27, 2023

brianlball commented Oct 29, 2023

GFlechas commented Oct 30, 2023

brianlball commented Oct 30, 2023

GFlechas commented Oct 30, 2023 via email

brianlball commented Oct 30, 2023

GFlechas commented Oct 31, 2023

brianlball commented Oct 31, 2023

GFlechas commented Nov 2, 2023

brianlball commented Nov 2, 2023

GFlechas commented Nov 2, 2023

brianlball commented Nov 8, 2023

MColeman2021 commented Jan 31, 2024

brianlball commented Jan 31, 2024

brianlball commented Feb 8, 2024

Safari-2024 commented May 13, 2024

wenyikuang commented May 13, 2024

brianlball commented May 13, 2024

mekiolivier commented Jul 10, 2024

brianlball commented Jul 10, 2024

mekiolivier commented Jul 10, 2024

mekiolivier commented Jul 10, 2024

brianlball commented Jul 11, 2024

mekiolivier commented Jul 12, 2024

brianlball commented Jul 12, 2024

mekiolivier commented Jul 12, 2024

brianlball commented Jul 12, 2024

mekiolivier commented Jul 12, 2024

brianlball commented Jul 13, 2024

mekiolivier commented Jul 15, 2024