Welcome, Guest
Username: Password: Remember me

TOPIC: error while running in parallel - merging temporary output files

error while running in parallel - merging temporary output files 11 years 2 weeks ago #10679

  • ingénieure
  • ingénieure's Avatar
Hello,

I am wondering if there's a way to merge/combine the temporary output files (ie. SISRES or T3DHYD) for each subdomain into one .slf file after a simulation encounters an error while running in parallel. I'm hoping to simplify the loading and viewing of these results in BlueKenue.

Thanks!
The administrator has disabled public write access.

error while running in parallel - merging temporary output files 10 years 11 months ago #11098

  • sebourban
  • sebourban's Avatar
  • OFFLINE
  • Administrator
  • Principal Scientist
  • Posts: 814
  • Thank you received: 218
Hello,

Sorry for the delay. You may have figured it out by now.
If not, you can use the python script runSERAFIN.py:

> runSERAFIN.py merge --parallel base-file.slf root-name out-file.slf

Hope this helps,
Sébastien.
The administrator has disabled public write access.
The following user(s) said Thank You: ingénieure

error while running in parallel - merging temporary output files 10 years 7 months ago #12393

  • jamesmac
  • jamesmac's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 13
Hi
I find that sometimes when running Telemac3d the temporary output files are not recollected, even the the simulation runs to completion.
I'ver tried using the runSelafin.py script to merge the files, but am not clear on the syntax. Could you please explain with an example?
Thanks
The administrator has disabled public write access.

error while running in parallel - merging temporary output files 10 years 7 months ago #12397

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 233
Hi, this happens to me when I have the results file open in BK when the simulation finishes. So the file is locked and telemac cannot recollect and write to it. Check whether this is the case...

Regards,
Costas
The administrator has disabled public write access.

error while running in parallel - merging temporary output files 10 years 7 months ago #12403

  • jamesmac
  • jamesmac's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 13
Thanks for you reply.
In my case the failure to merge the output files is not caused by them being already open in Blue Kenue (I have found this out the hard way and am always careful to close BK before the simulation ends).
On my system (Windows box with a 4-core Intel I7 cpu and 16Gb ram) short runs (ie smallish output files) recollect OK but longer runs fail to recollect. For example one that always fails to merge produces 4 T3DRES files each about 2.4Gb in size.
I could live with this if I could merge them manually using the runSelafin script, but I cannot get the arguments correct. In Sebastian's example quoted below :

> runSERAFIN.py merge --parallel base-file.slf root-name out-file.slf

what I need to know is :
  • what is base-file.slf?
  • what does root-name refer to?

  • Thanks
The administrator has disabled public write access.

error while running in parallel - merging temporary output files 10 years 7 months ago #12406

  • cyamin
  • cyamin's Avatar
  • OFFLINE
  • openTELEMAC Guru
  • Posts: 997
  • Thank you received: 233
Hello,

I have a similar configuration to you and I have automatically recollected a file larger than 10Gb over the network. It took some time but in the meantime I could see the file size grow in explorer and be patient.

I am also interested in the recollection script syntax, I guess I will be needing it if I manage to run Telemac with the MS HPC Pack's job scheduler.

Regards,
Costas
The administrator has disabled public write access.
Moderators: Serrer, a.barton

The open TELEMAC-MASCARET template for Joomla!2.5, the HTML 4 version.