Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • openfoam openfoam
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 423
    • Issues 423
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 9
    • Merge requests 9
  • Deployments
    • Deployments
    • Releases
  • Wiki
    • Wiki
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Development
  • openfoamopenfoam
  • Issues
  • #1118
Closed
Open
Issue created Dec 11, 2018 by Admin@OpenFOAM-adminMaintainer

redistributePar error when reducing the number of processors

Hi,

I'm facing the next issue with redistributePar. It fails for me when trying to redistribute from a higher number of processors to a smaller one.

Steps to reproduce it

For example, modifying the $FOAM_TUTORIALS/mesh/parallel/cavity tutorial to run the first steps with 5 processors and redistributing to 2 rather than vice versa.

cavity5To2.zip

Error log

/*---------------------------------------------------------------------------*\
| =========                 |                                                 |
| \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox           |
|  \\    /   O peration     | Version:  v1806                                 |
|   \\  /    A nd           | Web:      www.OpenFOAM.com                      |
|    \\/     M anipulation  |                                                 |
\*---------------------------------------------------------------------------*/
Build  : v1806
Arch   : "LSB;label=32;scalar=64"
Exec   : redistributePar -parallel -decomposeParDict system/decomposeParDict-2 -cellDist
Date   : Dec 11 2018
Time   : 19:12:26
Host   : "e06709f01e3c"
PID    : 797
I/O    : uncollated
Case   : /home/ofuser/workingDir/OpenFOAM/ofuser-v1806/run/cavity
nProcs : 2
Hosts  :
(
    (e06709f01e3c 2)
)
Pstream initialized with:
    floatTransfer      : 0
    nProcsSimpleSum    : 0
    commsType          : nonBlocking
    polling iterations : 0
trapFpe: Floating point exception trapping enabled (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
--> FOAM Warning : 
    From function int main(int, char**)
    in file redistributePar.C at line 2300
    Detected floating point exception trapping (FOAM_SIGFPE). This might give
    problems when mapping fields. Switch it off in case of problems.
Creating time directories on all processors

Create time

Create undecomposed database

Using mesh subdirectory "polyMesh"

Setting time to that of master or undecomposed case : 0.5
Checking for mesh in "/home/ofuser/workingDir/OpenFOAM/ofuser-v1806/run/cavity/processor0/constant/polyMesh/faces"

Per processor mesh availability:
    2{1}

[1] #0  Foam::error::printStack(Foam::Ostream&)[e06709f01e3c:00797] *** Process received signal ***
[e06709f01e3c:00797] Signal: Aborted (6)
[e06709f01e3c:00797] Signal code:  (-6)
[e06709f01e3c:00797] [ 0] /lib64/libc.so.6(+0x35270)[0x7f4a16ea1270]
[e06709f01e3c:00797] [ 1] /lib64/libc.so.6(gsignal+0x37)[0x7f4a16ea11f7]
[e06709f01e3c:00797] [ 2] /lib64/libc.so.6(abort+0x148)[0x7f4a16ea28e8]
[e06709f01e3c:00797] [ 3] /lib64/libc.so.6(+0x74f47)[0x7f4a16ee0f47]
[e06709f01e3c:00797] [ 4] /lib64/libc.so.6(+0x7ab54)[0x7f4a16ee6b54]
[e06709f01e3c:00797] [ 5] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam4ListIcE7setSizeEi+0x1f5)[0x7f4a1805c155]
[e06709f01e3c:00797] [ 6] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam9UOPstream5writeEi+0xb0)[0x7f4a18069810]
[e06709f01e3c:00797] [ 7] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4FoamlsERNS_7OstreamEi+0xa)[0x7f4a17fd1a1a]
[e06709f01e3c:00797] [ 8] redistributePar(_ZNK4Foam5UListIiE9writeListERNS_7OstreamEi+0xc8)[0x44ca78]
[e06709f01e3c:00797] [ 9] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam18processorPolyPatch14initUpdateMeshERNS_14PstreamBuffersE+0x292)[0x7f4a18202e22]
[e06709f01e3c:00797] [10] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam16polyBoundaryMesh10updateMeshEv+0x275)[0x7f4a1820b635]
[e06709f01e3c:00797] [11] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam8polyMeshC1ERKNS_8IOobjectE+0xbf6)[0x7f4a1825b346]
[e06709f01e3c:00797] [12] /opt/OpenFOAM/OpenFOAM-v1806/platforms/linux64GccDPInt32Opt/lib/libfiniteVolume.so(_ZN4Foam6fvMeshC2ERKNS_8IOobjectE+0x19)[0x7f4a1b4da8b9]
[e06709f01e3c:00797] [13] redistributePar[0x465014]
[e06709f01e3c:00797] [14] redistributePar[0x44838f]
[e06709f01e3c:00797] [15] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f4a16e8dc05]
[e06709f01e3c:00797] [16] redistributePar[0x44b410]
[e06709f01e3c:00797] *** End of error message ***
 at ??:?
[1] #1  Foam::sigSegv::sigHandler(int)--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 797 on node e06709f01e3c exited on signal 6 (Aborted).
--------------------------------------------------------------------------
Assignee
Assign to
Time tracking