[firedrake] parallel weirdness

[Hiroe Yamazaki]

Hi Lawrence,

I updated the files with the exact settings I see the problem, so
could you run test_linear.py again with the current HEAD of the branch
"periodic_parallel" (267de84)? With this setting I got results that
looked different at t = 600*dt in serial and parallel. I've attached
the picture for your reference (left: serial, right: parallel(2
cores), serial run gives a symmetric result but parallel run results
in slightly asymmetric).

All the best,
Hiroe

2014-11-19 11:10 GMT+00:00 Mitchell, Lawrence
<lawrence.mitchell at imperial.ac.uk>:
>
> On 18 Nov 2014, at 21:35, Hiroe Yamazaki <h.yamazaki at imperial.ac.uk> wrote:
>
>> Hi Lawrence,
>>
>> you can reproduce the problem by runing test_linear.py at
>> bitbucket.org/colinjcotter/slicemodels/branch/periodic_parallel. With
>> 1 and 2 cores, it gives different results.
>>
>> The code Colin is describing with line numbers is an old-version of
>> slicemodels.py, which is found here:
>>
>> https://gist.github.com/anonymous/c308131558ff54fec9c4
>>
>> In this version I added this term
>>
>> - (-dt*div(w)*pbar)*dx
>>
>> in line 270, which was previously added to the RHS in line 139.
>> With this change, the parallelization problem seemed to be fixed and I
>> got the same results with 1 and 2 cores, but but it makes no sense to
>> us.
>
> I cannot reproduce this problem with the current HEAD of that branch (6ce1ffb02).  The output vtus look the same in the eyeball norm, and once I fix the printing of the deltap (Colin, in parallel you can't look at the sum of the local entries.  Do function.dat.norm to get the l2 norm or norm(function) for the L2 norm).  In particular, if I specify jacobi PCs for /all/ solvers I get basically identical values in serial and parallel (up to solver tolerance)
>
> So I don't really know where to look.  Can you give a precise sequence of steps for me to follow to reproduce the problem and observe it?
>
> Lawrence
-------------- next part --------------
A non-text attachment was scrubbed...
Name: output.png
Type: image/png
Size: 19703 bytes
Desc: not available
URL: <http://mailman.ic.ac.uk/pipermail/firedrake/attachments/20141119/6d71bd80/attachment.png>