[firedrake] firedrake broken on ARCHER after update

[Eike Mueller]

Hi,

> At higher order, I don’t see to be able to run the matrix-free solver in the original configuration any more: it works on one core (with a reduced problem size), but not on a full node. I did check on my laptop that I can still run in parallel, but the results of a 1 core run and a 4 core run are not exactly identical at higher order, so something is not quite right there.

Hang on, thinking about this again, if I use BJACOBI+ILU as the preconditioner for the velocity mass inverse, isn’t the result naturally dependent on the number of processors, since by default a block corresponds to the dofs stored on one process? At lowest order I use the inverse of the diagonal lumped mass matrix, so there I don’t see this.

However, if I change BJACOBI+ILU -> JACOBI I still get a difference between the results on 1 and on 4 processors, so I must be missing something else.

Thanks,

Eike

> 
>> On 24 Apr 2015, at 22:48, Eike Mueller <E.Mueller at bath.ac.uk> wrote:
>> 
>> Thanks, I will try that. It's odd, since I reconfigured and did a
>> 
>> make clean; make
>> 
>> in the PETSc directory, and I checked that the generated library has an up-to-date modification date. Maybe I should clean out the entire PETSc directory and reclone it.
>> 
>> Eike
>> 
>> PS: i did indeed update petsc4py as well and only forgot in in the list, sorry about the confusion...
>> 
>> Sent from my iPad
>> 
>>> On 24 Apr 2015, at 18:50, Lawrence Mitchell <lawrence.mitchell at imperial.ac.uk> wrote:
>>> 
>>> 
>>>> On 24 Apr 2015, at 18:26, Eike Mueller <E.Mueller at bath.ac.uk> wrote:
>>>> 
>>>> Dear all,
>>>> 
>>>> I’m trying to update my firedrake on ARCHER. I updated all relevant packages (fiat, petsc, coffee, ufl, ffc, PyOP2 and firedrake) but when I try to run firedrake-clean I get the error below.
>>>> 
>>>> Any idea what this could be?
>>>> 
>>>> Thanks,
>>>> 
>>>> Eike
>>>> 
>>>> /opt/modules/default/init/bash: line 11: unalias: pip: not found
>>>> Traceback (most recent call last):
>>>> File "/var/opt/cray/alps/spool/13759147/firedrake-clean", line 3, in <module>
>>>>  from firedrake.ffc_interface import clear_cache, FFCKernel
>>>> File "/fs2/n02/n02/eike/git_workspace/firedrake/firedrake/__init__.py", line 2, in <module>
>>>>  import petsc
>>>> File "/fs2/n02/n02/eike/git_workspace/firedrake/firedrake/petsc.py", line 4, in <module>
>>>>  petsc4py.init(sys.argv)
>>>> File "/work/n02/n02/eike/git_workspace/petsc4py/cray-gnu-shared/lib/python2.7/site-packages/petsc4py/__init__.py", line 42, in init
>>>>  PETSc = petsc4py.lib.ImportPETSc(arch)
>>>> File "/work/n02/n02/eike/git_workspace/petsc4py/cray-gnu-shared/lib/python2.7/site-packages/petsc4py/lib/__init__.py", line 29, in ImportPETSc
>>>>  return Import('petsc4py', 'PETSc', path, arch)
>>>> File "/work/n02/n02/eike/git_workspace/petsc4py/cray-gnu-shared/lib/python2.7/site-packages/petsc4py/lib/__init__.py", line 64, in Import
>>>>  module = imp.load_module(fullname, fo, fn, stuff)
>>>> ImportError: /work/n02/n02/eike/git_workspace/petsc/cray-gnu-shared/lib/libpetsc.so.3.05: undefined symbol: PetscDLLibraryRegister_petscts
>>> 
>>> That looks somehow like the petsc install didn't work, said symbol ought to exist in the petsc library.  Does a simple petsc program compile and run?  For example, in the petsc source tree:
>>> 
>>> cd src/snes/examples/tutorials
>>> make ex19
>>> aprun -n 1 -N 1 ./ex19
>>> 
>>> Lawrence
>>> 
>>> _______________________________________________
>>> firedrake mailing list
>>> firedrake at imperial.ac.uk
>>> https://mailman.ic.ac.uk/mailman/listinfo/firedrake
>> _______________________________________________
>> firedrake mailing list
>> firedrake at imperial.ac.uk
>> https://mailman.ic.ac.uk/mailman/listinfo/firedrake
> 
> _______________________________________________
> firedrake mailing list
> firedrake at imperial.ac.uk
> https://mailman.ic.ac.uk/mailman/listinfo/firedrake