Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Building Examples Fail: Linking against trilinos error #13697

Open
ParticleTruthSeeker opened this issue Dec 27, 2024 · 17 comments
Open

Building Examples Fail: Linking against trilinos error #13697

ParticleTruthSeeker opened this issue Dec 27, 2024 · 17 comments

Comments

@ParticleTruthSeeker
Copy link

Hi,

The Trilinos examples fail to build. Initially complaining about missing gfortran and openmp flags.

I am also trying to link Elmer against Trilinos 16 but I am getting the following error:

/usr/bin/ld: libelmersolver.so: undefined reference to `ML_Epetra::MultiLevelPreconditioner::TestSmoothers(Teuchos::ParameterList&, bool)'

I have built ML with epetra and teuchos.

Any help would be very much appreciated.

Cheers

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 27, 2024

Would you mind posting how you ran cmake and also the corresponding output?

@ParticleTruthSeeker
Copy link
Author

I built Trilinos with cmake-gui. Here is the corresponding output.

Configuring Trilinos build directory

-- PROJECT_SOURCE_DIR='/home//Trilinos/Trilinos'
-- PROJECT_BINARY_DIR='/home//Trilinos/Build'
-- Trilinos_TRIBITS_DIR='/home//Trilinos/Trilinos/cmake/tribits'
-- TriBITS_VERSION_STRING='0.9 (Dev)'
-- CMAKE_VERSION='3.28.3'
-- CMAKE_GENERATOR='Unix Makefiles'
-- CMAKE_HOST_SYSTEM_NAME='Linux'
-- Trilinos_HOSTNAME='TerranCommandCenter'
CMake Warning (dev) at cmake/tribits/core/package_arch/TribitsFindPythonInterp.cmake:64 (find_package):
  Policy CMP0148 is not set: The FindPythonInterp and FindPythonLibs modules
  are removed.  Run "cmake --help-policy CMP0148" for policy details.  Use
  the cmake_policy command to set the policy and suppress this warning.

Call Stack (most recent call first):
  cmake/tribits/core/package_arch/TribitsFindPythonInterp.cmake:80 (tribits_find_python)
  cmake/tribits/core/package_arch/TribitsProjectImpl.cmake:109 (tribits_find_python_interp)
  cmake/tribits/core/package_arch/TribitsProject.cmake:92 (tribits_project_impl)
  CMakeLists.txt:48 (TRIBITS_PROJECT)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- PYTHON_EXECUTABLE='/usr/bin/python3'

Setting up major user options ...

The Current CXX Standard is : 17
-- Setting Trilinos_ENABLE_TriKota=OFF because '/home//Trilinos/Trilinos/packages/TriKota/Dakota' does not exist!
-- Trilinos_GENERATE_REPO_VERSION_FILE='ON'

Trilinos repos versions:
--------------------------------------------------------------------------------
*** Base Git Repo: Trilinos
c6f6bea7150 [Mon Jul 22 15:31:42 2024 -0400] <[email protected]>
Merge pull request #13245 from jmlapre/update_version_cmake_16
 --------------------------------------------------------------------------------


Reading list of native TPLs from /home//Trilinos/Trilinos/TPLsList.cmake

-- After reading above TPLsList.cmake file: Trilinos_NUM_DEFINED_TPLS='124'

Reading list of native packages from /home//Trilinos/Trilinos/PackagesList.cmake

-- After reading above PackagesList.cmake file: Trilinos_NUM_DEFINED_INTERNAL_TOPLEVEL_PACKAGES='60'

Processing Project, Repository, and Package dependency files and building internal dependencies graph ...

-- Trilinos_NUM_DEFINED_INTERNAL_PACKAGES='153'
-- Tentatively enabling TPL 'DLlib'

Package dependencies information:

-- Trilinos_NUM_DEFINED_TPLS='124'

-- Trilinos_NUM_DEFINED_INTERNAL_TOPLEVEL_PACKAGES='60'

-- Trilinos_NUM_DEFINED_TOPLEVEL_PACKAGES='184'

-- Trilinos_NUM_DEFINED_INTERNAL_PACKAGES='153'

-- Trilinos_NUM_DEFINED_PACKAGES='277'

Explicitly enabled top-level packages on input (by user):  Teuchos Epetra Zoltan EpetraExt Ifpack ML Belos 7

Explicitly enabled packages on input (by user):  TeuchosParameterList TeuchosComm Teuchos Epetra Zoltan EpetraExt Ifpack ML Belos 9

Explicitly disabled top-level packages on input (by user or by default):  Amesos PyTrilinos2 NewPackage 3

Explicitly disabled packages on input (by user or by default):  Amesos ShyLU_NodeBasker SEACASExotec2 STKMiddle_mesh STKSearchUtil STKTransferUtil STKMiddle_mesh_util PanzerExprEval PyTrilinos2 NewPackage 10

Explicitly enabled external packages/TPLs on input (by user):  MPI BLAS LAPACK Scotch METIS ParMETIS HYPRE SCALAPACK MUMPS DLlib 10

Explicitly disabled external packages/TPLs on input (by user or by default):  0

Disabling all packages that have a required dependency on disabled TPLs and optional package TPL support based on TPL_ENABLE_<TPL>=OFF ...


Disabling subpackages for hard disables of parent packages due to Trilinos_ENABLE_<PARENT_PACKAGE>=OFF ...


Disabling forward required packages and optional intra-package support that have a dependency on disabled packages Trilinos_ENABLE_<TRIBITS_PACKAGE>=OFF (or TPL_ENABLE_<TRIBITS_EXTERNAL_PACKAGE>=OFF) ...

-- Setting Ifpack_ENABLE_Amesos=OFF because Ifpack has an optional library dependence on disabled package Amesos
-- NOTE: Setting ML_ENABLE_Amesos=OFF which was ON because ML has an optional library dependence on disabled package Amesos
-- NOTE: ML_ENABLE_Amesos=ON but Trilinos_ENABLE_Amesos=OFF is set.  Setting ML_ENABLE_Amesos=OFF!
-- Setting Trilinos_ENABLE_ShyLU_DDCore=OFF because ShyLU_DDCore has a required library dependence on disabled package Amesos
-- Setting Trilinos_ENABLE_ShyLU_DD=OFF because ShyLU_DD has a required library dependence on disabled package ShyLU_DDCore
-- Setting Trilinos_ENABLE_ShyLU=OFF because ShyLU has a required library dependence on disabled package ShyLU_DD

Enabling subpackages for hard enables of parent packages due to Trilinos_ENABLE_<PARENT_PACKAGE>=ON ...

-- Setting subpackage enable Trilinos_ENABLE_TeuchosCore=ON because parent package Trilinos_ENABLE_Teuchos=ON
-- Setting subpackage enable Trilinos_ENABLE_TeuchosParser=ON because parent package Trilinos_ENABLE_Teuchos=ON
-- Setting subpackage enable Trilinos_ENABLE_TeuchosNumerics=ON because parent package Trilinos_ENABLE_Teuchos=ON
-- Setting subpackage enable Trilinos_ENABLE_TeuchosRemainder=ON because parent package Trilinos_ENABLE_Teuchos=ON
-- Setting subpackage enable Trilinos_ENABLE_TeuchosKokkosCompat=ON because parent package Trilinos_ENABLE_Teuchos=ON
-- Setting subpackage enable Trilinos_ENABLE_TeuchosKokkosComm=ON because parent package Trilinos_ENABLE_Teuchos=ON

Disabling subpackage tests/examples based on parent package tests/examples disables ...


Enabling all tests and/or examples that have not been explicitly disabled because Trilinos_ENABLE_[TESTS,EXAMPLES]=ON ...

-- Setting TeuchosCore_ENABLE_EXAMPLES=ON
-- Setting TeuchosParser_ENABLE_EXAMPLES=ON
-- Setting TeuchosComm_ENABLE_EXAMPLES=ON
-- Setting TeuchosNumerics_ENABLE_EXAMPLES=ON
-- Setting TeuchosRemainder_ENABLE_EXAMPLES=ON
-- Setting TeuchosKokkosCompat_ENABLE_EXAMPLES=ON
-- Setting TeuchosKokkosComm_ENABLE_EXAMPLES=ON
-- Setting Teuchos_ENABLE_EXAMPLES=ON
-- Setting Zoltan_ENABLE_EXAMPLES=ON
-- Setting EpetraExt_ENABLE_EXAMPLES=ON
-- Setting Ifpack_ENABLE_EXAMPLES=ON
-- Setting Belos_ENABLE_EXAMPLES=ON

Enabling subpackage tests/examples based on parent package tests/examples enables ...


Enabling all required (and optional since Trilinos_ENABLE_ALL_OPTIONAL_PACKAGES=ON) upstream packages for current set of enabled packages (Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF) ...

-- Setting Trilinos_ENABLE_Tpetra=ON because Belos has an optional dependence on Tpetra
-- Setting Trilinos_ENABLE_Xpetra=ON because Belos has an optional dependence on Xpetra
-- Setting Trilinos_ENABLE_Thyra=ON because Belos has an optional dependence on Thyra
-- NOTE: Not Setting Trilinos_ENABLE_AztecOO=ON even though Belos has an optional dependence on AztecOO because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_Triutils=ON even though Belos has an optional dependence on Triutils because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- Setting Trilinos_ENABLE_KokkosKernels=ON because Belos has an optional dependence on KokkosKernels
-- Setting Trilinos_ENABLE_Galeri=ON because Belos has an optional dependence on Galeri
-- NOTE: Not Setting Trilinos_ENABLE_Triutils=ON even though Belos has an optional dependence on Triutils because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_AztecOO=ON even though Belos has an optional dependence on AztecOO because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_AztecOO=ON even though ML has an optional dependence on AztecOO because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_Isorropia=ON even though ML has an optional dependence on Isorropia because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_AztecOO=ON even though Ifpack has an optional dependence on AztecOO because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_Triutils=ON even though Galeri has an optional dependence on Triutils because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- Setting Trilinos_ENABLE_Kokkos=ON because Xpetra has a required dependence on Kokkos
-- Setting Trilinos_ENABLE_ThyraCore=ON because Thyra has a required dependence on ThyraCore
-- NOTE: Not Setting Trilinos_ENABLE_ThyraEpetraAdapters=ON even though Thyra has an optional dependence on ThyraEpetraAdapters because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- NOTE: Not Setting Trilinos_ENABLE_ThyraEpetraExtAdapters=ON even though Thyra has an optional dependence on ThyraEpetraExtAdapters because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- Setting Trilinos_ENABLE_ThyraTpetraAdapters=ON because Thyra has an optional dependence on ThyraTpetraAdapters
-- NOTE: Not Setting Trilinos_ENABLE_ThyraEpetraAdapters=ON even though ThyraTpetraAdapters has an optional dependence on ThyraEpetraAdapters because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF
-- Setting Trilinos_ENABLE_RTOp=ON because ThyraCore has a required dependence on RTOp
-- Setting Trilinos_ENABLE_TpetraCore=ON because Tpetra has a required dependence on TpetraCore
-- Setting Trilinos_ENABLE_TpetraTSQR=ON because Tpetra has an optional dependence on TpetraTSQR
-- NOTE: Not Setting Trilinos_ENABLE_Triutils=ON even though EpetraExt has an optional dependence on Triutils because Trilinos_ENABLE_SECONDARY_TESTED_CODE=OFF

Enabling all optional intra-package enables <TRIBITS_PACKAGE>_ENABLE_<DEPPACKAGE> that are not currently disabled if both sets of packages are enabled ...

-- NOT setting Kokkos_ENABLE_Pthread=ON since Pthread is NOT enabled at this point!
-- NOT setting Kokkos_ENABLE_CUDA=ON since CUDA is NOT enabled at this point!
-- NOT setting Kokkos_ENABLE_HWLOC=ON since HWLOC is NOT enabled at this point!
-- Setting Kokkos_ENABLE_DLlib=ON since Trilinos_ENABLE_Kokkos=ON AND TPL_ENABLE_DLlib=ON
-- NOT setting Kokkos_ENABLE_CUSPARSE=ON since CUSPARSE is NOT enabled at this point!
-- Setting TeuchosCore_ENABLE_Kokkos=ON since Trilinos_ENABLE_TeuchosCore=ON AND Trilinos_ENABLE_Kokkos=ON
-- NOT setting TeuchosCore_ENABLE_BinUtils=ON since BinUtils is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_Boost=ON since Boost is NOT enabled at this point!
-- Setting TeuchosCore_ENABLE_MPI=ON since Trilinos_ENABLE_TeuchosCore=ON AND TPL_ENABLE_MPI=ON
-- NOT setting TeuchosCore_ENABLE_ARPREC=ON since ARPREC is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_QD=ON since QD is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_QT=ON since QT is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_quadmath=ON since quadmath is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_Pthread=ON since Pthread is NOT enabled at this point!
-- NOT setting TeuchosCore_ENABLE_Valgrind=ON since Valgrind is NOT enabled at this point!
-- Setting TeuchosParser_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_TeuchosParser=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- NOTE: TeuchosParameterList_ENABLE_TeuchosCore=ON is already set!
-- NOTE: TeuchosParameterList_ENABLE_TeuchosParser=ON is already set!
-- NOT setting TeuchosParameterList_ENABLE_yamlcpp=ON since yamlcpp is NOT enabled at this point!
-- Setting TeuchosComm_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_TeuchosComm=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- NOTE: TeuchosComm_ENABLE_TeuchosParameterList=ON is already set!
-- Setting TeuchosNumerics_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_TeuchosNumerics=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- Setting TeuchosNumerics_ENABLE_TeuchosComm=ON since Trilinos_ENABLE_TeuchosNumerics=ON AND Trilinos_ENABLE_TeuchosComm=ON
-- Setting TeuchosNumerics_ENABLE_BLAS=ON since Trilinos_ENABLE_TeuchosNumerics=ON AND TPL_ENABLE_BLAS=ON
-- Setting TeuchosNumerics_ENABLE_LAPACK=ON since Trilinos_ENABLE_TeuchosNumerics=ON AND TPL_ENABLE_LAPACK=ON
-- NOT setting TeuchosNumerics_ENABLE_Eigen=ON since Eigen is NOT enabled at this point!
-- Setting TeuchosRemainder_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_TeuchosRemainder=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- Setting TeuchosKokkosCompat_ENABLE_Kokkos=ON since Trilinos_ENABLE_TeuchosKokkosCompat=ON AND Trilinos_ENABLE_Kokkos=ON
-- Setting TeuchosKokkosCompat_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_TeuchosKokkosCompat=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- NOTE: TeuchosKokkosCompat_ENABLE_TeuchosParameterList=ON is already set!
-- NOT setting TeuchosKokkosCompat_ENABLE_Pthread=ON since Pthread is NOT enabled at this point!
-- Setting TeuchosKokkosComm_ENABLE_Kokkos=ON since Trilinos_ENABLE_TeuchosKokkosComm=ON AND Trilinos_ENABLE_Kokkos=ON
-- Setting TeuchosKokkosComm_ENABLE_TeuchosKokkosCompat=ON since Trilinos_ENABLE_TeuchosKokkosComm=ON AND Trilinos_ENABLE_TeuchosKokkosCompat=ON
-- Setting TeuchosKokkosComm_ENABLE_TeuchosComm=ON since Trilinos_ENABLE_TeuchosKokkosComm=ON AND Trilinos_ENABLE_TeuchosComm=ON
-- Setting TeuchosKokkosComm_ENABLE_MPI=ON since Trilinos_ENABLE_TeuchosKokkosComm=ON AND TPL_ENABLE_MPI=ON
-- Setting Teuchos_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- Setting Teuchos_ENABLE_TeuchosParser=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosParser=ON
-- NOTE: Teuchos_ENABLE_TeuchosParameterList=ON is already set!
-- Setting Teuchos_ENABLE_TeuchosComm=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosComm=ON
-- Setting Teuchos_ENABLE_TeuchosNumerics=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosNumerics=ON
-- Setting Teuchos_ENABLE_TeuchosRemainder=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosRemainder=ON
-- Setting Teuchos_ENABLE_TeuchosKokkosCompat=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosKokkosCompat=ON
-- Setting Teuchos_ENABLE_TeuchosKokkosComm=ON since Trilinos_ENABLE_Teuchos=ON AND Trilinos_ENABLE_TeuchosKokkosComm=ON
-- Setting KokkosKernels_ENABLE_Kokkos=ON since Trilinos_ENABLE_KokkosKernels=ON AND Trilinos_ENABLE_Kokkos=ON
-- NOT setting KokkosKernels_ENABLE_quadmath=ON since quadmath is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_MKL=ON since MKL is NOT enabled at this point!
-- Setting KokkosKernels_ENABLE_BLAS=ON since Trilinos_ENABLE_KokkosKernels=ON AND TPL_ENABLE_BLAS=ON
-- Setting KokkosKernels_ENABLE_LAPACK=ON since Trilinos_ENABLE_KokkosKernels=ON AND TPL_ENABLE_LAPACK=ON
-- NOTE: KokkosKernels_ENABLE_METIS=ON is already set!
-- NOT setting KokkosKernels_ENABLE_SuperLU=ON since SuperLU is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_Cholmod=ON since Cholmod is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_CUBLAS=ON since CUBLAS is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_CUSPARSE=ON since CUSPARSE is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_CUSOLVER=ON since CUSOLVER is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_ROCBLAS=ON since ROCBLAS is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_ROCSPARSE=ON since ROCSPARSE is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_ROCSOLVER=ON since ROCSOLVER is NOT enabled at this point!
-- NOT setting KokkosKernels_ENABLE_yamlcpp=ON since yamlcpp is NOT enabled at this point!
-- Setting RTOp_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_RTOp=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- Setting RTOp_ENABLE_TeuchosComm=ON since Trilinos_ENABLE_RTOp=ON AND Trilinos_ENABLE_TeuchosComm=ON
-- Setting RTOp_ENABLE_TeuchosNumerics=ON since Trilinos_ENABLE_RTOp=ON AND Trilinos_ENABLE_TeuchosNumerics=ON
-- NOTE: Epetra_ENABLE_BLAS=ON is already set!
-- NOTE: Epetra_ENABLE_LAPACK=ON is already set!
-- NOTE: Epetra_ENABLE_Teuchos=ON is already set!
-- NOT setting Epetra_ENABLE_CASK=ON since CASK is NOT enabled at this point!
-- NOTE: Epetra_ENABLE_MPI=ON is already set!
-- NOT setting Epetra_ENABLE_Oski=ON since Oski is NOT enabled at this point!
-- Setting Zoltan_ENABLE_MPI=ON since Trilinos_ENABLE_Zoltan=ON AND TPL_ENABLE_MPI=ON
-- NOTE: Zoltan_ENABLE_METIS=ON is already set!
-- NOTE: Zoltan_ENABLE_ParMETIS=ON is already set!
-- NOT setting Zoltan_ENABLE_PaToH=ON since PaToH is NOT enabled at this point!
-- NOTE: Zoltan_ENABLE_Scotch=ON is already set!
-- NOT setting Zoltan_ENABLE_Zlib=ON since Zlib is NOT enabled at this point!
-- NOT setting Zoltan_ENABLE_OVIS=ON since OVIS is NOT enabled at this point!
-- NOTE: EpetraExt_ENABLE_Teuchos=ON is already set!
-- Setting EpetraExt_ENABLE_Epetra=ON since Trilinos_ENABLE_EpetraExt=ON AND Trilinos_ENABLE_Epetra=ON
-- NOT setting EpetraExt_ENABLE_Triutils=ON since Triutils is NOT enabled at this point!
-- NOT setting EpetraExt_ENABLE_HDF5=ON since HDF5 is NOT enabled at this point!
-- NOT setting EpetraExt_ENABLE_UMFPACK=ON since UMFPACK is NOT enabled at this point!
-- NOT setting EpetraExt_ENABLE_AMD=ON since AMD is NOT enabled at this point!
-- NOT setting EpetraExt_ENABLE_PETSC=ON since PETSC is NOT enabled at this point!
-- Setting EpetraExt_ENABLE_HYPRE=ON since Trilinos_ENABLE_EpetraExt=ON AND TPL_ENABLE_HYPRE=ON
-- NOTE: EpetraExt_ENABLE_HYPRE=ON is already set!
-- Setting TpetraTSQR_ENABLE_Teuchos=ON since Trilinos_ENABLE_TpetraTSQR=ON AND Trilinos_ENABLE_Teuchos=ON
-- Setting TpetraTSQR_ENABLE_Kokkos=ON since Trilinos_ENABLE_TpetraTSQR=ON AND Trilinos_ENABLE_Kokkos=ON
-- Setting TpetraTSQR_ENABLE_KokkosKernels=ON since Trilinos_ENABLE_TpetraTSQR=ON AND Trilinos_ENABLE_KokkosKernels=ON
-- NOT setting TpetraTSQR_ENABLE_CUBLAS=ON since CUBLAS is NOT enabled at this point!
-- NOT setting TpetraTSQR_ENABLE_CUSOLVER=ON since CUSOLVER is NOT enabled at this point!
-- Setting TpetraCore_ENABLE_Teuchos=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_Teuchos=ON
-- Setting TpetraCore_ENABLE_Kokkos=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_Kokkos=ON
-- Setting TpetraCore_ENABLE_TeuchosKokkosCompat=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_TeuchosKokkosCompat=ON
-- Setting TpetraCore_ENABLE_TeuchosKokkosComm=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_TeuchosKokkosComm=ON
-- Setting TpetraCore_ENABLE_KokkosKernels=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_KokkosKernels=ON
-- Setting TpetraCore_ENABLE_Epetra=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_Epetra=ON
-- Setting TpetraCore_ENABLE_TpetraTSQR=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_TpetraTSQR=ON
-- Setting TpetraCore_ENABLE_TeuchosNumerics=ON since Trilinos_ENABLE_TpetraCore=ON AND Trilinos_ENABLE_TeuchosNumerics=ON
-- Setting TpetraCore_ENABLE_MPI=ON since Trilinos_ENABLE_TpetraCore=ON AND TPL_ENABLE_MPI=ON
-- NOT setting TpetraCore_ENABLE_CUDA=ON since CUDA is NOT enabled at this point!
-- NOT setting TpetraCore_ENABLE_QD=ON since QD is NOT enabled at this point!
-- NOT setting TpetraCore_ENABLE_quadmath=ON since quadmath is NOT enabled at this point!
-- NOT setting TpetraCore_ENABLE_mpi_advance=ON since mpi_advance is NOT enabled at this point!
-- Setting Tpetra_ENABLE_TpetraCore=ON since Trilinos_ENABLE_Tpetra=ON AND Trilinos_ENABLE_TpetraCore=ON
-- Setting Tpetra_ENABLE_TpetraTSQR=ON since Trilinos_ENABLE_Tpetra=ON AND Trilinos_ENABLE_TpetraTSQR=ON
-- Setting ThyraCore_ENABLE_TeuchosCore=ON since Trilinos_ENABLE_ThyraCore=ON AND Trilinos_ENABLE_TeuchosCore=ON
-- Setting ThyraCore_ENABLE_TeuchosParameterList=ON since Trilinos_ENABLE_ThyraCore=ON AND Trilinos_ENABLE_TeuchosParameterList=ON
-- Setting ThyraCore_ENABLE_TeuchosComm=ON since Trilinos_ENABLE_ThyraCore=ON AND Trilinos_ENABLE_TeuchosComm=ON
-- Setting ThyraCore_ENABLE_TeuchosNumerics=ON since Trilinos_ENABLE_ThyraCore=ON AND Trilinos_ENABLE_TeuchosNumerics=ON
-- Setting ThyraCore_ENABLE_RTOp=ON since Trilinos_ENABLE_ThyraCore=ON AND Trilinos_ENABLE_RTOp=ON
-- Setting ThyraTpetraAdapters_ENABLE_ThyraCore=ON since Trilinos_ENABLE_ThyraTpetraAdapters=ON AND Trilinos_ENABLE_ThyraCore=ON
-- Setting ThyraTpetraAdapters_ENABLE_Tpetra=ON since Trilinos_ENABLE_ThyraTpetraAdapters=ON AND Trilinos_ENABLE_Tpetra=ON
-- NOT setting ThyraTpetraAdapters_ENABLE_ThyraEpetraAdapters=ON since ThyraEpetraAdapters is NOT enabled at this point!
-- Setting Thyra_ENABLE_ThyraCore=ON since Trilinos_ENABLE_Thyra=ON AND Trilinos_ENABLE_ThyraCore=ON
-- NOT setting Thyra_ENABLE_ThyraEpetraAdapters=ON since ThyraEpetraAdapters is NOT enabled at this point!
-- NOT setting Thyra_ENABLE_ThyraEpetraExtAdapters=ON since ThyraEpetraExtAdapters is NOT enabled at this point!
-- Setting Thyra_ENABLE_ThyraTpetraAdapters=ON since Trilinos_ENABLE_Thyra=ON AND Trilinos_ENABLE_ThyraTpetraAdapters=ON
-- Setting Xpetra_ENABLE_Teuchos=ON since Trilinos_ENABLE_Xpetra=ON AND Trilinos_ENABLE_Teuchos=ON
-- Setting Xpetra_ENABLE_Kokkos=ON since Trilinos_ENABLE_Xpetra=ON AND Trilinos_ENABLE_Kokkos=ON
-- Setting Xpetra_ENABLE_BLAS=ON since Trilinos_ENABLE_Xpetra=ON AND TPL_ENABLE_BLAS=ON
-- Setting Xpetra_ENABLE_LAPACK=ON since Trilinos_ENABLE_Xpetra=ON AND TPL_ENABLE_LAPACK=ON
-- NOTE: Xpetra_ENABLE_Epetra=OFF is already set so not enabling even though Trilinos_ENABLE_Epetra=ON is set!
-- NOTE: Xpetra_ENABLE_EpetraExt=OFF is already set so not enabling even though Trilinos_ENABLE_EpetraExt=ON is set!
-- Setting Xpetra_ENABLE_Tpetra=ON since Trilinos_ENABLE_Xpetra=ON AND Trilinos_ENABLE_Tpetra=ON
-- Setting Xpetra_ENABLE_KokkosKernels=ON since Trilinos_ENABLE_Xpetra=ON AND Trilinos_ENABLE_KokkosKernels=ON
-- Setting Xpetra_ENABLE_Thyra=ON since Trilinos_ENABLE_Xpetra=ON AND Trilinos_ENABLE_Thyra=ON
-- NOTE: Xpetra_ENABLE_Epetra=OFF is already set so not enabling even though Trilinos_ENABLE_Epetra=ON is set!
-- NOTE: Xpetra_ENABLE_EpetraExt=OFF is already set so not enabling even though Trilinos_ENABLE_EpetraExt=ON is set!
-- NOTE: Xpetra_ENABLE_Tpetra=ON is already set!
-- NOTE: Xpetra_ENABLE_KokkosKernels=ON is already set!
-- NOTE: Xpetra_ENABLE_Thyra=ON is already set!
-- Setting Galeri_ENABLE_Teuchos=ON since Trilinos_ENABLE_Galeri=ON AND Trilinos_ENABLE_Teuchos=ON
-- Setting Galeri_ENABLE_Epetra=ON since Trilinos_ENABLE_Galeri=ON AND Trilinos_ENABLE_Epetra=ON
-- Setting Galeri_ENABLE_EpetraExt=ON since Trilinos_ENABLE_Galeri=ON AND Trilinos_ENABLE_EpetraExt=ON
-- Setting Galeri_ENABLE_Xpetra=ON since Trilinos_ENABLE_Galeri=ON AND Trilinos_ENABLE_Xpetra=ON
-- Setting Galeri_ENABLE_Tpetra=ON since Trilinos_ENABLE_Galeri=ON AND Trilinos_ENABLE_Tpetra=ON
-- NOT setting Galeri_ENABLE_Triutils=ON since Triutils is NOT enabled at this point!
-- NOTE: Ifpack_ENABLE_Teuchos=ON is already set!
-- Setting Ifpack_ENABLE_Epetra=ON since Trilinos_ENABLE_Ifpack=ON AND Trilinos_ENABLE_Epetra=ON
-- Setting Ifpack_ENABLE_EpetraExt=ON since Trilinos_ENABLE_Ifpack=ON AND Trilinos_ENABLE_EpetraExt=ON
-- NOT setting Ifpack_ENABLE_AztecOO=ON since AztecOO is NOT enabled at this point!
-- Setting Ifpack_ENABLE_HYPRE=ON since Trilinos_ENABLE_Ifpack=ON AND TPL_ENABLE_HYPRE=ON
-- NOT setting Ifpack_ENABLE_HIPS=ON since HIPS is NOT enabled at this point!
-- NOT setting Ifpack_ENABLE_SuperLU=ON since SuperLU is NOT enabled at this point!
-- NOT setting Ifpack_ENABLE_SPARSKIT=ON since SPARSKIT is NOT enabled at this point!
-- NOT setting Ifpack_ENABLE_Boost=ON since Boost is NOT enabled at this point!
-- Setting Ifpack_ENABLE_Galeri=ON since Trilinos_ENABLE_Ifpack=ON AND Trilinos_ENABLE_Galeri=ON
-- NOTE: Ifpack_ENABLE_HYPRE=ON is already set!
-- NOT setting Ifpack_ENABLE_SuperLU=ON since SuperLU is NOT enabled at this point!
-- NOT setting Ifpack_ENABLE_SPARSKIT=ON since SPARSKIT is NOT enabled at this point!
-- Setting ML_ENABLE_BLAS=ON since Trilinos_ENABLE_ML=ON AND TPL_ENABLE_BLAS=ON
-- Setting ML_ENABLE_LAPACK=ON since Trilinos_ENABLE_ML=ON AND TPL_ENABLE_LAPACK=ON
-- NOTE: ML_ENABLE_Teuchos=ON is already set!
-- NOTE: ML_ENABLE_Epetra=ON is already set!
-- Setting ML_ENABLE_Zoltan=ON since Trilinos_ENABLE_ML=ON AND Trilinos_ENABLE_Zoltan=ON
-- Setting ML_ENABLE_Galeri=ON since Trilinos_ENABLE_ML=ON AND Trilinos_ENABLE_Galeri=ON
-- NOTE: ML_ENABLE_Ifpack=ON is already set!
-- NOT setting ML_ENABLE_AztecOO=ON since AztecOO is NOT enabled at this point!
-- NOTE: ML_ENABLE_EpetraExt=ON is already set!
-- NOT setting ML_ENABLE_Isorropia=ON since Isorropia is NOT enabled at this point!
-- NOTE: ML_ENABLE_MPI=ON is already set!
-- NOTE: ML_ENABLE_METIS=ON is already set!
-- NOTE: ML_ENABLE_ParMETIS=ON is already set!
-- NOT setting ML_ENABLE_PETSC=ON since PETSC is NOT enabled at this point!
-- NOT setting ML_ENABLE_SuperLU=ON since SuperLU is NOT enabled at this point!
-- NOT setting ML_ENABLE_MATLAB=ON since MATLAB is NOT enabled at this point!
-- NOTE: ML_ENABLE_METIS=ON is already set!
-- NOTE: ML_ENABLE_ParMETIS=ON is already set!
-- NOT setting ML_ENABLE_SuperLU=ON since SuperLU is NOT enabled at this point!
-- Setting Belos_ENABLE_Teuchos=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Teuchos=ON
-- Setting Belos_ENABLE_Epetra=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Epetra=ON
-- Setting Belos_ENABLE_Tpetra=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Tpetra=ON
-- Setting Belos_ENABLE_Xpetra=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Xpetra=ON
-- Setting Belos_ENABLE_Thyra=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Thyra=ON
-- NOT setting Belos_ENABLE_AztecOO=ON since AztecOO is NOT enabled at this point!
-- NOT setting Belos_ENABLE_Triutils=ON since Triutils is NOT enabled at this point!
-- Setting Belos_ENABLE_KokkosKernels=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_KokkosKernels=ON
-- Setting Belos_ENABLE_Galeri=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Galeri=ON
-- NOT setting Belos_ENABLE_Triutils=ON since Triutils is NOT enabled at this point!
-- Setting Belos_ENABLE_EpetraExt=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_EpetraExt=ON
-- Setting Belos_ENABLE_Ifpack=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_Ifpack=ON
-- Setting Belos_ENABLE_ML=ON since Trilinos_ENABLE_Belos=ON AND Trilinos_ENABLE_ML=ON
-- NOT setting Belos_ENABLE_AztecOO=ON since AztecOO is NOT enabled at this point!

Set cache entries for optional packages/TPLs and tests/examples for packages actually enabled ...


Enabling the shell of non-enabled parent packages (mostly for show) that have at least one subpackage enabled ...


Adjust the set of internal and external packages:


Final set of enabled top-level packages:  Kokkos Teuchos KokkosKernels RTOp Epetra Zoltan EpetraExt Tpetra Thyra Xpetra Galeri Ifpack ML Belos 14

Final set of enabled packages:  Kokkos TeuchosCore TeuchosParser TeuchosParameterList TeuchosComm TeuchosNumerics TeuchosRemainder TeuchosKokkosCompat TeuchosKokkosComm Teuchos KokkosKernels RTOp Epetra Zoltan EpetraExt TpetraTSQR TpetraCore Tpetra ThyraCore ThyraTpetraAdapters Thyra Xpetra Galeri Ifpack ML Belos 26

Final set of non-enabled top-level packages:  TrilinosFrameworkTests TrilinosATDMConfigTests Gtest Sacado MiniTensor Shards Triutils TrilinosSS Isorropia Pliris AztecOO Amesos Pamgen Zoltan2Core ShyLU_Node Amesos2 SEACAS Anasazi Ifpack2 Stratimikos Teko Intrepid Intrepid2 Compadre STK Percept Krino Phalanx NOX MueLu Zoltan2Sphynx Zoltan2 ShyLU_DD ShyLU Tempus Stokhos ROL Piro Panzer PyTrilinos PyTrilinos2 NewPackage Adelus TrilinosCouplings TrilinosBuildStats TrilinosInstallTests 46

Final set of non-enabled packages:  TrilinosFrameworkTests TrilinosATDMConfigTests Gtest Sacado MiniTensor Shards Triutils TrilinosSS ThyraEpetraAdapters ThyraEpetraExtAdapters Isorropia Pliris AztecOO Amesos Pamgen Zoltan2Core ShyLU_NodeHTS ShyLU_NodeTacho ShyLU_NodeBasker ShyLU_NodeFastILU ShyLU_Node Amesos2 SEACASExodus SEACASExodus_for SEACASExoIIv2for32 SEACASNemesis SEACASIoss SEACASChaco SEACASAprepro_lib SEACASSupes SEACASSuplib SEACASSuplibC SEACASSuplibCpp SEACASSVDI SEACASPLT SEACASAlgebra SEACASAprepro SEACASBlot SEACASConjoin SEACASEjoin SEACASEpu SEACASCpup SEACASExo2mat SEACASExodiff SEACASExomatlab SEACASExotxt SEACASExo_format SEACASEx1ex2v2 SEACASExotec2 SEACASFastq SEACASGjoin SEACASGen3D SEACASGenshell SEACASGrepos SEACASExplore SEACASMapvarlib SEACASMapvar SEACASMapvar-kd SEACASMat2exo SEACASNas2exo SEACASZellij SEACASNemslice SEACASNemspread SEACASNumbers SEACASSlice SEACASTxtexo SEACASEx2ex1v2 SEACAS Anasazi Ifpack2 Stratimikos Teko Intrepid Intrepid2 Compadre STKUtil STKCoupling STKMath STKSimd STKNGP_TEST STKExprEval STKTopology STKSearch STKMiddle_mesh STKTransfer STKMesh STKSearchUtil STKTransferUtil STKIO STKMiddle_mesh_util STKTools STKBalance STKUnit_test_utils STKUnit_tests STKDoc_tests STKEmend STK Percept Krino Phalanx NOX MueLu Zoltan2Sphynx Zoltan2 ShyLU_DDFROSch ShyLU_DDCore ShyLU_DDCommon ShyLU_DD ShyLU Tempus Stokhos ROL Piro PanzerCore PanzerDofMgr PanzerDiscFE PanzerAdaptersSTK PanzerMiniEM PanzerExprEval Panzer PyTrilinos PyTrilinos2 NewPackage Adelus TrilinosCouplings TrilinosBuildStats TrilinosInstallTests 127

Final set of enabled top-level external packages/TPLs:  MPI BLAS LAPACK Scotch METIS ParMETIS HYPRE SCALAPACK MUMPS DLlib 10

Final set of enabled external packages/TPLs:  MPI BLAS LAPACK Scotch METIS ParMETIS HYPRE SCALAPACK MUMPS DLlib 10

Final set of non-enabled top-level external packages/TPLs:  MKL yamlcpp Peano CUDA CUBLAS CUSOLVER CUSPARSE Thrust Cusp ROCBLAS ROCSPARSE ROCSOLVER TBB Pthread HWLOC QTHREAD BinUtils ARPREC QD Boost OVIS gpcd DataWarp MTMETIS PuLP TopoManager LibTopoMap PaToH CppUnit ADOLC ADIC TVMET MF ExodusII Nemesis XDMF Zlib HDF5 CGNS Pnetcdf Netcdf ADIOS2 Faodel Cereal Catalyst2 y12m SuperLUDist SuperLUMT SuperLU Cholmod UMFPACK MA28 AMD CSparse PETSC BLACS STRUMPACK CSS_MKL PARDISO_MKL PARDISO Oski TAUCS ForUQTK Dakota HIPS MATLAB CASK SPARSKIT QT gtest BoostLib BoostAlbLib OpenNURBS Portals CrayPortals Gemini InfiniBand BGPDCMF BGQPAMI Pablo HPCToolkit Clp GLPK qpOASES Matio PAPI MATLABLib Eigen X11 Lemon GLM quadmath CAMAL RTlib AmgX VTune TASMANIAN ArrayFireCPU SimMesh SimModel SimParasolid SimAcis SimField Valgrind QUO ViennaCL Avatar mlpack pebbl MAGMASparse Check SARMA CDT mpi_advance 114

Final set of non-enabled external packages/TPLs:  MKL yamlcpp Peano CUDA CUBLAS CUSOLVER CUSPARSE Thrust Cusp ROCBLAS ROCSPARSE ROCSOLVER TBB Pthread HWLOC QTHREAD BinUtils ARPREC QD Boost OVIS gpcd DataWarp MTMETIS PuLP TopoManager LibTopoMap PaToH CppUnit ADOLC ADIC TVMET MF ExodusII Nemesis XDMF Zlib HDF5 CGNS Pnetcdf Netcdf ADIOS2 Faodel Cereal Catalyst2 y12m SuperLUDist SuperLUMT SuperLU Cholmod UMFPACK MA28 AMD CSparse PETSC BLACS STRUMPACK CSS_MKL PARDISO_MKL PARDISO Oski TAUCS ForUQTK Dakota HIPS MATLAB CASK SPARSKIT QT gtest BoostLib BoostAlbLib OpenNURBS Portals CrayPortals Gemini InfiniBand BGPDCMF BGQPAMI Pablo HPCToolkit Clp GLPK qpOASES Matio PAPI MATLABLib Eigen X11 Lemon GLM quadmath CAMAL RTlib AmgX VTune TASMANIAN ArrayFireCPU SimMesh SimModel SimParasolid SimAcis SimField Valgrind QUO ViennaCL Avatar mlpack pebbl MAGMASparse Check SARMA CDT mpi_advance 114

Setting up export dependencies for all enabled packages ...


Probing the environment ...

-- USE_XSDK_DEFAULTS='OFF'
-- BUILD_SHARED_LIBS='ON'
-- CMAKE_BUILD_TYPE='RELEASE'
-- MPI_USE_COMPILER_WRAPPERS='ON'
Leaving current CMAKE_C_COMPILER=/home//OpenMPI/Install/bin/mpicc since it is already set!
Leaving current CMAKE_CXX_COMPILER=/home//OpenMPI/Install/bin/mpicxx since it is already set!
Leaving current CMAKE_Fortran_COMPILER=/usr/bin/gfortran since it is already set!
-- MPI_EXEC='/usr/bin/mpiexec'
-- MPI_EXEC='/usr/bin/mpiexec'
-- CMAKE_C_COMPILER_ID='GNU'
-- CMAKE_C_COMPILER_VERSION='13.3.0'
-- CMAKE_CXX_COMPILER_ID='GNU'
-- CMAKE_CXX_COMPILER_VERSION='13.3.0'
-- Skip adding flags for OpenMP because Kokkos flags does that ...
-- Trilinos_SET_INSTALL_RPATH='ON'
-- CMAKE_INSTALL_RPATH_USE_LINK_PATH='ON'
-- Setting default for CMAKE_INSTALL_RPATH pointing to Trilinos_INSTALL_LIB_DIR
-- CMAKE_INSTALL_RPATH='/home//Trilinos/Install/lib'
-- Trilinos_MAKE_INSTALL_GROUP_READABLE='OFF'
-- Trilinos_MAKE_INSTALL_WORLD_READABLE='OFF'
-- CMAKE_INSTALL_DEFAULT_DIRECTORY_PERMISSIONS = (OWNER_READ OWNER_WRITE OWNER_EXECUTE)

Getting information for all enabled external packages/TPLs ...

Processing enabled external package/TPL: TrilinosTribitsLastLib (enabled explicitly, disable with -DTPL_ENABLE_TrilinosTribitsLastLib=OFF)
-- TrilinosTribitsLastLib_LIBRARY_NAMES='NEVER_USED'
-- TPL_TrilinosTribitsLastLib_LIBRARIES='-lgfortran'
Processing enabled external package/TPL: MPI (enabled explicitly, disable with -DTPL_ENABLE_MPI=OFF)
-- MPI_LIBRARY_NAMES=''
Processing enabled external package/TPL: BLAS (enabled explicitly, disable with -DTPL_ENABLE_BLAS=OFF)
-- BLAS_LIBRARY_NAMES='blas blas_win32 blis-mt'
-- TPL_BLAS_LIBRARIES='/home//AMDOptimizedCPULibs/BLAS/Install/lib/libblis-mt.a'
Processing enabled external package/TPL: LAPACK (enabled explicitly, disable with -DTPL_ENABLE_LAPACK=OFF)
-- LAPACK_LIBRARY_NAMES='lapack lapack_win32 flame'
-- TPL_LAPACK_LIBRARIES='/home//AMDOptimizedCPULibs/LAPACK/Install/lib/libflame.a'
Processing enabled external package/TPL: Scotch (enabled explicitly, disable with -DTPL_ENABLE_Scotch=OFF)
-- Scotch_LIBRARY_NAMES='ptscotch;ptscotcherr;scotch;scotcherr'
-- TPL_Scotch_LIBRARIES='/home//Scotch/Install/lib/libptscotch.so;/home//Scotch/Install/lib/libptscotcherr.so;/home//Scotch/Install/lib/libscotch.so;/home//Scotch/Install/lib/libscotcherr.so'
-- TPL_Scotch_INCLUDE_DIRS='/home//Scotch/Install/include'
Processing enabled external package/TPL: METIS (enabled explicitly, disable with -DTPL_ENABLE_METIS=OFF)
-- METIS_LIBRARY_NAMES='metis'
-- TPL_METIS_LIBRARIES='/home//METIS/Install-Metis/lib/libmetis.a'
-- TPL_METIS_INCLUDE_DIRS='/home//METIS/Install-Metis/include'
Processing enabled external package/TPL: ParMETIS (enabled explicitly, disable with -DTPL_ENABLE_ParMETIS=OFF)
-- ParMETIS_LIBRARY_NAMES='parmetis;metis'
-- TPL_ParMETIS_LIBRARIES='/home//METIS/Install-ParMETIS/lib/libparmetis.a'
-- TPL_ParMETIS_INCLUDE_DIRS='/home//METIS/Install-ParMETIS/include'
Processing enabled external package/TPL: HYPRE (enabled explicitly, disable with -DTPL_ENABLE_HYPRE=OFF)
-- HYPRE_LIBRARY_NAMES='HYPRE'
-- TPL_HYPRE_LIBRARIES='/home//HYPRE/hypre/src/hypre/lib/libHYPRE.so'
-- TPL_HYPRE_INCLUDE_DIRS='/home//HYPRE/hypre/src/hypre/include'
Processing enabled external package/TPL: SCALAPACK (enabled explicitly, disable with -DTPL_ENABLE_SCALAPACK=OFF)
-- SCALAPACK_LIBRARY_NAMES='scalapack;blacs;blacsF77;blacs'
-- TPL_SCALAPACK_LIBRARIES='/home//AMDOptimizedCPULibs/ScaLAPACK/Install/lib/libscalapack.a'
Processing enabled external package/TPL: MUMPS (enabled explicitly, disable with -DTPL_ENABLE_MUMPS=OFF)
-- MUMPS_LIBRARY_NAMES='dmumps;mumps_common;pord'
-- TPL_MUMPS_LIBRARIES='/home//AMDOptimizedCPULibs/MUMPS/Install/lib/libdmumps.a;/home//AMDOptimizedCPULibs/MUMPS/Install/lib/libmumps_common.a;/home//AMDOptimizedCPULibs/MUMPS/Install/lib/libpord.a'
-- TPL_MUMPS_INCLUDE_DIRS='/home//AMDOptimizedCPULibs/MUMPS/Install/include'
Processing enabled external package/TPL: DLlib (enabled explicitly, disable with -DTPL_ENABLE_DLlib=OFF)
-- Attempting to tentatively enable TPL 'DLlib' ...
-- DLlib_LIBRARY_NAMES='dl'
-- TPL_DLlib_LIBRARIES='/usr/lib/x86_64-linux-gnu/libdl.a'
-- Attempt to tentatively enable TPL 'DLlib' passed!

Setting up testing support ...

-- CTEST_DROP_METHOD='https'
-- CTEST_DROP_SITE='testing.sandia.gov'
-- CTEST_PROJECT_NAME='Trilinos'
-- CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_TRIGGER_SITE=''
-- CTEST_DROP_SITE_CDASH='TRUE'
-- TRIBITS_2ND_CTEST_DROP_SITE='testing-dev.sandia.gov'
-- TRIBITS_2ND_CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'

Configuring individual enabled Trilinos packages ...

Processing enabled top-level package: Kokkos (Libs)
Setting default Kokkos CXX standard to 17
Kokkos version: 4.3.1
-- CTEST_DROP_SITE='testing.sandia.gov'
-- CTEST_PROJECT_NAME='Trilinos'
-- CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_TRIGGER_SITE=''
-- CTEST_DROP_SITE_CDASH='TRUE'
-- TRIBITS_2ND_CTEST_DROP_SITE='testing-dev.sandia.gov'
-- TRIBITS_2ND_CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_DROP_SITE='testing.sandia.gov'
-- CTEST_PROJECT_NAME='Trilinos'
-- CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_TRIGGER_SITE=''
-- CTEST_DROP_SITE_CDASH='TRUE'
-- TRIBITS_2ND_CTEST_DROP_SITE='testing-dev.sandia.gov'
-- TRIBITS_2ND_CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
The project name is: Trilinos
Using internal gtest for testing
Using -std=c++17 for C++17 standard as feature
Built-in Execution Spaces:
    Device Parallel: NoTypeDefined
    Host Parallel: NoTypeDefined
      Host Serial: SERIAL

Architectures:
Using internal desul_atomics copy
Kokkos Backends: SERIAL
Processing enabled top-level package: Teuchos (Core, Parser, ParameterList, Comm, Numerics, Remainder, KokkosCompat, KokkosComm, Examples)
You set HAVE_GCC_ABI_DEMANGLE=1; this suggests you are cross compiling.  If you're not cross compiling, best practice is not to set this; Trilinos will figure it out for you.
You set HAVE_TEUCHOS_BLASFLOAT=1; this suggests you are cross compiling.  If you're not cross compiling, best practice is not to set this; Trilinos will figure it out for you.
You set HAVE_TEUCHOS_LAPACKLARND=; this suggests you are cross compiling.  If you're not cross compiling, best practice is not to set this; Trilinos will figure it out for you.
C++ compiler supports __attribute__((constructor)) syntax
C++ compiler supports __attribute__((weak)) syntax and testing weak functions
C++ compiler does NOT support #pragma weak syntax and testing weak functions
Wrapping every Teuchos timer with a Kokkos profiling region.
-- TeuchosParameterList_SIOVOC_UnitTests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_UnitTests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterListModifier_UnitTests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterEntry_UnitTest: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_SerializationTest: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_XMLDuplicateSublists: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Conditions_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Conditions_Serialization_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Dependencies_Serialization_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Dependencies_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_FancyOutputting_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_FunctionObject_Tests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_FunctionObject_Serialization_Tests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ObjectBuilder_UnitTests: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Validator_UnitTest: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_Validator_SerializationTest: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XML_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParameterListHelpers_UnitTest: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParser_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParser_ordered: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_badclose.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_badclose2.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_badopen.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_notclosed.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_notclosed2.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_BadParse_b_tworoots.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XMLParse_GoodParse_g_with_decls.xml: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_YamlParser_test: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_example: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_XML_Data_Types_example: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_ParameterList_Custom_Validator_XML: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XmlToParameterList: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
-- TeuchosParameterList_XmlToParameterList_empty: NOT added test because Teuchos_SKIP_CTEST_ADD_TEST='OFF'!
Processing enabled top-level package: KokkosKernels (Libs)
-- CTEST_DROP_SITE='testing.sandia.gov'
-- CTEST_PROJECT_NAME='Trilinos'
-- CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_TRIGGER_SITE=''
-- CTEST_DROP_SITE_CDASH='TRUE'
-- TRIBITS_2ND_CTEST_DROP_SITE='testing-dev.sandia.gov'
-- TRIBITS_2ND_CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
The project name is: Trilinos
-- CTEST_DROP_SITE='testing.sandia.gov'
-- CTEST_PROJECT_NAME='Trilinos'
-- CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
-- CTEST_TRIGGER_SITE=''
-- CTEST_DROP_SITE_CDASH='TRUE'
-- TRIBITS_2ND_CTEST_DROP_SITE='testing-dev.sandia.gov'
-- TRIBITS_2ND_CTEST_DROP_LOCATION='/cdash/submit.php?project=Trilinos'
CMake Warning at packages/kokkos-kernels/CMakeLists.txt:163 (message):
  KokkosKernels_LINALG_OPT_LEVEL is deprecated!


Overriding KOKKOSKERNELS_ENABLE_TPL_BLAS=OFF with TPL_ENABLE_BLAS=ON
Overriding KOKKOSKERNELS_ENABLE_TPL_LAPACK=OFF with TPL_ENABLE_LAPACK=ON
Trilinos has enabled MKL and SYCL but it does not detect oneMKL correctly so we disable it!
Overriding KOKKOSKERNELS_ENABLE_TPL_METIS=OFF with TPL_ENABLE_METIS=ON

================================
Kokkos Kernels version: 4.3.1
================================
Kokkos Kernels ETI Types
   Devices:  <Serial,HostSpace>
   Scalars:  double
   Ordinals: int
   Offsets:  size_t
   Layouts:  LayoutLeft

Kokkos Kernels components
   COMMON:    ON
   BATCHED:   ON
   BLAS:      ON
   LAPACK:    ON
   GRAPH:     ON
   SPARSE:    ON
   ODE:       ON

Kokkos Kernels TPLs
   BLAS:        
   LAPACK:      
   METIS:       
================================

Creating ETI files for Batched_Gemm_nt_nt_bll
Creating ETI files for Batched_Gemm_nt_t_bll
Creating ETI files for Batched_Gemm_t_nt_bll
Creating ETI files for Batched_Gemm_t_t_bll
Creating ETI files for Batched_Gemm_nt_nt_blr
Creating ETI files for Batched_Gemm_nt_t_blr
Creating ETI files for Batched_Gemm_t_nt_blr
Creating ETI files for Batched_Gemm_t_t_blr
Creating ETI files for Blas1_abs
Creating ETI files for Blas1_abs_mv
Creating ETI files for Blas1_scal
Creating ETI files for Blas1_scal_mv
Creating ETI files for Blas1_dot
Creating ETI files for Blas1_dot_mv
Creating ETI files for Blas1_axpby
Creating ETI files for Blas1_axpby_mv
Creating ETI files for Blas1_update
Creating ETI files for Blas1_update_mv
Creating ETI files for Blas1_sum
Creating ETI files for Blas1_sum_mv
Creating ETI files for Blas1_nrm1
Creating ETI files for Blas1_nrm1_mv
Creating ETI files for Blas1_nrm2w
Creating ETI files for Blas1_nrm2w_mv
Creating ETI files for Blas1_nrminf
Creating ETI files for Blas1_nrminf_mv
Creating ETI files for Blas1_iamax
Creating ETI files for Blas1_iamax_mv
Creating ETI files for Blas1_nrm2
Creating ETI files for Blas1_nrm2_mv
Creating ETI files for Blas1_mult
Creating ETI files for Blas1_mult_mv
Creating ETI files for Blas1_reciprocal
Creating ETI files for Blas1_reciprocal_mv
Creating ETI files for Blas1_rot
Creating ETI files for Blas1_rotg
Creating ETI files for Blas1_rotm
Creating ETI files for Blas1_rotmg
Creating ETI files for Blas1_swap
Creating ETI files for Blas2_gemv
Creating ETI files for Blas2_ger
Creating ETI files for Blas2_syr
Creating ETI files for Blas2_syr2
Creating ETI files for Blas3_gemm
Creating ETI files for Blas3_trsm
Creating ETI files for Blas3_trmm
Creating ETI files for Lapack_gesv
Creating ETI files for Lapack_trtri
Creating ETI files for Lapack_svd
Creating ETI files for Graph_color_d1
Creating ETI files for Sparse_sptrsv_solve
Creating ETI files for Sparse_spmv_struct
Creating ETI files for Sparse_spmv_mv_struct
Creating ETI files for Sparse_spmv_bsrmatrix
Creating ETI files for Sparse_spmv_mv_bsrmatrix
Creating ETI files for Sparse_spmv
Creating ETI files for Sparse_spmv_mv
Creating ETI files for Sparse_spgemm_symbolic
Creating ETI files for Sparse_spgemm_numeric
Creating ETI files for Sparse_spgemm_noreuse
Creating ETI files for Sparse_bspgemm_numeric
Creating ETI files for Sparse_spgemm_jacobi
Creating ETI files for Sparse_spadd_symbolic
Creating ETI files for Sparse_spadd_numeric
Creating ETI files for Sparse_spiluk_symbolic
Creating ETI files for Sparse_spiluk_numeric
Creating ETI files for Sparse_par_ilut_symbolic
Creating ETI files for Sparse_par_ilut_numeric
Creating ETI files for Sparse_gmres
Creating ETI files for Sparse_sptrsv_symbolic
Creating ETI files for Sparse_trsv
Creating ETI files for Sparse_gauss_seidel_symbolic
Creating ETI files for Sparse_gauss_seidel_numeric
Creating ETI files for Sparse_gauss_seidel_apply
Processing enabled top-level package: RTOp (Libs)
Processing enabled top-level package: Epetra (Libs, Examples)
Did not find new version of lapack. dggsvd3 is not available.
-- Epetra_petra_power_method: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_verySimple: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_UG_Ex1: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_UG_ExMaps: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_my_example: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_my_example_LL: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_petra_power_method_LL: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_verySimple_LL: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson01_mpi_only_through_Epetra: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson01_mpi_on_its_own: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson01_no_mpi: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson02_init_map_vec: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson02_read_modify_vec: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson03_power_method: NOT added test because Epetra_ENABLE_TESTS=''.
-- Epetra_lesson05_redistribution: NOT added test because Epetra_ENABLE_TESTS=''.
Processing enabled top-level package: Zoltan (Libs, Examples)
-- Zoltan_simpleHIER: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_simpleBLOCK: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_simpleRCB: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_simpleGRAPH: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_simplePHG: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_migrateGRAPH: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_problemGRAPH: NOT added test because Zoltan_ENABLE_TESTS=''.
-- Zoltan_exampleBLOCK: NOT added test because Zoltan_ENABLE_TESTS=''.
Processing enabled top-level package: EpetraExt (Libs, Examples)
Processing enabled top-level package: Tpetra (TSQR, Core)
Tpetra: Using internal Kokkos
Tpetra: Enabling deprecated code
Determine whether Tpetra will assume that MPI is GPU aware:
  - Tpetra_INST_CUDA, Tpetra_INST_HIP and Tpetra_INST_SYCL atre OFF, so Tpetra will assume that MPI is not GPU aware.
Tpetra: defaulting to Tpetra_ASSUME_GPU_AWARE_MPI: OFF
Tpetra execution space availability (ON means available): 
  - Serial:  ON
  - Threads: OFF
  - OpenMP:  OFF
  - Cuda:    OFF
  - HIP:     OFF
  - SYCL:    OFF
Tpetra: Tpetra_INST_INT_LONG_LONG is enabled by default.
Tpetra: Tpetra_INST_INT_UNSIGNED is disabled by default.
Tpetra: Tpetra_INST_INT_UNSIGNED_LONG is disabled by default.
Tpetra: Tpetra_INST_INT_INT is disabled by default.
Tpetra: Tpetra_INST_INT_LONG is disabled by default.

Tpetra: Validate global ordinal setting ...
Tpetra: global ordinal setting is OK

User-set default Node: Tpetra::KokkosCompat::KokkosSerialWrapperNode
Tpetra: Using Full ETI
Processing enabled top-level package: Thyra (Core, TpetraAdapters)
-- Thyra ModelEvaluator Hessian interfaces On
Processing enabled top-level package: Xpetra (Libs)
Xpetra: Enabling deprecated code
-- NOTE: Setting Xpetra_ENABLE_EpetraExt=OFF since Xpetra_ENABLE_Epetra='OFF'
Xpetra: Enabling ETI
Processing enabled top-level package: Galeri (Libs)
Processing enabled top-level package: Ifpack (Libs, Examples)
-- Parsed Hypre headers
-- Ifpack_ex_reordering: NOT added test because Ifpack_ENABLE_TESTS=''.
-- Ifpack_ex_filtering: NOT added test because Ifpack_ENABLE_TESTS=''.
-- Ifpack_ex_reordering_LL: NOT added test because Ifpack_ENABLE_TESTS=''.
-- Ifpack_ex_filtering_LL: NOT added test because Ifpack_ENABLE_TESTS=''.
Processing enabled top-level package: ML (Libs, Examples)
-- ML_aztec_simple: NOT added test because ML_ENABLE_TESTS=''.
-- ML_operator: NOT added test because ML_ENABLE_TESTS=''.
-- ML_scalingtest: NOT added test because ML_ENABLE_TESTS=''.
-- ML_preconditioner: NOT added test because ML_ENABLE_TESTS=''.
-- ML_readex: NOT added test because ML_ENABLE_TESTS=''.
-- ML_user_smoothing: NOT added test because ML_ENABLE_TESTS=''.
-- ML_ml_read_maxwell: NOT added test because ML_ENABLE_TESTS=''.
-- ML_Blackboard: NOT added test because ML_ENABLE_TESTS=''.
-- ML_PowerMethod: NOT added test because ML_ENABLE_TESTS=''.
-- ML_Richardson: NOT added test because ML_ENABLE_TESTS=''.
-- ML_EpetraInterface: NOT added test because ML_ENABLE_TESTS=''.
-- ML_ml_multiple_rhs: NOT added test because ML_ENABLE_TESTS=''.
-- ML_ml_2level_DD: NOT added test because ML_ENABLE_TESTS=''.
-- ML_ml_XML: NOT added test because ML_ENABLE_TESTS=''.
Processing enabled top-level package: Belos (Libs, Examples)
-- Belos_BlockGmres_Galeri_Ex: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_BlockPrecGmres_Galeri_Ex: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_SolverFactory_Epetra_Galeri_Ex: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_Tpetra_BlockGmres_Galeri_Ex: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_SolverFactory_Tpetra_Galeri_Ex: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_Kokkos_BlockGmresEx: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_Kokkos_BlockCGEx: NOT added test because Belos_ENABLE_TESTS=''.
-- Belos_Kokkos_GCRODREx: NOT added test because Belos_ENABLE_TESTS=''.

Processing explicit instantiation support for enabled packages ...

Processing ETI support: TpetraCore
TpetraCore: Processing ETI / test support
Enabled Scalar types:        long long|double
Enabled LocalOrdinal types:  int
Enabled GlobalOrdinal types: long long
Enabled Node types:          Tpetra::KokkosCompat::KokkosSerialWrapperNode
Excluded type combinations: :
Set of enabled types, before exclusions: S={long long} N={Tpetra::KokkosCompat::KokkosSerialWrapperNode} LO={int} GO={long long};S={double} N={Tpetra::KokkosCompat::KokkosSerialWrapperNode} LO={int} GO={long long}

Set up for creating a distribution ...


Finished configuring Trilinos!

********************************************************************
********  WARNING WARNING WARNING WARNING WARNING WARNING  *********
********************************************************************
* Several Trilinos packages are scheduled for deprecation in 2025.
* The following deprecated packages are enabled (either explicitly
* or implicitly due to a dependency)
*
*    ML
*    Ifpack
*    EpetraExt
*    Epetra
*
********************************************************************

CMake Warning at CMakeLists.txt:80 (message):
  Deprecated packages that are enabled: ML;Ifpack;EpetraExt;Epetra


If publishing results using Trilinos, please cite us: https://trilinos.github.io/cite.html
Configuring done (2.1s)
Generating done (0.7s)

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 27, 2024

It looks like you are building with OpenMP disabled. So I don't think that the lack of OpenMP flags is a Trilinos issue. Do any of the TPLs require OpenMP?

@ParticleTruthSeeker
Copy link
Author

To me it looks like its explicitly enabled and some dependencies do use it for sure but I have moved past this issue with the linker flags even though my Examples directory is empty.

Is there something we can do about this message I get when trying to link against Trilinos?

/usr/bin/ld: libelmersolver.so: undefined reference to `ML_Epetra::MultiLevelPreconditioner::TestSmoothers(Teuchos::ParameterList&, bool)'

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 27, 2024

Yes, could you have a look in your build directory? There should be a file packages/ml/src/config.h. Could you check that you have lines

#define HAVE_ML_EPETRA
#define HAVE_ML_EPETRAEXT
#define HAVE_ML_TEUCHOS

also, could you enable the ML examples (ML_ENABLE_EXAMPLES=ON)? If they build and run we know it's an issue with how elmer is linking Trilinos.

@ParticleTruthSeeker
Copy link
Author

Image
I don't have config.h. I have ml_config.h
Image
But the definitions you list exist but the examples aren't building.

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 27, 2024

Ok, can you show the error that you get from the examples in Trilinos?

@ParticleTruthSeeker
Copy link
Author

ParticleTruthSeeker commented Dec 27, 2024

So I have added the -lgfortran -fopenmp flags and I am no longer getting any errors. I found the ml examples under Build/packages/ml/examples. The .exe are asking me to recompile with some additional options --enable-aztecoo --enable-galeri so I will give that a go.

@ParticleTruthSeeker
Copy link
Author

ParticleTruthSeeker commented Dec 27, 2024

Here is my output from ML_operator.exe:

USing ParMETIS 3.x
Entering ML_Gen_MGHierarchy_UsingAggregation
**************************************************************
* ML Aggregation information                                 *
==============================================================
ML_Aggregate : ordering           = natural.
ML_Aggregate : min nodes/aggr     = 2
ML_Aggregate : max neigh selected = 0
ML_Aggregate : attach scheme      = MAXLINK
ML_Aggregate : strong threshold   = 0.000000e+00
ML_Aggregate : P damping factor   = 1.333333e+00
ML_Aggregate : number of PDEs     = 1
ML_Aggregate : number of null vec = 1
ML_Aggregate : smoother drop tol  = 0.000000e+00
ML_Aggregate : max coarse size    = 32
ML_Aggregate : max no. of levels  = 6
**************************************************************
ML_Aggregate_Coarsen (level 5) begins
ML_Aggregate_CoarsenUncoupled : current level = 5
ML_Aggregate_CoarsenUncoupled : current eps = 0.000000e+00
Aggregation(UVB) : Total nonzeros = 288 (Nrows=64)
Aggregation(UC) : Phase 0 - no. of bdry pts  = 0 
Aggregation(UC) : Phase 1 - nodes aggregated = 53 (64)
Aggregation(UC) : Phase 1 - total aggregates = 12 
Aggregation(UC_Phase2_3) : Phase 1 - nodes aggregated = 53 
Aggregation(UC_Phase2_3) : Phase 1 - total aggregates = 12
Aggregation(UC_Phase2_3) : Phase 2a- additional aggregates = 0
Aggregation(UC_Phase2_3) : Phase 2 - total aggregates = 12
Aggregation(UC_Phase2_3) : Phase 2 - boundary nodes   = 0
Aggregation(UC_Phase2_3) : Phase 3 - leftovers = 0 and singletons = 0
Aggregation(UC) : QR factorization - too small aggregates = 0
Calculating eigenvalue estimate using CG method
Gen_Prolongator (level 5) : Max eigenvalue = 1.8517e+00

Prolongator/Restriction smoother (level 5) : damping factor #1 = 7.2005e-01
Prolongator/Restriction smoother (level 5) : ( = 1.3333e+00 / 1.8517e+00)

Smoothed Aggregation : operator complexity = -6.900000e+01.
Optimal SGS damping parameter = 1.000000e+00

		*******************************************************
		***** Problem: Epetra::CrsMatrix
		***** Preconditioned GMRES solution
		***** Epetra ML::MultilLevelOperator
		***** No scaling
		*******************************************************

                iter:    0           residual = 1.000000e+00
                iter:    9           residual = 6.485225e-09


		Solution time: 0.001713 (sec.)
		total iterations: 9
||b-Ax||_2 = 3.29154e-08
Total Time = 0.00841544

Elmer then proceeds to link successfully against Trilinos. The advanced example ML_ml_analyze.exe with the preconditioner_test requires amesos:

Amesos not linked
2D computational stencil for equation 0 at node 406 (grid is 28 x 28)

	               0              -1               0
	              -1               4              -1
	               0              -1               0


--------------------------------------------------------------------------------

================================================================================
Label                          = A matrix level 0
Global rows                    = 784
Global columns                 = 784
Stored nonzeros                = 3808
Nonzeros / row                 = 4
Estimated storage (Mbytes)     = 0.051968

Actual nonzeros                = 3808
Nonzeros in strict lower part  = 1512
Nonzeros in strict upper part  = 1512

Empty rows                     = 0                    ( 0 %)
Dirichlet rows                 = 0                    ( 0 %)
Diagonally dominant rows       = 108                  ( 13.7755 %)
Weakly diag. dominant rows     = 784                  ( 100 %)

Maximum bandwidth              = 28

                                 one-norm       inf-norm       Frobenius      
                                 ========       ========       =========      

A                              = -1             8              124.772        

                                 min            avg            max            
                                 ===            ===            ===            

 A(i,j)                        = -1             0.0294118      4              
|A(i,j)|                       = 1              1.61765        4              

 A(k,k)                        = 4              4              4              
|A(k,k)|                       = 4              4              4              

 sum_j A(k,j)                  = 6              7.85714        8              
================================================================================

================================================================================
Label                          = A matrix level 1
Global rows                    = 140
Global columns                 = 140
Stored nonzeros                = 1152
Nonzeros / row                 = 8
Estimated storage (Mbytes)     = 0.014944

Actual nonzeros                = 1152
Nonzeros in strict lower part  = 506
Nonzeros in strict upper part  = 506

Empty rows                     = 0                    ( 0 %)
Dirichlet rows                 = 0                    ( 0 %)
Diagonally dominant rows       = 65                   ( 46.4286 %)
Weakly diag. dominant rows     = 98                   ( 70 %)

Maximum bandwidth              = 20

                                 one-norm       inf-norm       Frobenius      
                                 ========       ========       =========      

A                              = -1             1.11844        7.17791        

                                 min            avg            max            
                                 ===            ===            ===            

 A(i,j)                        = -0.111432      0.0145759      0.72639        
|A(i,j)|                       = 0.0256976      0.125425       0.72639        

 A(k,k)                        = 0.550178       0.576003       0.72639        
|A(k,k)|                       = 0.550178       0.576003       0.72639        

 sum_j A(k,j)                  = 0.747921       1.03207        1.11844        
================================================================================

================================================================================
Label                          = A matrix level 2
Global rows                    = 17
Global columns                 = 17
Stored nonzeros                = 125
Nonzeros / row                 = 7
Estimated storage (Mbytes)     = 0.001636

Actual nonzeros                = 125
Nonzeros in strict lower part  = 54
Nonzeros in strict upper part  = 54

Empty rows                     = 0                    ( 0 %)
Dirichlet rows                 = 0                    ( 0 %)
Diagonally dominant rows       = 16                   ( 94.1176 %)
Weakly diag. dominant rows     = 16                   ( 94.1176 %)

Maximum bandwidth              = 8

                                 one-norm       inf-norm       Frobenius      
                                 ========       ========       =========      

A                              = -1             0.113545       0.237479       

                                 min            avg            max            
                                 ===            ===            ===            

 A(i,j)                        = -0.0108138     0.00533958     0.0672602      
|A(i,j)|                       = 0.000896476    0.0108623      0.0672602      

 A(k,k)                        = 0.0322343      0.0555038      0.0672602      
|A(k,k)|                       = 0.0322343      0.0555038      0.0672602      

 sum_j A(k,j)                  = 0.0443824      0.0798697      0.113545       
================================================================================

Solving Ae = 0, with a random initial guess
- number of pre-smoother cycle(s)  = 5
- number of post-smoother cycle(s) = 1
- number of ML cycle(s)            = 10
- all reported data are scaled with respect to the corresponding
  value before the application of the solver
  (0 == perfect solution, 1 == no effect)

Solver                                    Linf       L2     
------                                    ----       --     

Presmoother  (level 0, eq 0)		0.714385   0.589294  

Postsmoother (level 0, eq 0)		0          0         

Presmoother  (level 1, eq 0)		0.542688   0.267665  

Postsmoother (level 1, eq 0)		0.777325   0.645755  


Coarse Solver (level 2, eq 0)		1          1         

complete ML cycle (eq0)			0.0257756  0.000592859

*** Total time for analysis = 0.00838338 (s)
--------------------------------------------------------------------------------

ML::ERROR:: -1, /home/Trilinos/Trilinos/packages/ml/src/Utils/ml_MultiLevelPreconditioner_Test.cpp, line 85

That results in undefined references to MPI symbols even though MPI is enabled in my Trilinos build.

./src/libamesos.so.16.0.0: undefined reference to `mpi_pack_'
/usr/bin/ld: ../src/libamesos.so.16.0.0: undefined reference to `mpi_cancel_'
/usr/bin/ld: ../src/libamesos.so.16.0.0: undefined reference to `mpi_type_commit_'
/usr/bin/ld: ../src/libamesos.so.16.0.0: undefined reference to `mpi_iprobe_'
/usr/bin/ld: ../src/libamesos.so.16.0.0: undefined reference to `mpi_initialized_'

I am not really sure if this is a real issue, though Elmer seems to be interested in Trilinos preconditioners.

Update:
Added mpif90 linker and compile flags to solve that issue but the example suggests ml is still not linked to amesos

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 27, 2024

Can you double-check as before that ML thinks that Amesos is enabled by looking at packages/ml/src/config.h?

@ParticleTruthSeeker
Copy link
Author

ParticleTruthSeeker commented Dec 28, 2024

It looks like its here.
Image

ML_ml_analyze.exe says the following:

Amesos (level 2) : This coarse solver is not available.
Amesos (level 2) : Now re-building with LAPACK
      1  LU                           

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 28, 2024

My best guess is that Amesos is indeed correctly enabled, but KLU was not enabled in Amesos.

@ParticleTruthSeeker
Copy link
Author

I tried with KLU but that particular error didn't change, but I have managed to build Elmer now so perhaps I shouldn't bother further unless I get a related elmersolver error?

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 28, 2024

That's up to you. It's a bit mysterious why the particular coarse grid solver doesn't get enabled. Overall, I wouldn't expect a big difference in performance as long as the coarse grid problem is reasonably small. We simply don't use a lot of Epetra builds anymore.

@ParticleTruthSeeker
Copy link
Author

ParticleTruthSeeker commented Dec 29, 2024

Sorry, I think that was because I hadn't installed the new libraries. Now the example is running but I think its running the KLU serial solver as there is no error message and 1 thread is pegged. Not sure how long it will take to finish.

I found this which is quite useful:
https://trilinos.github.io/linear_solver.html

Update: Seems to have segfaulted on Aztec

      1  LU                                                                                                                                                                                                                     

      1  LU                                                                                                                                                                                                                     

#19....n=1, omega=1.25e+00           9         3.18554e-06    236.547        N

- Aztec preconditioner
#20....ILU(fill=0)                   3         5.97056e-06    0.0026346      N
#21....ILU(fill=1)                   3         3.14463e-07    0.00275214     N
#22....ILU(fill=2)                   2         3.99552e-06    0.00329236     N

- Aztec as solver
Segmentation fault (core dumped)

@cgcgcg
Copy link
Contributor

cgcgcg commented Dec 29, 2024

Huh. Well, the code will be dropped in the next year, so I don't see a point in tracking down what happened there. I'm assuming you can run Elmer now?

@ParticleTruthSeeker
Copy link
Author

I will have to run some cases to find out. I might have a look at this example through valgrind but the KLU solver would take a long time to run through that given how long it took without valgrind.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants