Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

How can I use CernVM-FS on batch?

Singularity

CernVM-FS can be accessed on head-01/cvmfs/ is mounted on all compute and interactive hosts. You can test access by SSH into head.arcc.albany.edu using singularity. Singularity allows users to spawn secure containers, giving them full control over their environment without root privileges. For more information, please see https://www.sylabs.io/.

ITS provides a singularity image that can be run, giving a user access to /cvmfs/ without root. The .def file can be found on github at https://github.com/nschiraldi/singularity/blob/master/singularity.cernvmfs

How-to: Execute an Interactive Shell in the Image

There are two ways to access the image, from a shared network path, or to pull it down to a directory of your choice. 

  1. Executing a shell from the shared network directory:

    Code Block
    languagebash
    $ singularity exec --bind /network/ /network/rit/misc/software/singularity/images/singularity_cernvmfs.sif parrot_run bash --noprofile --norc
    $ cd /cmvfs/
  2. Pulling the image to a directory of your choice

    Code Block
    languagebash
    $ cd [path/to/your/directory]
    $ singularity pull shub://nschiraldi/singularity:cernvmfs
    $ singularity exec --bind /network/ singularity_cernvmfs.sif parrot_run bash --noprofile --norc
    $ cd /cvmfs/

How-to: Copy Files to my Lab Share

Code Block
languagebash
$ singularity run --bind /network/ singularity_cernvmfs.sif cp -R /cvmfs/[path/to/files] /network/rit/lab/[path/in/lab]

Can I create my own image?

 While you cannot build an image on head-01.arcc.albany.edu, they can be built via github + singularity-hub (https://www.singularity-hub.org/) CI/CD integration, or on a local machine and pushed to singularity-hub, then pulled down to head-01.arcc.albany.edu and run, seamlessly. You could also build a docker image on a local machine, upload it to docker-hub, and access it with:

Code Block
languagebash
$ singularity run -- bind /network/ docker://path-to-docker-image [cmd] [args]

 

 (How-to: Connect via SSH (PuTTY, macOS terminal, X2Go) and then executing

Code Block
languagebash
cd /cvmfs/
ls

If you need additional endpoints added, please contact ITS at askit@albany.edu