Hprc banner tamu.png

Difference between revisions of "Talk:SW:Singularity"

From TAMU HPRC
Jump to: navigation, search
(nearing in on objective)
(Replaced content with "See SW:Singularity:Examples")
 
(48 intermediate revisions by the same user not shown)
Line 1: Line 1:
== j-perdue random links for 8/10/2018 ==
+
See [[SW:Singularity:Examples]]
=== Placeholder ===
 
To be added to SW:Singlularity:Examples or something.... just a placeholder for now to dump all my URLs at home for access at work:
 
 
 
https://github.com/singularityware/singularity/issues/1076
 
 
 
https://github.com/singularityware/singularity/issues/1165
 
 
 
http://singularity.lbl.gov/quickstart#build-images-from-scratch
 
 
 
https://hub.docker.com/_/fedora/
 
 
 
https://github.com/NIH-HPC/singularity-examples/blob/master/torch/Singularity.torch
 
 
 
https://www.sylabs.io/docs/
 
 
 
=== history ===
 
 
 
* random notes from .bash_history on hprclab2
 
 
 
<pre>
 
[j-perdue@hprclab2 ~]$ history | grep docker
 
  460  git clone https://github.com/fedora-cloud/docker-brew-fedora.git
 
  466  less prep-docker-brew-branch.sh
 
  468  ./prep-docker-brew-branch.sh 28
 
  470  sudo docker pull fedora:28
 
  472  sudo docker run --rm -ti fedora:28 bash
 
  484  sudo docker run  -ti fedora:28 bash
 
  494  sudo docker run  -ti fedora:28 bash
 
  495  man docker
 
  496  man docker-run
 
  497  sudo docker build --writable Fedora28.img fedora:28
 
  515  sudo singularity build --writable FedoraLatest.img docker://fedora:latest
 
  516  sudo singularity build --writable Fedora28.img docker://fedora:28
 
  523  # sudo singularity build --writable --size Fedora28.img docker://fedora:28
 
  541  history | grep docker
 
[j-perdue@hprclab2 ~]$ history | grep singularit
 
  510  sudo singularity build --writable Fedora28.img fedora:28
 
  511  sudo singularity build --writable Fedora28.img fedora:27
 
  512  sudo singularity build --writable Fedora28.img
 
  XXX  sudo singularity shell --writable Fedora28-HPRCLAB.img
 
</pre>
 
 
 
=== nearing in on objective ===
 
 
 
The objective in this case is a Fedora28-HPRCLAB.img file that has space for users to manuever around and install stuff:
 
# that we can provide to users, a Singularity .img file (self-contained), for them to update as needed (as root on their own workstations) that also runs on our clusters
 
# is already populated with HPRCLAB RPMs
 
# has plenty of disk space for the user to add files (as non-root) while on the cluster
 
 
 
Latest go around looks like this:
 
 
 
# create a (--writeable) Singularity sandbox from docker://fedora:28 (called mysandbox below... a directory)
 
<pre>singularity build --sandbox /tmp/Fedora28-HPRCLAB.sandbox docker://fedora:28</pre>
 
# run 'sudo singularity shell" on sandbox to populate (JKP: need to check if sudo is necessary here)
 
# populate the sandbox with all the RPMs (probably requires sudo above) and users (again sudo)
 
# once you are happy with that, time to make an .img
 
# singularity image.create my20Gimage.img # create .img file
 
# singularity image.expand -s 20480 my20Gimage.img # expand to 20GB (works because there is no real file system yet)
 
#  sudo tar -cvf - -C mysandbox/ . | sudo singularity image.import my20Gimage.img  # see the last/tar example in 'singularity image.import --help'
 

Latest revision as of 13:24, 14 August 2018