<feed xmlns='http://www.w3.org/2005/Atom'>
<title>lofar-pilot, branch master</title>
<subtitle>A small runner script for LOFAR pipelines.</subtitle>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/'/>
<entry>
<title>Store script in src directory</title>
<updated>2025-07-09T19:31:41+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-07-09T19:31:41+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=7b3473095fa3efcaa83d78474772e16cf66ca896'/>
<id>7b3473095fa3efcaa83d78474772e16cf66ca896</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Add Makefile</title>
<updated>2025-07-09T19:06:11+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-07-09T19:06:11+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=65ed21e4850196a2e1b27254122e1e2df816e262'/>
<id>65ed21e4850196a2e1b27254122e1e2df816e262</id>
<content type='text'>
Using the script is a bit simpler if it is added to a location in
the user's PATH with execution permission set. The Makefile will,
in addition, remove the file extension. After running make it is
a simple matter of using `pilot` on the command line.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Using the script is a bit simpler if it is added to a location in
the user's PATH with execution permission set. The Makefile will,
in addition, remove the file extension. After running make it is
a simple matter of using `pilot` on the command line.
</pre>
</div>
</content>
</entry>
<entry>
<title>bugfix: set $PROGRAM before use</title>
<updated>2025-07-09T18:55:08+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-07-09T18:55:08+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=e4640d7d2803b872babfa239c49afb5978b6686c'/>
<id>e4640d7d2803b872babfa239c49afb5978b6686c</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Document supported environment variables</title>
<updated>2025-07-08T21:52:38+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-07-08T21:52:38+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=27c095276c6a0674ad386eecf6ea68413ef1af5c'/>
<id>27c095276c6a0674ad386eecf6ea68413ef1af5c</id>
<content type='text'>
Pilot recognises some environment variables and uses them if they
are set. This adds some text to the readme so it is clear for the
user.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Pilot recognises some environment variables and uses them if they
are set. This adds some text to the readme so it is clear for the
user.
</pre>
</div>
</content>
</entry>
<entry>
<title>Expose the batching system</title>
<updated>2025-07-08T20:15:34+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-07-08T20:12:51+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=05725c46cd33d72db60d5ea5954541f073163dec'/>
<id>05725c46cd33d72db60d5ea5954541f073163dec</id>
<content type='text'>
The queuing system was hard-coded to slurm. It may be, at times,
convenient to be able to run workflows on the local node (or use
a different queuing system altogether).

The old behaviour is maintained by setting the batching system
to slurm by default; the user can change the system by using
--batch_system.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
The queuing system was hard-coded to slurm. It may be, at times,
convenient to be able to run workflows on the local node (or use
a different queuing system altogether).

The old behaviour is maintained by setting the batching system
to slurm by default; the user can change the system by using
--batch_system.
</pre>
</div>
</content>
</entry>
<entry>
<title>use a single assignment of possibly pre-set APPTAINER variables</title>
<updated>2025-04-09T15:27:03+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-04-09T15:27:03+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=f247bf85b36ca38e820bfc066f36ac64c3ec9d5c'/>
<id>f247bf85b36ca38e820bfc066f36ac64c3ec9d5c</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>append to container PATH through APPTAINERENV_PREPEND_PATH</title>
<updated>2025-04-07T08:51:38+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-04-07T08:51:38+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=398f330c873563b2ab44bc01b0b9fedf3de8f061'/>
<id>398f330c873563b2ab44bc01b0b9fedf3de8f061</id>
<content type='text'>
Apptainer v1.3.6-1.el9 doesn't appear to allow resetting the
container path using APPTAINERENV_PATH. Using this variable
works in v1.3.4, but it isn't clear where this change was
introduced. APPTAINERENV_PREPEND_PATH is a safe alternative.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Apptainer v1.3.6-1.el9 doesn't appear to allow resetting the
container path using APPTAINERENV_PATH. Using this variable
works in v1.3.4, but it isn't clear where this change was
introduced. APPTAINERENV_PREPEND_PATH is a safe alternative.
</pre>
</div>
</content>
</entry>
<entry>
<title>create vlbi-cwl_latest.sif symlink</title>
<updated>2025-04-07T08:49:16+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-04-07T08:49:16+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=5cbd46d2c6260bb8fe60ef0d779eb024ae10f849'/>
<id>5cbd46d2c6260bb8fe60ef0d779eb024ae10f849</id>
<content type='text'>
In some versions of toil the `:latest` tag appears to be
automatically appended. This is a workaround for these
versions.
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
In some versions of toil the `:latest` tag appears to be
automatically appended. This is a workaround for these
versions.
</pre>
</div>
</content>
</entry>
<entry>
<title>place symlink in CWL_SINGULARITY_CACHE if it exists</title>
<updated>2025-04-07T08:48:51+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-04-07T08:48:51+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=284168295f41abeaef7c3a31f6de4392ca4ce888'/>
<id>284168295f41abeaef7c3a31f6de4392ca4ce888</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>make symlinking the container idempotent</title>
<updated>2025-04-01T14:26:24+00:00</updated>
<author>
<name>Matthijs van der Wild</name>
<email>matthijs.van-der-wild@durham.ac.uk</email>
</author>
<published>2025-04-01T14:26:24+00:00</published>
<link rel='alternate' type='text/html' href='https://gitwolf.duckdns.org/lofar-pilot/commit/?id=ada4996000d19330e17a41a3d30bdacb9ca7042f'/>
<id>ada4996000d19330e17a41a3d30bdacb9ca7042f</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
