Skip to content

Commit 3c8a78c

Browse files
committed
Squashed 'cwltool/schemas/' changes from aa320ec..8b6ddb1
8b6ddb1 Merge pull request #461 from MarkRobbo/rdfs-namespace eb64c56 Add rdfs namespaces where used e5f4086 Merge pull request #416 from common-workflow-language/mr-c-patch-1 4cf45da Merge pull request #459 from common-workflow-language/airflow-badge 100635d add badge and promote Airflow upwards db0c837 Merge pull request #407 from common-workflow-language/fix-support-link 0d88a24 Merge pull request #455 from ohsu-comp-bio/cwl-tes-implementation 8d76233 Merge pull request #453 from common-workflow-language/fix-conflicting-ids 3496956 fix conflicting IDs 15a7d51 Merge pull request #452 from common-workflow-language/hmenager-patch-1 78940a8 Add ELIXIR + BioExcel participating organizations 05fcef8 remove funnel from list since we are no longer maintaining it 09c2d0c Merge pull request #445 from common-workflow-language/toil-backend-update 873ebfa Merge pull request #448 from common-workflow-language/skanwal-patch-1 d52c2b1 Update README.md 77f38c8 Merge pull request #447 from common-workflow-language/avro-spec 615646e Fix broken avro spec link a863f80 Merge pull request #441 from common-workflow-language/more-contributors 9e84f13 Merge pull request #444 from common-workflow-language/mr-c-patch-2 506508b Merge pull request #432 from michael-kotliar/master dfbb124 update list of schedulers and platforms for Toil f7c68c4 add matching SVG c2c1f1e Added more contributors 50e9d25 Merge pull request #439 from common-workflow-language/link-cwlgen 6362e57 Add link to python-cwlgen. 04c3f8e Add Airflow in Implementations Section of Readme e150035 Merge pull request #426 from common-workflow-language/fix-wc-test 6acb016 Fix wc test by using wc -l to avoid padding issues on different implementions of 'wc' (!) d80919e Revert "Fix identifier conflicts (checked by cwltool for the first time) by giving ids" f2ea521 Merge pull request #418 from mdmiller53/master 2ade169 Update README.md 9930c4a Merge pull request #417 from common-workflow-language/fix-id-conflicts fcc593a Fix identifier conflicts (checked by cwltool for the first time) by giving ids to embedded tools and workflows. 60b4701 Move blog link out of support section d038d86 Merge pull request #355 from StarvingMarvin/master f6b6f74 Merge pull request #409 from common-workflow-language/LourensVeen-uml-sketch e4b4b99 Add UML sketch 81d5e1e Merge branch 'master' of https://github.com/common-workflow-language/common-workflow-language 074a420 Merge branch 'master' of github.com:StarvingMarvin/common-workflow-language 1f5ccec Use explicit anchor b0e1212 fix support link 1452e65 Merge pull request #406 from sharmatime/patch-1 b60a48c Update README.md aa44386 Merge pull request #400 from common-workflow-language/v1.1.0-dev1 e6dc6e4 Use ShellCommandRequirement for stderr tests. 7098e43 turn off shell quoting for stderr tests 8de0b2b sync remaining updates made to v1.0 8ab5eb9 stderr redirect tests use "echo" instead of checking for the usage message of "egrep". a90334a Merge pull request #399 from common-workflow-language/Consonance 9566984 add platform support list for Consonance d0fc2df Add missing files. f0f8b67 Sync v1.1 conformance test suite to changes in v1.0 suite. 50f052e Merge pull request #340 from Jeltje/master f8a2d76 Add Consonance 776eb3b Merge pull request #397 from common-workflow-language/ohofmann-clarifications af0b112 participating organization clarifications c7958cf Merge pull request #395 from common-workflow-language/dir5-allow-symlink 12c12ce Merge pull request #366 from common-workflow-language/support-link-and-collabs 142e34e Make the "dir5.cwl" pass if the implementation uses symlinks. 1d5c5b9 document Toil's slurm support 7063fc0 Merge pull request #386 from common-workflow-language/cwl-ecosystem-update 85976a7 Add latest additions to the CWL ecosystem f956af5 Merge pull request #385 from common-workflow-language/fix/issue/195 3a5aef3 Additional participating organizations 103c976 Merge pull request #383 from andrewjesaitis/userguide_typo f95eb57 Use v1.0 style id's in inputs/outputs example 2d7707c Merge pull request #376 from common-workflow-language/open-stand 6396df0 long overdue linking to open-stand.org 2d74be4 even dhough slim is larger than alpine, it reuses debian:8 that is already pulled for other tests, so overall smaller overhead a4822d8 specifying python2 as baseCommand in order for tests to work with systems where python3 is the default 360e2b9 Merge pull request #371 from common-workflow-language/smoe-userguide-typo-contianer 1a571ba UserGuide.yml trivial typo 3bd20eb Merge pull request #368 from bamuzesc/patch-1 bed0329 removed redundant line 4 "baseCommand: javac" 3003fc4 support instructions link, list of collabs 37c3e0a Merge pull request #360 from zrilak/master 2bc1b13 Tweaks to README 87d982f Merge branch 'master' of github.com:common-workflow-language/common-workflow-language 4f80e57 some concluding remark 047c9ad UserGuide: about nested workflow d5d124c include empty.yml 3b41eda outputSource within output parameter 70f528a CWL View link dc7d391 even dhough slim is larger than alpine, it reuses debian:8 that is already pulled for other tests, so overall smaller overhead 40b65c2 Merge remote-tracking branch 'upstream/master' 25975b0 specifying python2 as baseCommand in order for tests to work with systems where python3 is the default 9ce806b empty.yml can't be quite empty..? 37ef31c How to make empty.yml 1104bf7 Fix typos in UserGuide f5c5f4d Update README.md dd083bd Clarify Xenon CWL work 97b3698 Update organizations 5473858 Merge pull request #344 from common-workflow-language/import-hint-test a26c1ae add test for importing hints fd09b15 fixed typos git-subtree-dir: cwltool/schemas git-subtree-split: 8b6ddb1
1 parent 65f95a3 commit 3c8a78c

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

67 files changed

+1259
-177
lines changed

README.md

Lines changed: 54 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,20 @@
11
Common Workflow Language
22
========================
33

4-
[![GitHub stars](https://img.shields.io/github/stars/common-workflow-language/common-workflow-language.svg)](https://github.com/common-workflow-language/common-workflow-language/stargazers) [![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/common-workflow-language/common-workflow-language?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)
4+
[![GitHub stars](https://img.shields.io/github/stars/common-workflow-language/common-workflow-language.svg)](https://github.com/common-workflow-language/common-workflow-language/stargazers) [![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/common-workflow-language/common-workflow-language?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge) [**Support**](#Support)
55

66
The Common Workflow Language (CWL) is a specification for describing analysis
7-
workflows and tools that are portable and scalable across a variety of software
8-
and hardware environments, from workstations to cluster, cloud, and high
9-
performance computing (HPC) environments. CWL is designed to meet the needs of
10-
data-intensive science, such as Bioinformatics, Medical Imaging, Astronomy,
11-
Physics, and Chemistry.
7+
workflows and tools in a way that makes them portable and scalable across a
8+
variety of software and hardware environments, from workstations to cluster,
9+
cloud, and high performance computing (HPC) environments. CWL is designed to
10+
meet the needs of data-intensive science, such as Bioinformatics, Medical
11+
Imaging, Astronomy, Physics, and Chemistry.
1212

1313
CWL is developed by an informal, multi-vendor working group consisting of
14-
organizations and individuals interested enabling scientists to share data
15-
analysis workflows. [The CWL project is on Github.](https://github.com/common-workflow-language/common-workflow-language)
14+
organizations and individuals aiming to enable scientists to share data
15+
analysis workflows. [The CWL project is on Github](https://github.com/common-workflow-language/common-workflow-language) and we follow the [Open-Stand.org principles for collaborative open standards development](https://open-stand.org/about-us/principles/)
16+
17+
[![Open Stand badge](http://standards.ieee.org/images/openstand/128x128-blue2.png)](https://open-stand.org/about-us/principles/).
1618

1719
CWL builds on technologies such as [JSON-LD](http://json-ld.org)
1820
for data modeling and [Docker](http://docker.com) for portable runtime
@@ -40,17 +42,19 @@ Please cite https://dx.doi.org/10.6084/m9.figshare.3115156.v2
4042

4143
## Implementations
4244

43-
|Software|Description|CWL support|Platform support|Platform Maturity|
44-
|--------|-----------|-----------|--------|--------|
45-
|[cwltool](https://github.com/common-workflow-language/cwltool)|Reference implementation of CWL|[![Build Status](https://ci.commonwl.org/job/cwltool-conformance/badge/icon)](http://ci.commonwl.org/job/cwltool-conformance/lastBuild/testReport/)|Linux, OS X, local execution only|Production|
46-
|[Arvados](https://arvados.org)|Distributed computing platform for data analysis on massive data sets. [Using CWL on Arvados](http://doc.arvados.org/user/cwl/cwl-runner.html)|[![Build Status](https://ci.commonwl.org/job/arvados-conformance/badge/icon)](http://ci.commonwl.org/job/arvados-conformance/lastBuild/testReport/)|AWS, GCP, Azure, Slurm|Production|
47-
|[Toil](https://github.com/BD2KGenomics/toil)|Toil is a workflow engine entirely written in Python.|[![Build Status](https://ci.commonwl.org/job/toil-conformance/badge/icon)](http://ci.commonwl.org/job/toil-conformance/lastBuild/testReport/)|AWS, GCP, Azure, OpenStack, Grid Engine, Mesos|Production|
48-
|[Rabix Bunny](https://github.com/rabix/bunny)|Reproducible Analyses for Bioinformatics|[![Build Status](https://ci.commonwl.org/buildStatus/icon?job=rabix-conformance)](https://ci.commonwl.org/job/rabix-conformance/)|Java|alpha|
49-
|[Apache Taverna](http://taverna.incubator.apache.org/)|Domain-independent Workflow Management System|[alpha](https://issues.apache.org/jira/browse/TAVERNA-900)|Java|Production|
50-
|[Galaxy](https://galaxyproject.org/)|Web-based platform for data intensive biomedical research.|[alpha](https://github.com/common-workflow-language/galaxy)|Python|Production|
51-
|[AWE](https://github.com/MG-RAST/AWE)|Workflow and resource management system for bioinformatics data analysis.|[alpha](https://github.com/wgerlach/AWE)|Go|Production|
52-
|[Funnel](https://github.com/bmeg/funnel)|Use Google Genomics Pipeline API with CWL|alpha|GCP|alpha|
53-
|[xenon-cwl-runner](https://github.com/NLeSC/xenon-cwl-runner)|Run CWL workflows using Xenon|alpha|[any Xenon backend](http://nlesc.github.io/Xenon/): local, ssh, SLURM, Torque, Grid Engine|Production|
45+
|Software|Description|CWL support|Platform support|
46+
|--------|-----------|-----------|--------|
47+
|[cwltool](https://github.com/common-workflow-language/cwltool)|Reference implementation of CWL|[![Build Status](https://ci.commonwl.org/job/cwltool-conformance/badge/icon)](http://ci.commonwl.org/job/cwltool-conformance/lastBuild/testReport/)|Linux, OS X, local execution only|
48+
|[Arvados](https://arvados.org)|Distributed computing platform for data analysis on massive data sets. [Using CWL on Arvados](http://doc.arvados.org/user/cwl/cwl-runner.html)|[![Build Status](https://ci.commonwl.org/job/arvados-conformance/badge/icon)](http://ci.commonwl.org/job/arvados-conformance/lastBuild/testReport/)|AWS, GCP, Azure, Slurm|
49+
|[Toil](https://github.com/BD2KGenomics/toil)|Toil is a workflow engine entirely written in Python.|[![Build Status](https://ci.commonwl.org/job/toil-conformance/badge/icon)](http://ci.commonwl.org/job/toil-conformance/lastBuild/testReport/)|AWS, Azure, GCP, Grid Engine, LSF, Mesos, OpenStack, Slurm|
50+
|[Rabix Bunny](https://github.com/rabix/bunny)|An open-source, Java-based implementation of Common Workflow Language with support for multiple drafts/versions. See [Rabix.io](http://rabix.io) for details.|[![Build Status](https://ci.commonwl.org/buildStatus/icon?job=rabix-conformance)](https://ci.commonwl.org/job/rabix-conformance/)|Linux, OS X, [GA4GH TES](https://github.com/ga4gh/task-execution-server) (experimental)|
51+
|[cwl-tes](https://github.com/common-workflow-language/cwl-tes)|CWL engine backended by the [GA4GH Task Execution API](https://github.com/ga4gh/task-execution-schemas)|[![Build Status](https://travis-ci.org/common-workflow-language/cwl-tes.svg?branch=master)](https://travis-ci.org/common-workflow-language/cwl-tes)|Local, GCP, AWS, HTCondor, Grid Engine, PBS/Torque, Slurm|
52+
|[Airflow](https://github.com/Barski-lab/incubator-airflow)|Airflow updated with CWL-runner feature (supported by BioWardrobe Team, CCHMC)|[![Build Status](https://ci.commonwl.org/buildStatus/icon?job=airflow-conformance)](https://ci.commonwl.org/job/airflow-conformance)|Linux, OS X|
53+
|[Consonance](https://github.com/Consonance/consonance)|orchestration tool for running SeqWare workflows and CWL tools|[pending](https://ci.commonwl.org/job/rabix-conformance/)|AWS, OpenStack, Azure|
54+
|[Apache Taverna](http://taverna.incubator.apache.org/)|Domain-independent Workflow Management System|[alpha](https://issues.apache.org/jira/browse/TAVERNA-900)|Java|
55+
|[Galaxy](https://galaxyproject.org/)|Web-based platform for data intensive biomedical research.|[alpha](https://github.com/common-workflow-language/galaxy)|Python|
56+
|[AWE](https://github.com/MG-RAST/AWE)|Workflow and resource management system for bioinformatics data analysis.|[alpha](https://github.com/wgerlach/AWE)|Go|
57+
|[Xenon](http://nlesc.github.io/Xenon/)|Run CWL workflows using Xenon|[alpha](https://github.com/NLeSC/xenon-cwl-runner)|[any Xenon backend](http://nlesc.github.io/Xenon/): local, ssh, SLURM, Torque, Grid Engine|
5458

5559

5660
## Repositories of CWL Tools and Workflows
@@ -71,8 +75,20 @@ Please cite https://dx.doi.org/10.6084/m9.figshare.3115156.v2
7175
|[pypi2cwl](https://github.com/common-workflow-language/pypi2cwl)|Automatically run argparse2cwl on any package in PyPi|
7276
|[cwlavro](https://github.com/common-workflow-language/cwlavro)|Java classes for loading CWL documents|
7377
|[acd2cwl](https://github.com/common-workflow-language/acd2cwl)|CWL generator for ACD (EMBOSS) files |
74-
|[CWLviewer](https://github.com/MarkRobbo/CWLViewer)|A web application to view and share Common Workflow Language workflows|
78+
|[CWLviewer](https://view.commonwl.org/)|A web application to view and share Common Workflow Language workflows|
79+
|[cwl2zshcomp](https://github.com/kloetzl/cwl2zshcomp)|generates ZSH auto completions from CWL command line tool descriptions|
80+
|[scriptcwl](https://github.com/NLeSC/scriptcwl)|Create CWL workflows by writing a simple Python script|
81+
|[python-cwlgen](https://github.com/common-workflow-language/python-cwlgen)|Generation of CWL programmatically from Python.|
82+
83+
## Projects the CWL community is participating in
7584

85+
|Name|Details|
86+
|-------|-----------|
87+
|[GA4GH Task Execution API](https://github.com/ga4gh/task-execution-schemas/)|a minimal common API for submitting a single job to a remote execution endpoint. Many contributions from CWL project participants.|
88+
|[GA4GH Workflow Execution API](https://github.com/ga4gh/workflow-execution-schemas)|a minimal common API for submitting workflow requests to workflow execution systems in a standardized way. Many contributions from CWL project participants.|
89+
|[Bio-compute objects](https://hive.biochemistry.gwu.edu/htscsrs?pageid=biocompute)|"a step towards evaluation and validation of bio-medical scientific computations", CWL and researchobject.org participants are cooperating with this effort|
90+
91+
<a name="Support"></a>
7692
## Support, Community and Contributing
7793

7894
The recommended place to ask a question about all things CWL is on
@@ -87,9 +103,6 @@ join the [mailing list common-workflow-language on Google Groups](https://groups
87103
[fork the repository](https://github.com/common-workflow-language/common-workflow-language)
88104
and send a pull request!
89105

90-
Your CWL Community Engineer, Michael R. Crusoe, publishes a blog about his work
91-
with updates at http://mrc.commonwl.org.
92-
93106
### Code of Conduct
94107

95108
The CWL Project is dedicated to providing a harassment-free experience for
@@ -114,11 +127,16 @@ Conduct](https://github.com/common-workflow-language/common-workflow-language/bl
114127
* [Institut Pasteur](http://www.pasteur.fr)
115128
* [Wellcome Trust Sanger Institute](https://www.sanger.ac.uk/)
116129
* [University of California Santa Cruz](https://cbse.soe.ucsc.edu/research/bioinfo)
117-
* [Harvard Chan School of Public Health](http://www.hsph.harvard.edu/)
130+
* [Harvard T.H. Chan School of Public Health](http://www.hsph.harvard.edu/)
118131
* [Cincinnati Children's Hospital Medical Center](http://www.cincinnatichildrens.org/)
119132
* [Broad Institute](https://www.broadinstitute.org)
120-
* [BioDatomics](http://www.biodatomics.com/)
121-
* [Wolfson Wohl Cancer Research Centre](http://www.gla.ac.uk/researchinstitutes/cancersciences/ics/facilities/wwcrc/)
133+
* [University of Melbourne Center for Cancer Research](https://umccr.github.io/)
134+
* [Netherlands eScience Center](https://www.esciencecenter.nl/)
135+
* [Texas Advanced Computing Center Life Science Computing Group](https://www.tacc.utexas.edu/life-sciences-computing) / [Agave Platform](https://agaveapi.co/)
136+
* [CyVerse](http://www.cyverse.org/)
137+
* [Institute for Systems Biology](https://www.systemsbiology.org/)
138+
* [ELIXIR Europe](https://www.elixir-europe.org/)
139+
* [BioExcel CoE](http://bioexcel.eu/)
122140

123141
## Individual Contributors
124142

@@ -131,15 +149,24 @@ Conduct](https://github.com/common-workflow-language/common-workflow-language/bl
131149
* Michael R. Crusoe <[email protected]>
132150
* Roman Valls Guimerà <[email protected]>
133151
* Guillermo Carrasco Hernandez <[email protected]>
152+
* Kenzo-Hugo Hillion <[email protected]>
134153
* Sinisa Ivkovic <[email protected]>
154+
* Sehrish Kanwal <[email protected]>
135155
* Andrey Kartashov <[email protected]>
136156
* John Kern <[email protected]>
157+
* Farah Zaib Khan <[email protected]>
137158
* Dan Leehr <[email protected]>
138159
* Hervé Ménager <[email protected]>
139160
* Maxim Mikheev <[email protected]>
161+
* Michael Miller <[email protected]>
140162
* Tim Pierce <[email protected]>
141163
* Josh Randall <[email protected]>
164+
* Mark Robinson <[email protected]>
142165
* Janko Simonović <[email protected]>
143-
* Stian Soiland-Reyes <soiland-reyes@cs.manchester.ac.uk>
166+
* Stian Soiland-Reyes <[email protected]>
144167
* Luka Stojanovic <[email protected]>
145168
* Nebojša Tijanić <[email protected]>
169+
170+
171+
The CWL Community Engineer, Michael R. Crusoe, publishes a blog about his work
172+
with updates at http://mrc.commonwl.org.

doc/cwl_v1.0_object_model.dia

8.22 KB
Binary file not shown.

0 commit comments

Comments
 (0)