<<O>>  Difference Topic MyGrid2 (r1.5 - 22 Jun 2007 - QiuweiYu)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Page

Line: 8 to 8

Participating Team

  • Short team name: myGrid
Changed:
<
<
  • Participant names: Qiuwei Yu, Carole Goble, Robert Steven, Daniele Turi (University of Manchester)
>
>
  • Participant names: Qiuwei Yu, Katy Wolstencroft, Khalid Belhajjame, Carole Goble, Robert Steven, Daniele Turi (University of Manchester)

Line: 36 to 36

Changed:
<
<

In order to produce the complete provenance for part2 and part3, extra constant processors (such as ReslicedImages?, ReslicedHeaders?, AtlasImage? and AtlasHeader?) were used to carry the results from one workflow to another. For this reason, each part of the provenance RDF contains:

>
>
In order to produce the complete provenance for part2 and part3, extra constant processors (such as ReslicedImages, ReslicedHeaders, AtlasImage and AtlasHeader) were used to carry the results from one workflow to another. For this reason, each part of the provenance RDF contains:

  • Part 1: align_warp and reslice.
Line: 76 to 75

Changed:
<
<
Compared with the provenance of the primary workflow runs, these documents contain the same processors except each _Italic_convert processor has been replaced with two new processors, _Italic_pgmtoppm and then _Italic_pnmtojpeg, in order to convert from PGM to JPEG in workflow Part 3. The difference is documented in the adaptation specified by Query 7 and on our first challenge results page which associated with Provenance Query 7.

Model Integration Results

State here which combinations of teams' models you have managed to perform the provenance query over

Translation Details

Describe details regarding how data models were translated (or otherwise used to answer the query following the team's approach), any data which was absent from a downloaded model, and whether this affected the possibility of translation or successful provenance query, and any data which was excluded in translation from a downloaded model because it was extraneous

Benchmarks

Describe your proposed benchmark queries, how the comparable quantities are determined, and the results of applying the benchmark to your own system

Further Comments

Provide here further comments.

Conclusions

Provide here your conclusions on the challenge, and issues that you like to see discussed at a face to face meeting.

>
>
Compared with the provenance of the primary workflow runs, these documents contain the same processors except each convert processor has been replaced with two new processors, pgmtoppm and then pnmtojpeg, in order to convert from PGM to JPEG in workflow Part 3. The difference is documented in the adaptation specified by Query 7 and on our first challenge results page which associated with Provenance Query 7.

META FILEATTACHMENT provenanceassertedmodelgraph.png attr="" comment="Provenance Ontology" date="1171896628" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceOntology\provenance asserted model graph.png" size="54703" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallengePart1?.png attr="" comment="Workflow Part1 Diagram" date="1171896704" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\SC_WFs\Workflow Diagrams\SecondChallengePart1.png" size="4764" user="QiuweiYu" version="1.1"
 <<O>>  Difference Topic MyGrid2 (r1.4 - 21 Jun 2007 - QiuweiYu)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Page

Line: 14 to 14

Differences from First Challenge

Changed:
<
<
Note here any changes in your provenance representation, workflow enactment or system since the first challenge. Alternatively, if you did not participate in the first challenge, please provide the same details as were required for those who did (particularly workflow representation and provenance representation).
>
>
We implemented some sample Web Services for the processors (such as align_warp, reslice, slice, softmean and convert) rather than using beanshell scripts in the workflow. We also demostrated three different approaches to create the Second Provenance Challenge workflow in Taverna for best practice.

Provenance Data for Workflow Parts

Line: 29 to 29

The provenance for the three parts of the primary workflow (which are also recorded with required annotations for query 8 and query 9) are as follows:
Changed:
<
<
>
>

Changed:
<
<
>
>

Changed:
<
<
>
>

Changed:
<
<

In order to produce the complete provenance for part2 and part3, repeated processors which include reslice and softmean were used. Based on our provenance schema and original workflow designed in Taveran workbench (see our first challenge results page), for each part of the exported provenance, the output data of the previous part is the input of the next part. Some of the specially designed ‘beanshell’ processors also contain their own output data. Since the original workflow has been split into three parts, these 'bridging' processors must be repeated at the start of parts 2 and 3 which take the output data from in the previous workflow part. For this reason, each part of the provenance RDF contains:

>
>
In order to produce the complete provenance for part2 and part3, extra constant processors (such as ReslicedImages?, ReslicedHeaders?, AtlasImage? and AtlasHeader?) were used to carry the results from one workflow to another. For this reason, each part of the provenance RDF contains:

  • Part 1: align_warp and reslice.
Changed:
<
<
    • Workflow Part1 Diagram
>
>
    • Workflow Part1 Diagram

    • Figure 2 - Part 1 of the Primary Workflow
Changed:
<
<
>
>

Changed:
<
<
    • Workflow Part2 Diagram
>
>
    • Workflow Part2 Diagram

    • Figure 3 - Part 2 of the Primary Workflow

    • reslice (as processors in the part 1) are re-used as data stores to pass values of ReslicedImage and ReslicedHeader into softmean in part 2, reslice can also be viewed as the softmean inputs in part 2.
Changed:
<
<
>
>

Changed:
<
<
    • Workflow Part3 Diagram
>
>
    • Workflow Part3 Diagram

    • Figure 4 - Part 3 of the Primary Workflow
Line: 70 to 69

The provenance for the three parts of the secondary workflow (which has been modified as per for query 7) are as follows:
Changed:
<
<

>
>

Changed:
<
<
>
>

Added:
>
>

Compared with the provenance of the primary workflow runs, these documents contain the same processors except each _Italic_convert processor has been replaced with two new processors, _Italic_pgmtoppm and then _Italic_pnmtojpeg, in order to convert from PGM to JPEG in workflow Part 3. The difference is documented in the adaptation specified by Query 7 and on our first challenge results page which associated with Provenance Query 7.

Line: 101 to 99

Provide here your conclusions on the challenge, and issues that you like to see discussed at a face to face meeting.

Deleted:
<
<
-- QiuweiYu - 19 Feb 2007

META FILEATTACHMENT provenanceassertedmodelgraph.png attr="" comment="Provenance Ontology" date="1171896628" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceOntology\provenance asserted model graph.png" size="54703" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallengePart1?.png attr="" comment="Workflow Part1 Diagram" date="1171896704" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\SC_WFs\Workflow Diagrams\SecondChallengePart1.png" size="4764" user="QiuweiYu" version="1.1"
Line: 114 to 111

META FILEATTACHMENT SecondChallenge?_myGrid_Q7_Part2.rdf attr="" comment="Secondary Workflow Part2" date="1171896978" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Q7_Part2.rdf" size="24995" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Q7_Part3.rdf attr="" comment="Secondary Workflow Part3" date="1171896994" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Q7_Part3.rdf" size="46181" user="QiuweiYu" version="1.1"
META FILEATTACHMENT ResliceAndSoftmean?.txt attr="" comment="reslice and softmean" date="1171899749" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ResliceAndSoftmean.txt" size="547" user="QiuweiYu" version="1.1"
Added:
>
>
META FILEATTACHMENT Primary_WF_Part1.rdf attr="" comment="" date="1182443082" path="Primary_WF_Part1.rdf" size="95218" user="QiuweiYu" version="1.1"
META FILEATTACHMENT Primary_WF_Part2.rdf attr="" comment="" date="1182443112" path="Primary_WF_Part2.rdf" size="40177" user="QiuweiYu" version="1.1"
META FILEATTACHMENT Primary_WF_Part3.rdf attr="" comment="" date="1182443134" path="Primary_WF_Part3.rdf" size="46235" user="QiuweiYu" version="1.1"
META FILEATTACHMENT Secondary_WF_Part1.rdf attr="" comment="" date="1182443150" path="Secondary_WF_Part1.rdf" size="93708" user="QiuweiYu" version="1.1"
META FILEATTACHMENT Secondary_WF_Part2.rdf attr="" comment="" date="1182443160" path="Secondary_WF_Part2.rdf" size="40191" user="QiuweiYu" version="1.1"
META FILEATTACHMENT Secondary_WF_Part3.rdf attr="" comment="" date="1182443169" path="Secondary_WF_Part3.rdf" size="56924" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_PrimaryWF_Part1.png attr="" comment="" date="1182443189" path="SPC_PrimaryWF_Part1.png" size="10263" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_PrimaryWF_Part2.png attr="" comment="" date="1182443202" path="SPC_PrimaryWF_Part2.png" size="5493" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_PrimaryWF_Part3.png attr="" comment="" date="1182443218" path="SPC_PrimaryWF_Part3.png" size="4871" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_SecondaryWF_Part2.png attr="" comment="" date="1182443230" path="SPC_SecondaryWF_Part2.png" size="5519" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_SecondaryWF_Part1.png attr="" comment="" date="1182443241" path="SPC_SecondaryWF_Part1.png" size="10299" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SPC_SecondaryWF_Part3.png attr="" comment="" date="1182443253" path="SPC_SecondaryWF_Part3.png" size="5595" user="QiuweiYu" version="1.1"
META FILEATTACHMENT InputAndOutputConnections?.txt attr="" comment="" date="1182443272" path="InputAndOutputConnections.txt" size="829" user="QiuweiYu" version="1.1"
 <<O>>  Difference Topic MyGrid2 (r1.3 - 19 May 2007 - QiuweiYu)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Page

Line: 8 to 8

Participating Team

  • Short team name: myGrid
Changed:
<
<
  • Participant names: Qiuwei Yu, Carole Goble, Daniele Turi (University of Manchester)
>
>
  • Participant names: Qiuwei Yu, Carole Goble, Robert Steven, Daniele Turi (University of Manchester)

 <<O>>  Difference Topic MyGrid2 (r1.2 - 19 Feb 2007 - QiuweiYu)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Page

This is the Second Provenance Challenge page for the University of Manchester myGrid team.
Added:
>
>

Participating Team

Differences from First Challenge

Note here any changes in your provenance representation, workflow enactment or system since the first challenge. Alternatively, if you did not participate in the first challenge, please provide the same details as were required for those who did (particularly workflow representation and provenance representation).

Provenance Data for Workflow Parts

Our metadata and provenance is managed through a NG4J named graph, and we have used TriQL queries to complete the first provenance challenge. In order to meet the requirement of phrase one, our provenance data were collected in the XML notation and are provided as RDF (Resource Description Framework) files. Figure1 graphically presents the schema (also called the data model). This schema also shared under http://www.cs.man.ac.uk/~yuq/SecondChallenge/ProvenanceOntology/.

    • Provenance Ontology
    • Figure 1 Provenance ontology abstract view in Protégé

The provenance for the three parts of the primary workflow (which are also recorded with required annotations for query 8 and query 9) are as follows:

In order to produce the complete provenance for part2 and part3, repeated processors which include reslice and softmean were used. Based on our provenance schema and original workflow designed in Taveran workbench (see our first challenge results page), for each part of the exported provenance, the output data of the previous part is the input of the next part. Some of the specially designed ‘beanshell’ processors also contain their own output data. Since the original workflow has been split into three parts, these 'bridging' processors must be repeated at the start of parts 2 and 3 which take the output data from in the previous workflow part. For this reason, each part of the provenance RDF contains:

  • Part 1: align_warp and reslice.

    • Workflow Part1 Diagram
    • Figure 2 - Part 1 of the Primary Workflow

    • Workflow Part2 Diagram
    • Figure 3 - Part 2 of the Primary Workflow

    • reslice (as processors in the part 1) are re-used as data stores to pass values of ReslicedImage and ReslicedHeader into softmean in part 2, reslice can also be viewed as the softmean inputs in part 2.

    • Workflow Part3 Diagram
    • Figure 4 - Part 3 of the Primary Workflow

    • The softmean processor in part 2 exists to carry part of the slicer inputs to part 3. In our original workflow softmean is responsible for holding the values of AtlasImage and AtlasHeader as data stores which need to be passed into slicer in part 3.

The provenance for the three parts of the secondary workflow (which has been modified as per for query 7) are as follows:

Compared with the provenance of the primary workflow runs, these documents contain the same processors except each _Italic_convert processor has been replaced with two new processors, _Italic_pgmtoppm and then _Italic_pnmtojpeg, in order to convert from PGM to JPEG in workflow Part 3. The difference is documented in the adaptation specified by Query 7 and on our first challenge results page which associated with Provenance Query 7.

Model Integration Results

State here which combinations of teams' models you have managed to perform the provenance query over

Translation Details

Describe details regarding how data models were translated (or otherwise used to answer the query following the team's approach), any data which was absent from a downloaded model, and whether this affected the possibility of translation or successful provenance query, and any data which was excluded in translation from a downloaded model because it was extraneous

Benchmarks

Describe your proposed benchmark queries, how the comparable quantities are determined, and the results of applying the benchmark to your own system

Further Comments

Provide here further comments.

Conclusions

Provide here your conclusions on the challenge, and issues that you like to see discussed at a face to face meeting.

-- QiuweiYu - 19 Feb 2007

META FILEATTACHMENT provenanceassertedmodelgraph.png attr="" comment="Provenance Ontology" date="1171896628" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceOntology\provenance asserted model graph.png" size="54703" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallengePart1?.png attr="" comment="Workflow Part1 Diagram" date="1171896704" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\SC_WFs\Workflow Diagrams\SecondChallengePart1.png" size="4764" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallengePart2?.png attr="" comment="Workflow Part2 Diagram" date="1171896741" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\SC_WFs\Workflow Diagrams\SecondChallengePart2.png" size="925" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallengePart3?.png attr="" comment="Workflow Part3 Diagram" date="1171896766" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\SC_WFs\Workflow Diagrams\SecondChallengePart3.png" size="3854" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Part1.rdf attr="" comment="Primary Workflow Part1" date="1171896846" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Part1.rdf" size="67991" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Part2.rdf attr="" comment="Primary Workflow Part2" date="1171896888" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Part2.rdf" size="24987" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Part3.rdf attr="" comment="Primary Workflow Part3" date="1171896906" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Part3.rdf" size="37012" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Q7_Part1.rdf attr="" comment="Secondary Workflow Part1" date="1171896956" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Q7_Part1.rdf" size="68353" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Q7_Part2.rdf attr="" comment="Secondary Workflow Part2" date="1171896978" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Q7_Part2.rdf" size="24995" user="QiuweiYu" version="1.1"
META FILEATTACHMENT SecondChallenge?_myGrid_Q7_Part3.rdf attr="" comment="Secondary Workflow Part3" date="1171896994" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ProvenanceData\SecondChallenge_myGrid_Q7_Part3.rdf" size="46181" user="QiuweiYu" version="1.1"
META FILEATTACHMENT ResliceAndSoftmean?.txt attr="" comment="reslice and softmean" date="1171899749" path="C:\Documents and Settings\sky\Desktop\Provenance Challenge 2\Phrase one\ResliceAndSoftmean.txt" size="547" user="QiuweiYu" version="1.1"
 <<O>>  Difference Topic MyGrid2 (r1.1 - 16 Feb 2007 - QiuweiYu)
Line: 1 to 1
Added:
>
>
META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Page

This is the Second Provenance Challenge page for the University of Manchester myGrid team.
View topic | Diffs | r1.5 | > | r1.4 | > | r1.3 | More
Revision r1.1 - 16 Feb 2007 - 23:46 - QiuweiYu
Revision r1.5 - 22 Jun 2007 - 10:25 - QiuweiYu