<<O>>  Difference Topic Karma2 (r1.5 - 22 Feb 2007 - YogeshSimmhan)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Template

Line: 7 to 7

Participating Team

  • Short team name: Karma
Changed:
<
<
  • Participant names: Yogesh L. Simmhan, Srinath Perera, Suresh Marru, Satoshi Shirasuna, Beth Plale, Dennis Gannon
>
>
  • Participant names: Yogesh L. Simmhan, Suresh Marru, Srinath Perera, Satoshi Shirasuna, Beth Plale, Dennis Gannon

Line: 34 to 34

Provenance Activities (Provenance Data to Import)

Each activity is a individual XML document. For convenience, they have been concatenated into a single XML document under a single root element for each workflow.
Changed:
<
<
  • [[][Stage I Provenance Activities]]
>
>

Changed:
<
<
  • [[][Stage II Provenance Activities]]
>
>

Changed:
<
<
  • [[][Stage III Provenance Activities]]
>
>

Changed:
<
<
  • [[][Modified Stage III Provenance Activities]] (stages I and II activities do not change)
>
>

Changed:
<
<
(For an example of a provenance view that is generated in Karma from these activities, see [[][Stage I WorkflowTrace?]], [[Stage II WorkflowTrace?][]], and [[Stage III WorkflowTrace?][]]. These views are for sample only and not expected to be used for importing.)
>
>
(For an example of a provenance view that is generated in Karma from these activities, see Stage I WorkflowTrace, Stage II WorkflowTrace, Stage III WorkflowTrace, and Alternate Stage III WorkflowTrace. These views are for sample only and not expected to be used for importing.)

Provenance Activity Description & Utilities

Here is a description of the key provenance activities that can help with importing the data. The activity types described here encapsulate all information required to answer the Challenge queries. Other activity types present in the dump above are useful for more complex querying and monitoring requirements.
Line: 65 to 65

  • Sending Result : This is produced when the response message of the invocation sent by the service instance to the receiver (client). Other than default fields, it contains an optional result header and result body elements for putting the SOAP (or equivalent) response Header and Body.
  • Service/Workflow Terminated : Decribes a service or workflow instance that is shutting down.
Changed:
<
<
Karma libraries? are available for reading the XML activities as Apache XML Bean objects in Java.
>
>
Karma libraries are available for reading the XML activities as Apache XML Bean objects in Java.

Model Integration Results

Line: 87 to 87

Provide here your conclusions on the challenge, and issues that you like to see discussed at a face to face meeting.

Changed:
<
<
-- YogeshSimmhan - 18 Feb 2007
>
>
-- YogeshSimmhan - 22 Feb 2007

META FILEATTACHMENT challenge2-Part-I.png attr="h" comment="Workflow Image for Part-I" date="1172080134" path="challenge2-Part-I.png" size="29027" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-II.png attr="h" comment="Workflow Image for Part-II" date="1172080146" path="challenge2-Part-II.png" size="12213" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III.png attr="h" comment="Workflow Image for Part-III" date="1172080157" path="challenge2-Part-III.png" size="16841" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Alternate.png attr="h" comment="Workflow Image for Part-III (Alternate for Q7)" date="1172080196" path="challenge2-Part-III-Alternate.png" size="20188" user="YogeshSimmhan" version="1.1"
Changed:
<
<
META FILEATTACHMENT challenge2-Part-I.xwf attr="" comment="Workflow Document for Part-I (Viewable in XBaya)" date="1172080276" path="challenge2-Part-I.xwf" size="152775" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-II.xwf attr="" comment="Workflow Document for Part-II (Viewable in XBaya)" date="1172080294" path="challenge2-Part-II.xwf" size="91369" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III.xwf attr="" comment="Workflow Document for Part-III (Viewable in XBaya)" date="1172080307" path="challenge2-Part-III.xwf" size="110796" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Alternate.xwf attr="" comment="Workflow Document for Part-III-Alternate for Q7(Viewable in XBaya)" date="1172080335" path="challenge2-Part-III-Alternate.xwf" size="127839" user="YogeshSimmhan" version="1.1"
>
>
META FILEATTACHMENT challenge2-Part-I.xwf attr="h" comment="Workflow Document for Part-I (Viewable in XBaya)" date="1172108758" path="challenge2-Part-I.xwf" size="138090" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-II.xwf attr="h" comment="Workflow Document for Part-II (Viewable in XBaya)" date="1172108779" path="challenge2-Part-II.xwf" size="54549" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-III.xwf attr="h" comment="Workflow Document for Part-III (Viewable in XBaya)" date="1172108798" path="challenge2-Part-III.xwf" size="110800" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-III-Alternate.xwf attr="h" comment="Workflow Document for Part-III (Viewable in XBaya)" date="1172111580" path="challenge2-Part-III-Alternate.xwf" size="127735" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-I-Activities.xml attr="" comment="Provenance Activities for Workflow Part-I" date="1172110976" path="challenge2-Part-I-Activities.xml" size="115858" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-II-Activities.xml attr="" comment="Provenance Activities for Workflow Part-II" date="1172108905" path="challenge2-Part-II-Activities.xml" size="29934" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Activities.xml attr="" comment="Provenance Activities for Workflow Part-III" date="1172113880" path="challenge2-Part-III-Activities.xml" size="66776" user="YogeshSimmhan" version="1.3"
META FILEATTACHMENT challenge2-Part-III-Alternate-Activities.xml attr="" comment="Provenance Activities for Workflow Part-III-Alternate for Q7" date="1172108971" path="challenge2-Part-III-Alternate-Activities.xml" size="134952" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-I-Trace.xml attr="h" comment="Sample Provenance Trace for Workflow Part-I" date="1172109002" path="challenge2-Part-I-Trace.xml" size="14815" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-II-Trace.xml attr="h" comment="Sample Provenance Trace for Workflow Part-II" date="1172109014" path="challenge2-Part-II-Trace.xml" size="4350" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Trace.xml attr="h" comment="Sample Provenance Trace for Workflow Part-III" date="1172114016" path="challenge2-Part-III-Trace.xml" size="8211" user="YogeshSimmhan" version="1.2"
META FILEATTACHMENT challenge2-Part-III-Alternate-Trace.xml attr="h" comment="Sample Provenance Trace for Workflow Part-III-Alternate for Q7" date="1172109037" path="challenge2-Part-III-Alternate-Trace.xml" size="12057" user="YogeshSimmhan" version="1.1"
 <<O>>  Difference Topic Karma2 (r1.4 - 21 Feb 2007 - YogeshSimmhan)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Template

Line: 24 to 24

Workflow Model

  Workflow Part-I Workflow Part-II Workflow Part-III Workflow Part-III-Alternate
| Image |
Changed:
<
<
Workflow Image for Part-I | Workflow Image for Part-II | Workflow Image for Part-III | Workflow Image for Part-III (Alternate for Q7) |
>
>
Workflow Image for Part-I | Workflow Image for Part-II | Workflow Image for Part-III | Workflow Image for Part-III (Alternate for Q7) |

XBaya Document challenge2-Part-I.xwf challenge2-Part-II.xwf challenge2-Part-III.xwf challenge2-Part-III-Alternate.xwf

You can view the documents in the XBaya Workflow Composer [a java web Start application].

Line: 46 to 46

Provenance Activity Description & Utilities

Here is a description of the key provenance activities that can help with importing the data. The activity types described here encapsulate all information required to answer the Challenge queries. Other activity types present in the dump above are useful for more complex querying and monitoring requirements.
Changed:
<
<
  • Service/Workflow Initialized :
  • Service/Workflow Invoked :
  • Data Consumed :
  • Data Produced :
  • Sending Result :
  • Service/Workflow Terminated :
>
>

In our model, we make a distinction between and abstract service and a service instance. Workflows are composed by connecting abstract services, while instances of services are used during workflow invocation through late binding. Service instances are identified using a globally unique 'serviceID'. Workflows are also considered as a type of service. Hence, you can compose an abstract workflow out of abstract services and out of other abstract workflows. Workflow instances also have a globally unique 'serviceID' that identifies the workflow instance. Data products are identified by a globally unique ID and they optionally have a replica URL associated with them when they appear in activities.

Service instances are usually invoked in the context of a workflow. An invocation is identified by 4 parts:

  1. the serviceID of the service being invoked,
  2. the (parent) workflow instance in whose context this invocation takes place is identified using the 'workflowID' attribute (whose value equals the serviceID for the workflow),
  3. the 'workflowTimestep' gives a logical time for the service invocation in the workflow lifecycle, and
  4. the 'workflowNodeID' uniquely identifies a node in the workflow graph (the same abstract service used multiple times in an abstract workflow will have different workflowNodeIDs).

All activities have these 4-IDs set as the notification source for that activity. They also optionally have the ID for the client that invokes this service/receives the response. All activities have a timestamp file that gives the time at which they were generated, a human readable description, and an optional XML 'annotation' field for extensions.

Some key activities in a workflow's lifecycle (in order of generation) are:

  • Service/Workflow Initialized : These activities are generated at the start of a workflow instance or a service instance. These are generated only if a new instance is created, so they may not be published for all workflow runs if a compatible service/workflow instance was already available. Since these activities are not generated in the context of a service/workflow invocation (since it can be reused by multiple workflows), the notification source for this activity only has the serviceID field set.
  • Service/Workflow Invoked : An invocation consists of a request message and an optional response message, depending on the message exchange pattern. For the challenge workflows, both are present. The Service/Workflow Invoked activity is produced when the request message of the invocation is received by the service instance. Other than default fields, it contains an optional request header and request body elements for putting the SOAP (or equivalent) request Header and Body.
  • Data Consumed : Describes a data product that is used by this invocation. Provides better guarantees than looking for data IDs in SOAP messages.
  • Data Produced : Describes a data product that is generated by this invocation.
  • Sending Result : This is produced when the response message of the invocation sent by the service instance to the receiver (client). Other than default fields, it contains an optional result header and result body elements for putting the SOAP (or equivalent) response Header and Body.
  • Service/Workflow Terminated : Decribes a service or workflow instance that is shutting down.

Karma libraries? are available for reading the XML activities as Apache XML Bean objects in Java.

 <<O>>  Difference Topic Karma2 (r1.3 - 21 Feb 2007 - YogeshSimmhan)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Template

Line: 9 to 9

  • Short team name: Karma
  • Participant names: Yogesh L. Simmhan, Srinath Perera, Suresh Marru, Satoshi Shirasuna, Beth Plale, Dennis Gannon
  • Project URL: http://www.extreme.indiana.edu/karma
Changed:
<
<
>
>

Differences from First Challenge

Note here any changes in your provenance representation, workflow enactment or system since the first challenge. Alternatively, if you did not participate in the first challenge, please provide the same details as were required for those who did (particularly workflow representation and provenance representation).

Added:
>
>
Karma has a provenance collection part in the form of provenance activities collected from workflow executions and a provenance dissemination part in the form of views generated from the activities. In the First Challenge, we exposed the views of the provenance collected, such as Workflow Trace and Data Provenance. The views were themselves not sufficient to answer all queries and the actual provenance activities are necessary. Hence, in addition to the provenance views, we are also submitting the provenance activities we collect that gives the complete description for the workflow run that has sufficient information to answer all queries.

Provenance Data for Workflow Parts

Give links here to your provenance data files for the workflow parts of the challenge: three parts for the original workflow and three parts for the modified workflow (as per provenance query 7). The data files could be attached to the results page.

Added:
>
>

Workflow Model

  Workflow Part-I Workflow Part-II Workflow Part-III Workflow Part-III-Alternate
Image Workflow Image for Part-I Workflow Image for Part-II Workflow Image for Part-III Workflow Image for Part-III (Alternate for Q7)
XBaya Document challenge2-Part-I.xwf challenge2-Part-II.xwf challenge2-Part-III.xwf challenge2-Part-III-Alternate.xwf

You can view the documents in the XBaya Workflow Composer [a java web Start application].

Provenance Activities (Provenance Data to Import)

Each activity is a individual XML document. For convenience, they have been concatenated into a single XML document under a single root element for each workflow.
  • [[][Stage I Provenance Activities]]

  • [[][Stage II Provenance Activities]]

  • [[][Stage III Provenance Activities]]

  • [[][Modified Stage III Provenance Activities]] (stages I and II activities do not change)

(For an example of a provenance view that is generated in Karma from these activities, see [[][Stage I WorkflowTrace?]], [[Stage II WorkflowTrace?][]], and [[Stage III WorkflowTrace?][]]. These views are for sample only and not expected to be used for importing.)

Provenance Activity Description & Utilities

Here is a description of the key provenance activities that can help with importing the data. The activity types described here encapsulate all information required to answer the Challenge queries. Other activity types present in the dump above are useful for more complex querying and monitoring requirements.
  • Service/Workflow Initialized :
  • Service/Workflow Invoked :
  • Data Consumed :
  • Data Produced :
  • Sending Result :
  • Service/Workflow Terminated :

Karma libraries? are available for reading the XML activities as Apache XML Bean objects in Java.


Model Integration Results

State here which combinations of teams' models you have managed to perform the provenance query over

Line: 41 to 77

-- YogeshSimmhan - 18 Feb 2007

Added:
>
>
META FILEATTACHMENT challenge2-Part-I.png attr="h" comment="Workflow Image for Part-I" date="1172080134" path="challenge2-Part-I.png" size="29027" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-II.png attr="h" comment="Workflow Image for Part-II" date="1172080146" path="challenge2-Part-II.png" size="12213" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III.png attr="h" comment="Workflow Image for Part-III" date="1172080157" path="challenge2-Part-III.png" size="16841" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Alternate.png attr="h" comment="Workflow Image for Part-III (Alternate for Q7)" date="1172080196" path="challenge2-Part-III-Alternate.png" size="20188" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-I.xwf attr="" comment="Workflow Document for Part-I (Viewable in XBaya)" date="1172080276" path="challenge2-Part-I.xwf" size="152775" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-II.xwf attr="" comment="Workflow Document for Part-II (Viewable in XBaya)" date="1172080294" path="challenge2-Part-II.xwf" size="91369" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III.xwf attr="" comment="Workflow Document for Part-III (Viewable in XBaya)" date="1172080307" path="challenge2-Part-III.xwf" size="110796" user="YogeshSimmhan" version="1.1"
META FILEATTACHMENT challenge2-Part-III-Alternate.xwf attr="" comment="Workflow Document for Part-III-Alternate for Q7(Viewable in XBaya)" date="1172080335" path="challenge2-Part-III-Alternate.xwf" size="127839" user="YogeshSimmhan" version="1.1"
 <<O>>  Difference Topic Karma2 (r1.2 - 20 Feb 2007 - YogeshSimmhan)

META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Template

Line: 7 to 7

Participating Team

  • Short team name: Karma
Changed:
<
<
  • Participant names: Yogesh L. Simmhan, Beth Plale, Dennis Gannon
>
>
  • Participant names: Yogesh L. Simmhan, Srinath Perera, Suresh Marru, Satoshi Shirasuna, Beth Plale, Dennis Gannon

 <<O>>  Difference Topic Karma2 (r1.1 - 18 Feb 2007 - YogeshSimmhan)
Line: 1 to 1
Added:
>
>
META TOPICPARENT ParticipatingTeams

Second Provenance Challenge Template

Participating Team

Differences from First Challenge

Note here any changes in your provenance representation, workflow enactment or system since the first challenge. Alternatively, if you did not participate in the first challenge, please provide the same details as were required for those who did (particularly workflow representation and provenance representation).

Provenance Data for Workflow Parts

Give links here to your provenance data files for the workflow parts of the challenge: three parts for the original workflow and three parts for the modified workflow (as per provenance query 7). The data files could be attached to the results page.

Model Integration Results

State here which combinations of teams' models you have managed to perform the provenance query over

Translation Details

Describe details regarding how data models were translated (or otherwise used to answer the query following the team's approach), any data which was absent from a downloaded model, and whether this affected the possibility of translation or successful provenance query, and any data which was excluded in translation from a downloaded model because it was extraneous

Benchmarks

Describe your proposed benchmark queries, how the comparable quantities are determined, and the results of applying the benchmark to your own system

Further Comments

Provide here further comments.

Conclusions

Provide here your conclusions on the challenge, and issues that you like to see discussed at a face to face meeting.

-- YogeshSimmhan - 18 Feb 2007

View topic | Diffs | r1.5 | > | r1.4 | > | r1.3 | More
Revision r1.1 - 18 Feb 2007 - 22:38 - YogeshSimmhan
Revision r1.5 - 22 Feb 2007 - 02:16 - YogeshSimmhan