Compound transformation demo

• Example: compound transformation A call transformation B, A's input message part "raw" goes to B's input message part "raw".
• Attach a metadata to A describing the "calling" information

(http://vds.org/types/call, B_Key)

• Attach a metadata to A describing the data link information

(http://vds.org/types/hasLink, link1)

• Further attach metadata to the link metadata to specify the data link source and data link destination

(http://vds.org/types/hasSource, http://ANS::AInput/raw)
(http://vds.org/types/hasDestination, http://BNS::BInput/raw)

• Supported queries
  • Find all compound transformations that will call transformation T
  • Given a message part, where does it go to?
  • Given a message part, where does it come from?
  • Given a message part, in which compound tranformations does it appear?

• a GShell script publishes compound transformation calling and data flow information.

• Demo
  • Based on a text file that contains the information of a transformation (namespace, name, arguments with their types), a WSDL file describing the transformation signature is automatically generated.
  • For each transformation, a GShell script publishes the corresponding UDDI business/service, WSDL, metadata (e.g., the semantic type of a transformationa argument, or the quality of a transformation) to Grimoires.
  • The sample query in the paper "Virtual Data Grid Middleware Services for Data-Intensive Science"

Which TRs can process a subject image?
Q: xsearchvdc -q tr_meta dataType subject_image input
A: fMRIDC.AIR::align_warp

findEntityByMetadata

(dataType, subject_image)

align_warpInput

align_warp

• • In Grimoires service, attach metadata to metadata, find an entity by metadata where the entity is also a metadata.

• Utility developping
  • A batch scirpt publishes UDDI business/service/WSDL/metadata, and discovers a WSDL message part by metadata. The script uses GShell commands in the batch mode.
  • A Java program generates WSDL based on the transformation signature on the fly.

• XPath query performance in GT4 WS core
  • WS core does not index resource properties. Each time an XML dom tress is merged from RPs when doing XPath query.
  • Ways to improve the XPath query performance
    • Implement a new expression evaluator.
    • Implement a new operation provider.
  • MDS people has plan to improve the XPath query performance.
• Integrating Grimoires with MDS
  • Use Grimoires as an information provider for MDS
    • Having WSRFized Grimoires, this is straight forward. MDS index service can be set up so that it will fetch Grimoires RPs representing service descriptions.
  • Use MDS as an information provider for Grimoires
    • Map MDS service descriptions to Grimoires data model.
• Grimoires access control mechanism (to be filled by Victor)

• Mapping atomic VDS transformations to Grimoires data model
  • transformation -> UDDI service
  • transformation signature -> WSDL (transformation arguments -> WSDL message parts)
  • information in transformation catelog (name, site, location, type enumeration (src/bin), OS arch, profile) -> UDDI binding template with metadata attached
  • metadata will be attached to UDDI service (transformation) and WSDL message part (transformation argument).

• Mapping compound transformations to Grimoires data model
  • compound transformation -> UDDI service
  • DAG of compound transformation -> metadata attached to the above UDDI service
    • Link metadata? describes data flow from the source message part to the destination message part
    • We notice that the metadata structure will affect the query performance.
    • Possible queries against compound transformations:
      • who is the caller (who passes data to a transforamtion)?
      • who is the callee (who receives data from a transforamtion)?

• A lot of discussed issues are in the email prepared by Victor.

• Developped

Minutes for Jan 2006 ANL Soca Meeting

WSRFizing Grimoires

XPath query performance

Access control

Integrating Grimoires with VDS

Publishing and discovering atomic transformation

Data model mapping

Demo

GRIMOIRES SHELL

>run PublishBusiness
==== Publish a business ====
Input the business name:
MCS
Input the business description:
MCS, ANL
Business key[$0]: 9c855693-038e-4d65-a6b9-f87003fbc90a
>run PublishService
==== Publish a service ====
Input the service name:
reslice2
Input the service description:
reslice2 transformation
Input the business key:
$0
Input the service access point:
http://vds.org/services/reslice2
Input the service WSDL URL:
http://www.ecs.soton.ac.uk/~wf/grimoires/wsdl/reslice2.wsdl
Service key[$1]: 66eb50af-d4ca-48af-b249-e4f0cf10fa3b
>run PublishMetadata
What type of entity to annotate (keyedEntity, operation, or messagePart):
keyedEntity
==== Publish a metadata to a keyed entity ====
Input the entity key:
$1
Input the key type (business, service, or metadata):
service
Input the type (URI) of the metadata to describe the entity:
http://vds.org/types/Quality
Input the value of the metadata to describe the entity:
99
Metadata key[$2]: 3f4dca3e-3129-412f-910f-c8cff55ea35c
>run PublishWSDL
==== Publish a WSDL file ====
Input the WSDL URL:
http://www.ecs.soton.ac.uk/~wf/grimoires/wsdl/reslice2.wsdl
WSDL key[$3]: 6e885d5f-e213-4569-b996-aae715e3fc91
>run PublishMetadata
What type of entity to annotate (keyedEntity, operation, or messagePart):
messagePart
==== Publish a metadata to a message part ====
Input the message namespace:
http://www.example.org/reslice2/
Input the message name:
reslice2Input
Input the message part name:
airimg
Input the type (URI) of the metadata to describe the message part:
http://vds.org/types/DataType
Input the value of the metadata to describe the message part:
http://vds.org/values/subject_image
Metadata key[$4]: 575d3a81-488a-417b-8696-09e823837a4b
>run InquireMetadata
==== Inquire a metadata ====
Input the metadata type (URI):
http://vds.org/types/DataType
Input the metadata value:
http://vds.org/values/subject_image
==== Entity No. 0 ====
Found a message part with this metedata:
        (http://vds.org/types/DataType, http://vds.org/values/subject_image)
Message namespace: http://www.example.org/reslice2/
Message name: reslice2Input
Message part name: airimg
>

Publishing and discovering compound transformation

Data model mapping

Demo

>run PublishService
==== Publish a service ====
Input the service name:
workflow1
Input the service description:
a compound transformation
Input the business key:
$0
Input the service access point:

Input the service WSDL URL:

Service key[$10]: 00208813-ba24-4482-9b0d-2fbe3b4ff35a
>run PublishMetadata
What type of entity to annotate (keyedEntity, operation, or messagePart):
keyedEntity
==== Publish a metadata to a keyed entity ====
Input the entity key:
$10
Input the key type (business, service, or metadata):
service
Input the type (URI) of the metadata to describe the entity:
http://vds.org/types/Calling
Input the value of the metadata to describe the entity:
66eb50af-d4ca-48af-b249-e4f0cf10fa3b
Metadata key[$11]: 4a27d84f-5630-475f-8f93-8911a9d72c57
>run InquireService
==== Inquire a services ====
Input the service name:
reslice2
==== Service No. 0 ====
Service name: reslice2
Service key: 66eb50af-d4ca-48af-b249-e4f0cf10fa3b
Business key: 9c855693-038e-4d65-a6b9-f87003fbc90a
Service description: reslice2 transformation
Access point in binding template: http://vds.org/services/reslice2
tModel: http://www.ecs.soton.ac.uk/~wf/grimoires/wsdl/reslice2.wsdl
>run GetEntityMetadata
==== Get metadata of an entity ====
Input the entity key:
$10
Input the entity type (business or service):
service
==== Metadata 0 ====
Metadata key[$12]: 4a27d84f-5630-475f-8f93-8911a9d72c57
Author: null
Publication date: Tue Jan 10 14:48:57 CST 2006
Metadata type: http://vds.org/types/Calling
Metadata value: 66eb50af-d4ca-48af-b249-e4f0cf10fa3b
==== Metadata 1 ====
Metadata key[$13]: Auto-Anonymous
Author: Grimoires
Publication date: Tuesday, January 10, 2006 2:50:21 PM CST
Metadata type: http://www.grimoires.org/metadata/CurrentTime
Metadata value: Tuesday, January 10, 2006 2:50:21 PM CST
>run InquireMetadata
==== Inquire a metadata ====
Input the metadata type (URI):
http://vds.org/types/Calling
Input the metadata value:
66eb50af-d4ca-48af-b249-e4f0cf10fa3b
==== Entity No. 0 ====
Found a service with this metedata:
        (http://vds.org/types/Calling, 66eb50af-d4ca-48af-b249-e4f0cf10fa3b)
Service name: workflow1
Service key: 00208813-ba24-4482-9b0d-2fbe3b4ff35a
Business key: 9c855693-038e-4d65-a6b9-f87003fbc90a
Service description: a compound transformation
Access point in binding template:
tModel:
>