WAQL-PP: Preprocessor for a Data Aggregation Query Language

This week I started to design and implement a preprocessor for the Web-service Aggregation Query Language (WAQL) which is an extension of XQuery. This language is used as part of the WS-Aggregation framework developed at the Distributed Systems Group of the Vienna University of Technology. With this text I want to explain the motivation behind WAQL and how the preprocessor will be designed. The motivation is nicely stated as part of my task description.

The key idea of WAQL is that it provides a convenience syntax for XQuery, which otherwise tends to become complex and hardly comprehensible in bigger scenarios. WAQL queries are transformed into valid XQuery expressions, which are finally executed by a (third-party) XQuery engine.

First of all we need to get a grasp of what the WAQL extensions to the XQuery language are. Since WAQL is still in its experimental stages, there is no exact specification of the language and it may change or grow over time. At the moment WAQL consists of two language constructs:

  • Template Lists: This extension tries to simplify the specification of generated inputs. It basically is syntactical sugar representing a XQuery for-loop construct and as such can be transformed easily.
  • Data Dependencies: This second extension is the interesting one, it can express dependencies between several different queries. The framework has to identify these dependencies and execute the queries in a valid order, so that all dependencies can be resolved.

The above two constructs should explain why the actual transformation has to be split into several phases which can be triggered by the framework at different points in time. The separate steps the preprocessor has to perform are as follows:

  1. Parsing: The textual WAQL query is parsed and an intermediate representation is constructed. Since WAQL is an extension which enhances the set of expressions for the XQuery language, the actual parser has to understand the full XQuery grammar. This may sound like a lot of work, but the XQuery specification provides a detailed description of the grammar in about 140 EBNF rules. So defining a valid parser is a doable job.
  2. Resolving of data dependencies: At this point the preprocessor has generated a list of all unresolved data dependencies. However the preprocessor has no idea which other queries are linked to the one currently being processed. So the actual resolving has to be done by the framework, the preprocessor just adapts the intermediate representation to the data provided by the framework.
  3. Transformation: Once all dependencies have been resolved the intermediate representation can be transformed back into a textual XQuery (without any WAQL extensions), which can then be passed on to a third-party XQuery engine.

Now that the basic operations are defined, we are able to give a rough description of the WAQL preprocessor and how it can be embedded into the existing framework. The two basic modules are a generated parser (obviously performing the parsing step) and a driving engine (performing the resolving and transformation steps). The parser will most certainly be generated using the JavaCC parser generator. The below graphic should explain the architecture.

Architecture of the WAQL preprocessor

Note that the above explanation is written from the compiler-constructor point of view, it just covers the preprocessor as part of the framework. All the other nasty details of WS-Aggregation are beyond the scope of this text. If you are interested you should read the paper or contact Waldemar Hummer who was kind enough to explain it to me. Also I will continue to write about the ongoing development of the preprocessor, so stay tuned.

Update: This text was crossposted to the DSG Praktika Blog as well.

Hi to every , since I am

Hi to every , since I am truly keen of reading this
website's post to be updated daily. It includes nice material.

Pingback

[...] of WAQL-PP, a WAQL Preprocessor for Java I was working on for the last two weeks. In one of the former posts I described the motivation behind this little project and how I planned to implement it. I’m [...]

Great article.

Great article.

Every one wishes to love hot

Every one wishes to love hot girls. They keep nurturing dream of dating a lovely Beirut escort girl.
But to the hard luck of many, beautiful girls have lot of followers behind them.
You might be lucky but chances are slim and competition is stiff.

whoah this weblog is

whoah this weblog is fantastic i like studying your posts.
Keep up the good work! You already know, many people are searching
around for this info, you can help them greatly.

What's up it's me, I am also

What's up it's me, I am also visiting this website regularly,
this site is in fact nice and the viewers are genuinely sharing
fastidious thoughts.

Hello colleagues, its

Hello colleagues, its enormous piece of writing regarding tutoringand fully defined, keep it up all the time.

Hi I am so glad I found your

Hi I am so glad I found your webpage, I really found
you by error, while I was browsing on Google for something
else, Anyhow I am here now and would just like to say thank you for a tremendous post and a all
round exciting blog (I also love the theme/design), I don't have time to read it all at the minute
but I have saved it and also included your RSS feeds, so when I have time I will
be back to read a lot more, Please do keep up the excellent job.

When someone writes an post

When someone writes an post he/she retains the plan of a user in his/her brain that how a
user can know it. Thus that's why this paragraph
is great. Thanks!

Ciekawy artykuł, ogólnie się

Ciekawy artykuł, ogólnie się z Tobą zgadzam, choć w kilku kwestiach bym
się kłóciła. Z pewnością Twój blog zasługuje na szacunek.
Z pewnością tu wrócę.

Good day! Wonderful post! I

Good day! Wonderful post! I enjoy the method that you outlined
Reply to comment | antforge.org. Amazing article and thus nice
document! Obviously that the new journalist is normally
qualified and contains a nice knowledge of developing.

Ought to have have a very art! I have to be very nearly in the
developing as you, except it’s certainly not these cup of tea .

It'll make me and my friends structure records furthermore articles by means of different businesses.
In case you are concerned with the following, look for lots of reviews
more income this one relationship youtube.com.
This website holds each day get a experienced producing company

Wow, amazing blog structure!

Wow, amazing blog structure! How lengthy have you ever been running a
blog for? you make blogging look easy. The full look of
your site is wonderful, as neatly as the content!

Everything is very open with

Everything is very open with a very clear description of the issues.
It was truly informative. Your site is extremely helpful. Thank you for sharing!

What's up all, here every

What's up all, here every person is sharing these experience,
therefore it's good to read this blog, and I used to visit
this weblog all the time.

Pingback

[...] post:  WAQL-PP: Preprocessor for a Data Aggregation Query Language … By admin | category: VIENNA University of Technology | tags: distributed, language, [...]