Diferenzas

Isto amosa as diferenzas entre a revisión seleccionada e a versión actual da páxina.

--- composit:wsc09 [2014/11/10 13:02] – [Purpose of this web document] pablo.rodriguez.mier
+++ composit:wsc09 [2014/11/20 17:19] (actual) – [Evaluation] pablo.rodriguez.mier
@@ Liña 37: / Liña 37: @@
 ===== Evaluation =====
+We tested different configurations to study their individual performance and the overall impact on composition response times. In particular, we used the following configurations:
+  - **SPARQL D/M**: pure //SPARQL// Discovery / Matchmaking where all interactions with the Service and Knowledge Base managers are directly implemented as //SPARQL// queries. This is the typical approach of discovery engines and was the original implementation of iServe.
+  - **Index. D/SPARQL+Cache M**: I/O service discovery is based on an index. We additionally used herein an intermediate cache at the level of the concept matcher in order to avoid issuing recurrent //SPARQL// queries.
+  - **Full Indexed D/M**: both service discovery and concept matchmaking relied on local indexes pre-populated at load time (and updated with writes). In this configuration, service discovery and concept matchmaking do not need to issue any //SPARQL// query to the backed.
+The forward graph generation time + optimizations (**G. time**) and the total number of SPARQL queries generated (**#SPARQL**) are shown for each of these configurations. Column
+"**Composition**" shows the graph size (**G. size (opt)**, measured as the number of services) after the optimizations, and the total composition time (**Comp. time**) of the optimal service composition search. The last column "**Sol. (serv./length)**" shows the size of the optimal solution found (services, length).
@@ Liña 46: / Liña 55: @@
 |  WSC'09/10 - D02  |  93          |  720.10                       |  38614    |  92.71                       |  17663    |  0.43                 |  0        |  43             |  0.03            |  20 / 6               |
 |  WSC'09/10 - D03  |  65          |  609.00                       |  18410    |  67.98                       |  12130    |  0.60                 |  0        |  13             |  0.01            |  10 / 3               |
-|  WSC'09/10 - D04  |  199         |  2871.60                      |  -        |  256.26                      |  47212    |  1.16                 |  0        |  118            |  >300            |  40 / 5               |
+|  WSC'09/10 - D04  |  199         |  2830.52                      |  120498   |  256.26                      |  47212    |  1.16                 |  0        |  118            |  >300            |  40 / 5               |
-|  WSC'09/10 - D05  |  216         |  5472.00                      |  181179   |                              |           |  4.63                 |  0        |  96             |  0.13            |  30 / 19              |
+|  WSC'09/10 - D05  |  216         |  5472.00                      |  181179   |  437.38                      |  78018    |  4.63                 |  0        |  96             |  0.13            |  30 / 19              |
+All datasets were solved with optimal values for composition length and number of services, showing a similar scalability as observed in the WSC'08 datasets (see graph below).
+{{:composit:wsc09-tsc-results.png?nolink|}}