scandipwa / persisted-query

scandipwa/persisted-query

ScandiPWA persisted query module

magento2-module Compatibility: 2.4.7 Code Quality: Fail Tests: N/A Security: Pass OSL-3.0

Are you the maintainer of scandipwa?

Packagento pulls scandipwa's Composer packages from the public registry so buyers can find them here.

Claim the namespace to take ownership, publish new releases directly, and start charging for premium versions.

Claim this namespace →

ScandiPWA persisted query

The main goal of persisted query approach is to reduce the amount of data transfered from the client to the server within a POST body containing GraphQl Document.
However, current module extends the usage of persisted queries to actually cache the responses in Varnish or CDN node
for fast responses. (avg. 5ms vs 5000ms on dev machine)

Prerequisites

  1. Varnish
  2. Redis
  3. PHP ext-phpredis is suggested for faster serialization and deserialization

Config

magento setup:config:set

For the convenience there are additional flags available for php bin/magento setup:config:set command:

--pq-host[mandatory] - persisted query redis host (redis for ScandiPWA docker setup)

--pq-port[mandatory] - persisted query redis port (6379 for ScandiPWA docker setup)

--pq-database[mandatory] - persisted query redis database (5 for ScandiPWA docker setup)

--pq-scheme[mandatory] - persisted query redis scheme

--pq-password[optional, empty password is not allowed] - persisted query redis password

Manual configuration

Configuration for custom Redis storage, where hashes and GraphQl documents are kept in environment config
(app/etc/env.php) -> cache/persisted-query and can be configured manually:

	'persisted-query' => [
		'redis' => [
			'host' => 'redis',
			'scheme' => 'tcp',
			'port' => '6379',
			'database' => '5'
		]
	]

Cache control

Available from v1.3.0

CLI command magento cache:flush and admin panel Cache Management has necessary logic to flush GraphQl responses
stored in varnish.

persisted_query_response - can be disabled, controls varnish caches (graphql response caches).

bin/magento scandipwa:pq:flush - flushes persisted query REDIS storage(query body)

Usage

Dynamic persisted query suppose Client to register unknown queries with a series of request-response.

Recommended usage:

  1. Optimistically request query execution, referencing query by hash, passing necessary query variables as request
    parameters: GET /graphql?hash=135811058&hideChildren=true
  2. Server has multiple options:
  • respond with resolved query (status code 200)
  • respond with Unknown query error (status code 410)
  1. Status code 410 - client must issue PUT request, with the same hash and entire GraphQl query document within
    the body
    . PUT /graphql?hash=135811058
  2. Server responds with status code 201 on successful query registration.
  3. Server will now executes the registered query referenced by hashGET /graphql?hash=135811058

In order to effectively utilize persisted query mechanism and avoid unnecessary time-consuming request-response
interactions GraphQl query must utilize variables.

Variables

Variables must be passed in pseudo-json format. You must keep the structure, but skip usage of quotes.

Array

Array is a list of values, separated with coma, i.e.: cmsBlocks_identifiers=homepage-promo-categories,homepage-top-items,homepage-about-us

Let's consider the details:
cmsBlocks_identifiers - GraphQl variable name
homepage-promo-categories,homepage-top-items,homepage-about-us - Array of values

Complex structures

Complex structures must keep structures described with special chars {, }, :.
Array within complex structs MUST use special chars: [, ].

Example:

_filter={category_url_path:{eq:men},max_price:{lteq:300},color:{in:[74,75]}}
Let's consider the details:
_filter - GraphQl variable name
{ category_url_path: { eq:men }, max_price:{ lteq:300 }, color:{ in:[74,75] } } - "Object", passed as GET parameter. It has not quotation marks, as these are automatically added by the server
during the processing.


Examples

Query body:

query ($cmsBlocks_identifiers:[String]) {cmsBlocks:cmsBlocks(identifiers:$cmsBlocks_identifiers){ items{ title, content, identifier } }}

Request URI:

GET /graphql?hash=2443957263&cmsBlocks_identifiers=homepage-promo-categories,homepage-top-items,homepage-about-us


Query body:

"query ($_currentPage:Int!, $_pageSize:Int!, $_filter:ProductFilterInput!, $category_url_path:String!) {products(currentPage:$_currentPage, pageSize:$_pageSize, filter:$_filter){ total_count, items{ id, name, short_description, url_key, special_price, sku, categories{ name, url_path, breadcrumbs{ category_name, category_url_key } }, price{ regularPrice{ amount{ value, currency } }, minimalPrice{ amount{ value, currency } } }, thumbnail, thumbnail_label, small_image, small_image_label, brand, color, size, shoes_size, type_id }, filters{ name, request_var, filter_items{ label, value_string, ... on SwatchLayerFilterItem { label, swatch_data{ type, value } } } } }, category:category(url_path:$category_url_path){ id, name, description, url_path, image, url_key, product_count, meta_title, meta_description, breadcrumbs{ category_name, category_url_key, category_level }, children{ id, name, description, url_path, image, url_key, product_count, meta_title, meta_description, breadcrumbs{ category_name, category_url_key, category_level } } }}"

Request URI:

https://scandipwa.local/graphql?hash=1713013963&_currentPage=1&_pageSize=12&_filter={category_url_path:{eq:men},max_price:{lteq:300}}&category_url_path=men

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog,
and this project adheres to Semantic Versioning.

[Unreleased]

[2.1.0] - 2019-10-28

Changed

  • Replace predis/predis with colinmollenhour/credis, that supports PhpRedis module for high load.

[1.5.0] - 2019-10-25

Changed

  • Replace predis/predis with colinmollenhour/credis, that supports PhpRedis module for high load.

[2.0.2] - 2019-10-23

Changed

  • Fix argument value partial escaping

[1.4.8] - 2019-10-23

Changed

  • Fix argument value partial escaping

[2.0.1] - 2019-10-18

Changed

  • Fix float parameter handling

[1.4.7] - 2019-10-18

Changed

  • Fix float parameter handling

[2.0.0] - 2019-07-29

Changed

  • Magento 2.3.2 adoption
  • Fixes

[1.4.3] - 2019-07-26

Added

  • verbose error messages for Varnish flush requests

[1.3.0] - 2019-05-23

Added

  • Event observer forbin/magento cache:flush to trigger persisted query varnish storage flush (happens also on
    setup:upgrade)
  • bin/magento scandipwa:pq:flush - command for flushing query document (redis) storage (does not happen on
    setup:upgrade)

Removed

  • persisted_query cache is unlisted in CLI and Admin cache control menu

Changed

  • File restructuring improving readability
  • Updating README.md & CHANGELOG.md
  • Update Magento module version to fit release tag
  • Minor CS improvements

[1.2.0] - 2019-05-07

Added

  • flush option for persisted query redis
  • cache control for PQ and PQ responses
  • flushing logic for varnish and redis

Removed

  • version tag in composer.json

Changed

  • Update README.md
  • improve code styling and comments

[1.1.1] - 2019-03-20

Changed

  • --pq-scheme is not setting tcp by default.
  • Move CHANGELOG.md to the root of the module
  • README.md

[1.1.0] - 2019-03-20

Added

  • Added custom flags to setup:config:set CLI command

Changed

  • Changed README.md

[1.0.0] - 2019-03-08

Added

  • Initial commit
  • predis/predis as dependency
  • persisted query support
  • Magento 2 module registration: ScandiPWA_PersistedQuery
  • Plugin\PersistedQuery registered for Magento\GraphQl\Controller\GraphQl
  • Plugin\PersistedQuery registered for ScandiPWA\GraphQl\Controller\GraphQl
Versions
Version Stability QA Status Compatibility Released
3.1.1 stable Fail Magento 2.4.7 Details 2023-04-12 07:33:36
3.1.0 stable Not tested Not yet tested Details 2023-04-04 02:38:40
3.0.5 stable Not tested Not yet tested Details 2022-06-11 00:02:43
3.0.4 stable Not tested Not yet tested Details 2022-06-09 19:16:51
3.0.3 stable Not tested Not yet tested Details 2022-01-25 20:47:22
3.0.2 stable Not tested Not yet tested Details 2021-09-22 17:27:15
3.0.1 stable Not tested Not yet tested Details 2020-11-05 10:32:23
2.5.2 stable Not tested Not yet tested Details 2020-11-05 10:30:50
3.0.0 stable Not tested Not yet tested Details 2020-11-05 09:39:42
2.5.1 stable Not tested Not yet tested Details 2020-11-05 09:36:09
2.5.0 stable Not tested Not yet tested Details 2020-09-07 10:57:15
2.4.0 stable Not tested Not yet tested Details 2020-08-26 15:57:41
2.2.2 stable Not tested Not yet tested Details 2020-08-07 08:46:02
2.3.2 stable Not tested Not yet tested Details 2020-08-07 08:45:21
2.3.1 stable Not tested Not yet tested Details 2020-07-24 13:17:53
2.3.0 stable Not tested Not yet tested Details 2020-06-09 13:23:26
2.2.1 stable Not tested Not yet tested Details 2020-06-09 13:21:13
2.2.0 stable Not tested Not yet tested Details 2020-05-30 07:19:29
2.1.2 stable Not tested Not yet tested Details 2020-01-22 13:30:42
1.5.1 stable Not tested Not yet tested Details 2019-11-05 10:02:31
2.1.0 stable Not tested Not yet tested Details 2019-10-28 10:55:26
2.1.1 stable Not tested Not yet tested Details 2019-10-28 10:54:51
1.5.0 stable Not tested Not yet tested Details 2019-10-25 14:42:55
1.4.8 stable Not tested Not yet tested Details 2019-10-23 07:16:18
2.0.2 stable Not tested Not yet tested Details 2019-10-23 07:16:07
2.0.1 stable Not tested Not yet tested Details 2019-10-18 08:06:43
1.4.6 stable Not tested Not yet tested Details 2019-10-18 08:06:16
1.4.7 stable Not tested Not yet tested Details 2019-10-18 08:05:57
1.4.5 stable Not tested Not yet tested Details 2019-08-28 09:58:41
2.0.0 stable Not tested Not yet tested Details 2019-08-28 09:57:25
1.4.3 stable Not tested Not yet tested Details 2019-07-26 13:05:40
1.4.4 stable Not tested Not yet tested Details 2019-07-26 13:02:23
1.4.2 stable Not tested Not yet tested Details 2019-06-11 13:32:43
1.4.1 stable Not tested Not yet tested Details 2019-05-30 14:14:04
1.4.0 stable Not tested Not yet tested Details 2019-05-30 12:42:00
1.3.0 stable Not tested Not yet tested Details 2019-05-23 10:07:48
1.2.0 stable Not tested Not yet tested Details 2019-05-07 07:37:38
1.1.1 stable Not tested Not yet tested Details 2019-03-20 12:25:42
1.1.0 stable Not tested Not yet tested Details 2019-03-20 11:51:58
1.0.0 stable Not tested Not yet tested Details 2019-03-08 14:36:19

Requires 6

Package Constraint
magento/framework *
magento/module-cache-invalidate *
magento/module-page-cache *
magento/module-store *
magento/module-graph-ql ^100.3
colinmollenhour/credis ^1.10

Suggests 1

Package Reason
magento/module-catalog To invalidate persisted_query cache after full reindex

Compatibility

Each Magento release line is installed on its supported PHP versions, then the module is built (DI compilation + static-content deploy) and its unit and integration suites are run. The matrix shows the lines and PHP versions the module is confirmed to install and run on. Code-quality results further down (phpstan, phpcs, …) are reported separately and never affect compatibility.

Compatibility matrix (Magento × PHP)
Magento PHP 8.2 PHP 8.3 PHP 8.4 PHP 8.5
2.4.7 Pass Pass
2.4.8 Pass Fail di error
2.4.9 Fail di error Fail di error

Code Quality

Advisory checks against the module's source. Static analysis runs once across the whole module; PHPStan re-runs per Magento + PHP version because resolvable symbols differ between releases. These NEVER affect the Compatibility badge. A phpcs finding can't make a module incompatible.

Static analysis

Coding standards (phpcs), mess detection (phpmd), copy-pasted code (cpd), PHP cross-version compatibility, composer.json validity. Each runs once for the whole module.

Static analysis results
Tool Status Findings Summary
PHPCS Warning 42 42 warnings (ruleset: Magento2) — 30 auto-fixable with phpcbf
PHPMD Warning 7 7 rule violations (UnusedFormalParameter:5, ExcessiveParameterList:1, NPathComplexity:1)
Cpd Pass 0
Composer validate Info 4 valid; 4 advisory notes (composer validate --strict)

PHPStan

Type-checks the module's PHP against a real Magento install at the configured gate level. Re-runs per Magento and PHP version because resolvable symbols differ between releases.

PHPStan results by Magento and PHP version
Magento PHP 8.2 PHP 8.3 PHP 8.4 PHP 8.5
2.4.7 21 21
2.4.8 21 29
2.4.9 31 31

Tests

Unit and integration suites, run for each applicable Magento and PHP version. A test failure speaks to the module's behaviour, not its compatibility with a Magento line, so it is reported here separately and never reddens the compatibility matrix.

Unit tests

Unit tests results by Magento and PHP version
Magento PHP 8.2 PHP 8.3 PHP 8.4 PHP 8.5
2.4.7 N/A N/A
2.4.8 N/A N/A
2.4.9 N/A N/A

Integration tests

Integration tests results by Magento and PHP version
Magento PHP 8.2 PHP 8.3 PHP 8.4 PHP 8.5
2.4.7 N/A N/A
2.4.8 N/A N/A
2.4.9 N/A N/A

Security

Security checks run directly against the module: an audit of its declared dependencies for known vulnerabilities (composer audit) and a scan of its source for malware and web-shell signatures. Each runs once. A malware detection fails the version outright.

Security results
Tool Status Findings Summary
Composer audit Pass 0
Malware scan Pass 0
License
OSL-3.0

More from scandipwa

View vendor
Make it pay

Turn an existing module into recurring revenue.

If you already maintain a Magento 2 module on GitHub or GitLab, listing it on Packagento takes about five minutes. We mirror your tags, handle distribution signing, and route paid licenses through Stripe Connect, so you can keep shipping the way you already do.