Piling of jobs in the backend

[tejubhe]

Support Request

Hi Team ,

Getting above issue in our Prod environment with below Blitz.php config `/**

• Blitz config.php
• This file exists only as a template for the Blitz settings.
• It does nothing on its own.
• Don't edit this file, instead copy it to 'craft/config' as 'blitz.php'
• and make your changes there to override default settings.
• Once copied to 'craft/config', this file will be multi-environment aware as
• well, so you can have different settings groups for each environment, just as
• you do for 'general.php'
  */

return [
'*' => [
// With this setting enabled, Blitz will log detailed messages to storage/logs/blitz.log.
'debug' => (getenv('ENVIRONMENT') === 'dev'),

    // With this setting enabled, Blitz will begin caching pages according to the included/excluded URI patterns. Disable this setting to prevent Blitz from caching any new pages.
    'cachingEnabled' => (getenv('ENABLE_BLITZ_CACHE') === '1') && (getenv('SITE_LIVE') === '1'),

    // The URI patterns to include in caching. Set `siteId` to a blank string to indicate all sites.
    'includedUriPatterns' => [
       [
           'siteId' => '',
           'uriPattern' => '.*',
       ]
    ],

    // The URI patterns to exclude from caching (overrides any matching patterns to include). Set `siteId` to a blank string to indicate all sites.
    //'excludedUriPatterns' => [
    //    [
    //        'siteId' => 1,
    //        'uriPattern' => 'pages/contact',
    //    ],
    //],

    // The storage type to use.
    //'cacheStorageType' => 'putyourlightson\blitz\drivers\storage\FileStorage',

    // The storage settings.
    //'cacheStorageSettings' => [
    //    'folderPath' => '@webroot/cache/blitz',
    //    'createGzipFiles' => false,
    //    'countCachedFiles' => true,
    //],

    // The storage type classes to add to the plugin’s default storage types.
    //'cacheStorageTypes' => [],

    // The warmer type to use.
    'cacheWarmerType' => 'putyourlightson\blitz\drivers\warmers\DummyWarmer',

    // The warmer settings.
    // 'cacheWarmerSettings' => ['concurrency' => 3],

    // The warmer type classes to add to the plugin’s default warmer types.
    //'cacheWarmerTypes' => [],

    // Custom site URIs to warm when either a site or the entire cache is warmed.
    //'customSiteUris' => [
    //    [
    //        'siteId' => 1,
    //        'uri' => 'pages/custom',
    //    ],
    //],

    // The purger type to use.
    //'cachePurgerType' => 'putyourlightson\blitz\drivers\purgers\CloudflarePurger',

    // The purger settings (zone ID keys are site UIDs).
    //'cachePurgerSettings' => [
    //    'zoneIds' => [
    //        'f64d4923-f64d4923-f64d4923' => [
    //            'zoneId' => '',
    //        ],
    //    ],
    //    'email' => '',
    //    'apiKey' => '',
    //    'warmCacheDelay' => '5',
    //],

    // The purger type classes to add to the plugin’s default purger types.
    //'cachePurgerTypes' => [
    //    'putyourlightson\blitzshell\ShellDeployer',
    //],

    // The deployer type to use.
    //'deployerType' => 'putyourlightson\blitz\drivers\deployers\GitDeployer',

    // The deployer settings (zone ID keys are site UIDs).
    //'deployerSettings' => [
    //    'gitRepositories' => [
    //        'f64d4923-f64d4923-f64d4923' => [
    //            'repositoryPath' => '@root/path/to/repo',
    //            'branch' => 'master',
    //            'remote' => 'origin',
    //        ],
    //    ],
    //    'commitMessage' => 'Blitz auto commit',
    //    'username' => '',
    //    'personalAccessToken' => '',
    //    'name' => '',
    //    'email' => '',
    //    'commandsBefore' => '',
    //    'commandsAfter' => '',
    //],

    // The deployer type classes to add to the plugin’s default deployer types.
    //'deployerTypes' => [
    //    'putyourlightson\blitzshell\ShellDeployer',
    //],

// Whether the cache should automatically be cleared when elements are updated.
'clearCacheAutomatically' => true,

// Whether the cache should automatically be warmed after clearing.
'warmCacheAutomatically' => true,
'useAsyncQueue' => true,
    // Whether the cache should automatically be refreshed after a global set is updated.
    'refreshCacheAutomaticallyForGlobals' => false,
'queueJobTtr' => 3600,

    // Whether the cache should be refreshed when an element is saved but unchanged.
    //'refreshCacheWhenElementSavedUnchanged' => false,

    // Whether the cache should be refreshed when an element is saved but not live.
    //'refreshCacheWhenElementSavedNotLive' => false,

    // Whether URLs with query strings should cached and how.
    // - `0`: Do not cache URLs with query strings
    // - `1`: Cache URLs with query strings as unique pages
    // - `2`: Cache URLs with query strings as the same page
    'queryStringCaching' => 1,

    // // The query string parameters to exclude when determining if and how a page should be cached.
    // 'excludedQueryStringParams' => ['gclid', 'fbclid'],

    // The query string parameters to exclude when determining if and how a page should be cached (regular expressions may be used).
    'excludedQueryStringParams' => [
       [
           'siteId' => '',
           'queryStringParam' => 'gclid',
       ],
       [
           'siteId' => '',
           'queryStringParam' => 'fbclid',
       ],
    ],        

    // An API key that can be used to clear, flush, warm, or refresh expired cache through a URL (min. 16 characters).
    //'apiKey' => '',

    // A path to the `bin` folder that should be forced.
    //'binPath' => '',

    // Whether elements should be cached in the database.
    //'cacheElements' => true,

    // Whether element queries should be cached in the database.
    //'cacheElementQueries' => true,

    // The amount of time after which the cache should expire (if not 0). See [[ConfigHelper::durationInSeconds()]] for a list of supported value types.
    // 'cacheDuration' => 0,

    // Element types that should not be cached (in addition to the defaults).
    //'nonCacheableElementTypes' => [
    //    'putyourlightson\campaign\elements\ContactElement',
    //],

    // Source ID attributes for element types (in addition to the defaults).
    //'sourceIdAttributes' => [
    //    'putyourlightson\campaign\elements\CampaignElement' => 'campaignTypeId',
    //],

    // The integrations to initialise.
    //'integrations' => [
    //    'putyourlightson\blitz\drivers\integrations\FeedMeIntegration',
    //    'putyourlightson\blitz\drivers\integrations\SeomaticIntegration',
    //],

    // The value to send in the cache control header.
    //'cacheControlHeader' => 'public, s-maxage=31536000, max-age=0',

    // Whether an `X-Powered-By: Blitz` header should be sent.
    //'sendPoweredByHeader' => true,

    // Whether the "cached on" and "served by" timestamp comments should be appended to the cached output.
    // - `false`: Do not append any comments
    // - `true`: Append all comments
    // - `2`: Append "cached on" comment only
    // - `3`: Append "served by" comment only
    //'outputComments' => true,

    // The priority to give the refresh cache job (the lower the number, the higher the priority). Set to `null` to inherit the default priority.
    //'refreshCacheJobPriority' => 10,

    // The priority to give driver jobs (the lower the number, the higher the priority). Set to `null` to inherit the default priority.
    //'driverJobPriority' => 100,

    // The time in seconds to wait for mutex locks to be released.
    //'mutexTimeout' => 1,

    // The paths to executable shell commands.
    //'commands' => [
    //    'git' => '/usr/bin/git',
    //],

    // The name of the JavaScript event that will trigger a script inject.
    //'injectScriptEvent' => 'DOMContentLoaded',
    ]

];
`

And below is my composer.json file for reference.
{ "require": { "clubstudioltd/craft-asset-rev": "7.0.0", "codemix/yii2-streamlog": "^1.3", "craftcms/azure-blob": "2.1.0", "craftcms/ckeditor": "3.14.1", "craftcms/cms": "4.16.13", "craftcms/element-api": "4.2.0", "craftcms/feed-me": "5.13.0", "craftcms/redactor": "3.1.0", "craftpulse/craft-password-policy": "4.1.0", "cs/kaleidoscope-fieldtype": "~1.0.0", "doublesecretagency/craft-cpcss": "2.6.0", "doublesecretagency/craft-cpjs": "2.6.0", "elasticsearch/elasticsearch": "*", "flipboxfactory/keychain": "4.0.0", "flipboxfactory/saml-sp": "4.3.1", "guzzlehttp/guzzle": "^7.9", "guzzlehttp/psr7": "^2.7", "http-interop/http-factory-guzzle": "^1.2", "hybridinteractive/craft-position-fieldtype": "4.0.0", "jalendport/craft-fetch": "^2.0.0", "jalendport/craft-preparse": "2.1.2", "luwes/craft-codemirror": "2.0.0", "mmikkel/incognito-field": "1.3.0", "mobiledetect/mobiledetectlib": "^4.8", "nfourtythree/entriessubset": "2.1.2", "nystudio107/craft-cookies": "4.0.1", "nystudio107/craft-minify": "4.0.1", "nystudio107/craft-retour": "4.1.28", "nystudio107/craft-seomatic": "4.1.17", "ostark/craft-async-queue": "3.2.1", "presseddigital/linkit": "4.0.4.1", "putyourlightson/craft-blitz": "4.23.15", "spicyweb/craft-neo": "4.4.5", "superbig/craft-audit": "3.0.3", "verbb/formie": "2.2.5", "verbb/navigation": "2.1.4", "verbb/super-table": "3.0.16", "verbb/workflow": "2.0.17", "vlucas/phpdotenv": "^3.4.0", "yiisoft/yii2-redis": "~2.0.0" }, "require-dev": { "yiisoft/yii2-shell": "^2.0.3" }, "autoload": { "psr-4": { "modules\\cswebsitemodule\\": "modules/cswebsitemodule/src", "modules\\": "modules/" } }, "config": { "sort-packages": true, "optimize-autoloader": true, "platform": { "php": "8.0.3" }, "allow-plugins": { "yiisoft/yii2-composer": true, "craftcms/plugin-installer": true, "treeware/plant": true, "php-http/discovery": true } }, "scripts": { "craft-update": [ "@pre-craft-update", "@post-craft-update" ], "pre-craft-update": [], "post-craft-update": [ "@php craft install/check && php craft clear-caches/blitz || return 0", "@php craft install/check && php craft clear-caches/compiled-templates || return 0", "@php craft install/check && php craft clear-caches/cp-resources || return 0", "@php craft install/check && php craft clear-caches/data || return 0", "@php craft install/check && php craft clear-caches/retour-redirect-caches || return 0", "@php craft install/check && php craft clear-caches/seomatic-frontendtemplate-caches || return 0", "@php craft install/check && php craft clear-caches/seomatic-metabundle-caches || return 0", "@php craft install/check && php craft clear-caches/seomatic-sitemap-caches || return 0", "@php craft install/check && php craft clear-caches/temp-files || return 0", "@php craft install/check && php craft migrate/all --interactive=0 || return 0", "@php craft install/check && php craft project-config/apply --interactive=0 || return 0" ], "post-root-package-install": [], "post-create-project-cmd": [ "@php craft setup/welcome" ], "pre-update-cmd": "@pre-craft-update", "pre-install-cmd": "@pre-craft-update", "post-update-cmd": "@post-craft-update" }, "minimum-stability": "dev", "prefer-stable": true, "repositories": [ { "type": "path", "url": "plugins/kaleidoscope-fieldtype" }, { "type": "composer", "url": "https://composer.craftcms.com/", "canonical": false } ] }

Plugin Version

4.23.15

[bencroker]

The doesn’t look ideal. Have you read this common issue, as well as the linked article?

My guess is that your queue job handler needs tweaking, and the templates need some optimising. If you have any specific questions then I can try to help.