zip file creation fails on a large site

  • Greetings — We are using SimplyStatic quite successfully to archive a number of sites prior to shutting down a multisite, but have been unable to do so on one (relatively large) site. The debug log at end reads:

    [2018-06-04 08:45:30] [class-ss-fetch-urls-task.php:37] Total pages: 21234; Pages remaining: 0
[2018-06-04 08:45:30] [class-ss-task.php:38] Status message: [fetch_urls] Fetched 21234 of 21234 pages/files
[2018-06-04 08:45:30] [class-ss-archive-creation-job.php:142] We've found our next task: create_zip_archive
[2018-06-04 08:45:30] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 08:45:30] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 08:45:30] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 08:45:37] [class-ss-create-zip-archive.php:42] Creating zip archive
[2018-06-04 08:53:55] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 08:53:55] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 08:53:55] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 08:53:59] [class-ss-create-zip-archive.php:42] Creating zip archive
[2018-06-04 09:00:42] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 09:00:42] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 09:00:42] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 09:00:45] [class-ss-create-zip-archive.php:42] Creating zip archive

[[repeated about a dozen times...]]

[2018-06-04 20:27:36] [class-ss-create-zip-archive.php:42] Creating zip archive
[2018-06-04 20:32:35] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 20:32:35] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 20:32:35] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 20:32:36] [class-ss-create-zip-archive.php:42] Creating zip archive
[2018-06-04 20:37:36] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 20:37:36] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 20:37:36] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 20:37:36] [class-ss-create-zip-archive.php:42] Creating zip archive
[2018-06-04 20:42:36] [class-ss-archive-creation-job.php:105] Current task: create_zip_archive
[2018-06-04 20:42:36] [class-ss-archive-creation-job.php:120] Performing task: create_zip_archive
[2018-06-04 20:42:36] [class-ss-create-zip-archive.php:35] Fetching list of files to include in zip
[2018-06-04 20:42:37] [class-ss-create-zip-archive.php:42] Creating zip archive

    And that’s where it ends! Would sure appreciate additional pointers so we can diagnose this one…thanks.

    Jim P.

    The page I need help with: [log in to see the link]

Viewing 5 replies - 1 through 5 (of 5 total)

  • Hi Jim,

    Do you have the ability to increase the PHP max_execution_time setting on this server? That may silently fail on some hosts, which doesn’t result in an obvious error.

    Cheers,

    Leon

    same here. “file corrupted”

    on debug – all green
    – ubuntu 16.04 LTS + all updates
    – php 7.0.30
    – curl 7.47.0

    WP 4.9.6
    Twenty Seventeen 1.6
    yoast 7.6.1
    ACF 5.7rc

    All TEMP files are valid.
    I can view them and everything works in temp.

    Delivery Method “Local Directory” same – works perfect.

    – – – –

    gzip is already the newest version (1.6-4ubuntu1).
    zip is already the newest version (3.0-11).
    tar is already the newest version (1.28-2.1ubuntu0.1)

    – – – – –

    max_execution_time = 3000

    Hi @nebuso,

    What kind of hosting are you on? Are you able to confirm that max_execution_time INI setting for your PHP?

    Sometimes, hosts will override this and it won’t respect any increase you make to it, but if you have full control over your PHP configuration, you may be able to overcome it.

    If you manually zip up the locally exported folder, how big is the resulting ZIP file?

    I could suggest you try my plugin (linked to from Simply Static’s readme), it still creates the ZIP file synchronously, but the crawling and generating of the export folder are done in different steps, so that may buy you enough time with the ZIP creation.

    Cheers,

    Leon

    OK, I think I found.

    I used Faker to generate some dummy data.
    “too long slugs”.

    Thanks for your time!

    Ah, great to know – I sometimes use Faker when testing!

    Glad you got it sorted ??

Viewing 5 replies - 1 through 5 (of 5 total)
  • The topic ‘zip file creation fails on a large site’ is closed to new replies.

Tags