sync huge upload folder (10GB)

  • Resolved adimil

    (@adimil)


    6 years, 9 months ago

    Hi
    I installed the plugin on small site, everything worked perfectly.
    Now I tried to use it on old site with a lot of media files.
    Afer a quick setup I run a sync method, it starts to work my server CPU jumped and it was very slow, I made a short calculation it should take 40-50 hours to sync all media folder.
    So I upload the media folder to bucket using gsutil command,
    Now my bucket is synced and all images available from the bucket external URL, but all (or almost) images link in the site (HTML markup) are broken.
    In order to solve it, I click on “Regenerate and Sync with GCS” in media page the on few images and their HTML markup was fixed.
    That means sync method upload image to bucket and updating something in db OR somewhere?
    please advise how to run a full sync in this case.
    Thanks

Viewing 1 replies (of 1 total)
  • Plugin Author Eric Sopp

    (@ideric)

    Hey Adimil, thanks for the message.

    What you are describing is a common problem for large sites that want to become stateless. We are experiencing this problem with some of our clients as well. Unfortunately, there is no simple solution at the moment. The only tool offered is the synchronization feature in the WP-Stateless Settings Panel.

    This isn’t the best solution, but it is the solution that is currently available.

    We’ve reached out to several others who experience this problem to help fund the development of a better method, but no one has shown interest.

Viewing 1 replies (of 1 total)
  • The topic ‘sync huge upload folder (10GB)’ is closed to new replies.