Not seeing large files

So here’s some more info.

I was using Media Synch to add a few thousand media files from custom folders under the wp-content/uploads folder structure. Was working fine for days, as I added a few files at a time (from a handful to a couple hundred, depending on the folder). Then today, in one folder on the server, it’s only seeing about half the files. All of the files it won’t see are 1mb in size or higher. They’re all .png files, which is all I’ve been loading for the past few days.

I can drag the files and upload them normally in the Media Library, but that doesn’t put them where I want them. I’ve cleared my WP cache multiple times, cleared my browser cache (tried on more than one machine, so it’s not machine-specific). I uninstalled, deleted, and re-installed Media Synch, but it still won’t see the files over 1MB in this one folder. It’s very odd.

Why all of a sudden would Media Synch stop working on larger image files, when it was having no problems prior?

File size shouldn’t matter at all. But maybe those files have specific naming which makes them ignored by this plugin, for example:

• ending with thumbnail size (e.g “-100×100” or any other size)
• ending with “-scaled”…

Another issue could be if there are too many files in general, but it shouldn’t happen even for thousands of files (depending on your server config). But if the whole page is loaded properly and it’s just that issue where only some files are not being listed, then it’s not this, but probably file naming.

You are exactly right! Thanks! Many of the files from the folder in question did indeed have 00×00 at the end of the filename, even though they weren’t thumbnails. I renamed them, and they are detected as expected!

Thank you!

Ah, I see, makes sense now. I’m glad you found a solution ??

Now I’m having a related, I think, problem.

Another folder with very large image files, the largest is 58mb, many are in the 20mb range. MS seems to be only able to import one at a time before throwing an error. My max post size is 110MB, max upload size is 100MB. I set the import batch to 1, and it will bring in one file, then show an internal server error up at the top.

So I rescan, set the batch to one, select all files, and the same thing happens, one gets imported, then it stops. It’s only taking a couple of seconds for this to happen, so it doesn’t look like a server timeout.

Hmm interesting, but file size shouldn’t matter during import as well. Since this plugin doesn’t move or change files in any way, it just creates 2 database records, which should happen very quickly.

But maybe there are other plugins that detect this import action and do some additional actions.

It would be great to find out what’s the actual error that happens, which probably requires turning on WordPress debugging to see the error. Or you could try disabling any media-related plugins, if there are any.

It’s only started happening on these larger files though. It’s weird. I have a little over 100 to do, so it’s going to just be a grind.

At your suggestion, I turned on debugging in WP-config, and it seems the processing of larger files exceeds the 256M memory limit I had set. I upped it to 512, and at a batch of 10, it got through a few, until it gave a “not found” error. Nothing in the logs for that one though. So, I knocked the batch back down to 1 and it’s now going through them.

Thanks again for your help.

Wow, interesting, I hope I’ll get to replicate it on my end and fix it at some point. So thanks for sharing.

File sizes apparently matter a lot. I had to eventually increase the memory limit to 1024M (1 gig) to be able to process most of the large files.

All that said, this plugin has been very good for me. I was constantly getting corrupted media libraries when importing the normal way.

Hey @steel-rat, I added an option to disable thumbnail generation during import. And import time for some large images dropped from 20-30 seconds to ~0.05 seconds. But then if thumbnails are needed, they need to be generated somehow (with some plugin for example).

And since this option is only in a beta version of the pro plugin: https://mediasyncplugin.com/ – please let me know if you want a coupon to try it out (there should be a contact email in the footer).