Not serving webp images & background bulk optimization

  • Resolved tanmaydwivedit

    (@tanmaydwivedit)


    2 years, 10 months ago

    Hi,
    We’ve setup the ewww with offload media (with all proper htaccess configs & showing green .webp on ewww console), and going through the other tickets we found that “force webp” option configures itself if files are removed from server (via offload media), but in our case, forcing causes non-webp images to have attach the webp extension..what we would want is serve converted images in webp format while non-converted ones to be served in their default format.
    secondary question, is it possible to do background bulk conversion? We have more than 60k+ files and bulk optimizer doesn’t do background optimization/conversion for old files.

    Attaching sys info copied from EWWW

    checking active plugins
EIO_Base::content_url()
wp-content/uploads/
found S3 domain of harborshoppers.sfo2.digitaloceanspaces.com with bucket harborshoppers and region sfo2
found WOM delivery domain of cdn.harborshoppers.com
object versioning enabled
upload_url: https://harborshoppers.com/wp-content/uploads/
EIO_Base::__construct()
plugin (resource) content_url: https://harborshoppers.com/wp-content/ewww/
plugin (resource) content_dir: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/
home url: https://harborshoppers.com/
relative home url: //harborshoppers.com/
home domain: harborshoppers.com
site/upload url: https://harborshoppers.sfo2.digitaloceanspaces.com
site/upload domain: harborshoppers.sfo2.digitaloceanspaces.com
EIO_JS_Webp::__construct()
request uri is EWWW IO settings
is_admin
ewww_image_optimizer_admin_init()
EIO_Base::content_url()
wp-content/uploads/
found S3 domain of harborshoppers.sfo2.digitaloceanspaces.com with bucket harborshoppers and region sfo2
found WOM delivery domain of cdn.harborshoppers.com
object versioning enabled
upload_url: https://harborshoppers.com/wp-content/uploads/
EIO_Base::__construct()
plugin (resource) content_url: https://harborshoppers.com/wp-content/ewww/
plugin (resource) content_dir: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/
home url: https://harborshoppers.com/
relative home url: //harborshoppers.com/
home domain: harborshoppers.com
site/upload url: https://harborshoppers.sfo2.digitaloceanspaces.com
site/upload domain: harborshoppers.sfo2.digitaloceanspaces.com
ewww_image_optimizer_cloud_init()
ewww_image_optimizer_upgrade()
ewww_image_optimizer_exec_init()
ewww_image_optimizer_cron_setup()
EWWWIO_Tracking::schedule_send()
checkin already scheduled: 1652864328
ewww_image_optimizer_tool_init()
ewww_image_optimizer_install_tools()
Checking/Installing tools in /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/
wp-content/ewww permissions: 0755
ewww_image_optimizer_install_paths()
CPU architecture: x86_64
generated paths:
/srv/users/harbors/apps/harborshoppers/public/wp-content/plugins/ewww-image-optimizer/binaries/jpegtran-linux
/srv/users/harbors/apps/harborshoppers/public/wp-content/plugins/ewww-image-optimizer/binaries/optipng-linux
/srv/users/harbors/apps/harborshoppers/public/wp-content/plugins/ewww-image-optimizer/binaries/gifsicle-linux
/srv/users/harbors/apps/harborshoppers/public/wp-content/plugins/ewww-image-optimizer/binaries/pngquant-linux
/srv/users/harbors/apps/harborshoppers/public/wp-content/plugins/ewww-image-optimizer/binaries/cwebp-linux
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/pngquant
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp
ewww_image_optimizer_skip_tools()
enabled: jpegtran
enabled: optipng
enabled: gifsicle
enabled: webp
Linux/UNIX style OS, checking permissions
ewww_image_optimizer_check_permissions()
permissions for /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran: 0755
permissions ok
ewww_image_optimizer_check_permissions()
permissions for /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle: 0755
permissions ok
ewww_image_optimizer_check_permissions()
permissions for /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng: 0755
permissions ok
ewww_image_optimizer_check_permissions()
permissions for /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp: 0755
permissions ok
ewww_image_optimizer_settings_script()
ewww_image_optimizer_bulk_script()
ewww_image_optimizer_tool_script()
ewww_image_optimizer_webp_script()
ewww_image_optimizer_notice_utils()
ewww_image_optimizer_exec_check()
ewww_image_optimizer_skip_tools()
enabled: jpegtran
enabled: optipng
enabled: gifsicle
enabled: webp
ewww_image_optimizer_path_check()
ewww_image_optimizer_find_nix_binary()
found /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran, testing...
ewww_image_optimizer_md5check()
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran: c0a44f6f16ddc78d8d027ffd3e09c512d637876833c5ffaaf5b1e7acd5ce3cda
checksum verified, binary is intact
ewww_image_optimizer_mimetype()
testing mimetype: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran
7f454c46
ewwwio type: application/x-executable
ewww_image_optimizer_tool_found()
testing case: j at /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran: Independent JPEG Group's JPEGTRAN, version 9d 12-Jan-2020
optimizer found
defining EWWW_IMAGE_OPTIMIZER_JPEGTRAN
ewww_image_optimizer_find_nix_binary()
found /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng, testing...
ewww_image_optimizer_md5check()
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng: 4404076a4f9119d4dfbb7acb00eb65345e804186a019c7136d8f8e87fb0cb997
checksum verified, binary is intact
ewww_image_optimizer_mimetype()
testing mimetype: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng
7f454c46
ewwwio type: application/x-executable
ewww_image_optimizer_tool_found()
testing case: o at /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng: OptiPNG version 0.7.7
optimizer found
defining EWWW_IMAGE_OPTIMIZER_OPTIPNG
ewww_image_optimizer_find_nix_binary()
found /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle, testing...
ewww_image_optimizer_md5check()
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle: 566f058b2043c4f3c8c049b0507bfa78dcb33dac52b132cade5f67bbb62d91e4
checksum verified, binary is intact
ewww_image_optimizer_mimetype()
testing mimetype: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle
7f454c46
ewwwio type: application/x-executable
ewww_image_optimizer_tool_found()
testing case: g at /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle: LCDF Gifsicle 1.91
optimizer found
defining EWWW_IMAGE_OPTIMIZER_GIFSICLE
ewww_image_optimizer_find_nix_binary()
found /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp, testing...
ewww_image_optimizer_md5check()
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp: 5fec3397c56b74b8a8ac8c9bac99dc11d40f9528a6c05e4108f1cd65d5a0a4fc
checksum verified, binary is intact
ewww_image_optimizer_mimetype()
testing mimetype: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp
7f454c46
ewwwio type: application/x-executable
ewww_image_optimizer_tool_found()
testing case: w at /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp
/srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp: 1.2.0
optimizer found
defining EWWW_IMAGE_OPTIMIZER_CWEBP
using: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/jpegtran
using: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/optipng
using: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/gifsicle
using: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/cwebp
defining EWWW_IMAGE_OPTIMIZER_PNGOUT
defining EWWW_IMAGE_OPTIMIZER_PNGQUANT
defining EWWW_IMAGE_OPTIMIZER_SVGCLEANER
ewww_image_optimizer_options()
ewww_image_optimizer_savings()
savings query avoided via (single-site) cache
harbors
EWWW IO version: 651
WP version: 5.7.6
PHP version: 70333
libxml version: 20904
core plugin
ABSPATH: /srv/users/harbors/apps/harborshoppers/public/
WP_CONTENT_DIR: /srv/users/harbors/apps/harborshoppers/public/wp-content
EWWWIO_CONTENT_DIR: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/
home url (Site URL): https://harborshoppers.com
site url (WordPress URL): https://harborshoppers.com
wp_upload_dir (baseurl): https://harborshoppers.com/wp-content/uploads
wp_upload_dir (basedir): /srv/users/harbors/apps/harborshoppers/public/wp-content/uploads
content_width:
registered stream wrappers: https,ftps,compress.zlib,compress.bzip2,php,file,glob,data,http,ftp,zip,phar,s3sfo2
not external cache
ewww_image_optimizer_gd_support()
GD found, supports:
GD Version: bundled (2.1.0 compatible)
FreeType Support: 1
FreeType Linkage: with freetype
GIF Read Support: 1
GIF Create Support: 1
JPEG Support: 1
PNG Support: 1
WBMP Support: 1
XPM Support:
XBM Support: 1
WebP Support: 1
BMP Support: 1
JIS-mapped Japanese Font Support:
ewww_image_optimizer_gmagick_support()
ewww_image_optimizer_imagick_support()
3FR,AAI,AI,ART,ARW,AVI,AVS,BGR,BGRA,BGRO,BIE,BMP,BMP2,BMP3,BRF,CAL,CALS,CANVAS,CAPTION,CIN,CIP,CLIP,CMYK,CMYKA,CR2,CRW,CUR,CUT,DATA,DCM,DCR,DCX,DDS,DFONT,DJVU,DNG,DOT,DPX,DXT1,DXT5,EPDF,EPI,EPS,EPS2,EPS3,EPSF,EPSI,EPT,EPT2,EPT3,ERF,EXR,FAX,FILE,FITS,FRACTAL,FTP,FTS,G3,G4,GIF,GIF87,GRADIENT,GRAY,GROUP4,GV,H,HALD,HDR,HISTOGRAM,HRZ,HTM,HTML,HTTP,HTTPS,ICB,ICO,ICON,IIQ,INFO,INLINE,IPL,ISOBRL,ISOBRL6,JBG,JBIG,JNG,JNX,JPE,JPEG,JPG,JPS,JSON,K25,KDC,LABEL,M2V,M4V,MAC,MAGICK,MAP,MASK,MAT,MATTE,MEF,MIFF,MKV,MNG,MONO,MOV,MP4,MPC,MPEG,MPG,MRW,MSL,MSVG,MTV,MVG,NEF,NRW,NULL,ORF,OTB,OTF,PAL,PALM,PAM,PANGO,PATTERN,PBM,PCD,PCDS,PCL,PCT,PCX,PDB,PDF,PDFA,PEF,PES,PFA,PFB,PFM,PGM,PICON,PICT,PIX,PJPEG,PLASMA,PNG,PNG00,PNG24,PNG32,PNG48,PNG64,PNG8,PNM,PPM,PREVIEW,PS,PS2,PS3,PSB,PSD,PTIF,PWP,RADIAL-GRADIENT,RAF,RAS,RAW,RGB,RGBA,RGBO,RGF,RLA,RLE,RMF,RW2,SCR,SCT,SFW,SGI,SHTML,SIX,SIXEL,SPARSE-COLOR,SR2,SRF,STEGANO,SUN,SVG,SVGZ,TEXT,TGA,THUMBNAIL,TIFF,TIFF64,TILE,TIM,TTC,TTF,TXT,UBRL,UBRL6,UIL,UYVY,VDA,VICAR,VID,VIFF,VIPS,VST,WBMP,WMF,WMV,WMZ,WPG,X,X3F,XBM,XC,XCF,XPM,XPS,XV,XWD,YCbCr,YCbCrA,YUV
ewww_image_optimizer_find_nix_binary()
ewww_image_optimizer_tool_found()
testing case: n at /usr/bin/nice
/usr/bin/nice: 0
nice found
5054 images have been optimized
automatic compression enabled
remove metadata: on
jpg level: 10
png level: 10
gif level: 10
pdf level: 0
svg level: 0
bulk delay:
backup mode: off
cloudinary upload: off
ExactDN enabled: off
ExactDN all the things: on
ExactDN lossy: 0
ExactDN resize existing: off
ExactDN attachment queries: on
Easy IO exclusions:

add missing dimensions: off
lazy load: off
ewwwio_other_lazy_detected()
LL autoscale: on
LQIP: off
S(VG)IIP: off
external CSS background (all things):
LL exclusions:

optipng level: 2
pngout disabled: yes
pngout level: 2
svgcleaner disabled: yes
ewww_image_optimizer_jpg_quality()
configured quality: 82
ewww_image_optimizer_jpg_quality()
effective quality: 82
ewww_image_optimizer_webp_quality()
webp quality: 90
effective WebP quality: 90
parallel optimization: off
background optimization: on
scheduled optimization: off
include media library: on
include originals: off
folders to optimize:

folders to ignore:

skip images smaller than: bytes
skip PNG images larger than: bytes
exclude originals from lossy: off
exclude originals from metadata removal: off
use system binaries: no
resize detection: off
max media dimensions: 0 x 0
max other dimensions: x
resize existing images: on
resize existing (non-media) images: off
ewww_image_optimizer_get_image_sizes()
sizes: thumbnail
medium
medium_large
large
ts_portfolio_thumb
ts_team_thumb
ts_testimonial_thumb
ts_logo_thumb
1536x1536
2048x2048
woocommerce_thumbnail
woocommerce_single
woocommerce_gallery_thumbnail
shop_catalog
shop_single
shop_thumbnail
ywrr_picture
custom-size-1
custom-size-2
custom-size-3
ts_menu_icon_thumb
ts_blog_shortcode_thumb
ts_blog_thumb
ts_product_cat_thumb
ts_product_deal_thumb
ppec_logo_image_size
ppec_header_image_size
Array
(
[thumbnail] => Array
(
[width] => 150
[height] => 150
[crop] =>
)
[medium] => Array
(
[width] => 300
[height] => 300
[crop] =>
)
[medium_large] => Array
(
[width] => 768
[height] => 9999
[crop] =>
)
[large] => Array
(
[width] => 1024
[height] => 1024
[crop] =>
)
[ts_portfolio_thumb] => Array
(
[width] => 610
[height] => 400
[crop] => 1
)
[ts_team_thumb] => Array
(
[width] => 320
[height] => 320
[crop] => 1
)
[ts_testimonial_thumb] => Array
(
[width] => 150
[height] => 150
[crop] => 1
)
[ts_logo_thumb] => Array
(
[width] => 240
[height] => 130
[crop] => 1
)
[1536x1536] => Array
(
[width] => 1536
[height] => 1536
[crop] =>
)
[2048x2048] => Array
(
[width] => 2048
[height] => 2048
[crop] =>
)
[woocommerce_thumbnail] => Array
(
[width] => 200
[height] => 200
[crop] => 1
)
[woocommerce_single] => Array
(
[width] => 600
[height] => 0
[crop] => 0
)
[woocommerce_gallery_thumbnail] => Array
(
[width] => 100
[height] => 100
[crop] => 1
)
[shop_catalog] => Array
(
[width] => 200
[height] => 200
[crop] => 1
)
[shop_single] => Array
(
[width] => 600
[height] => 0
[crop] => 0
)
[shop_thumbnail] => Array
(
[width] => 100
[height] => 100
[crop] => 1
)
[ywrr_picture] => Array
(
[width] => 135
[height] => 135
[crop] => 1
)
[custom-size-1] => Array
(
[width] => 200
[height] => 61
[crop] =>
)
[custom-size-2] => Array
(
[width] => 200
[height] => 57
[crop] =>
)
[custom-size-3] => Array
(
[width] => 200
[height] => 33
[crop] =>
)
[ts_menu_icon_thumb] => Array
(
[width] => 36
[height] => 36
[crop] => 1
)
[ts_blog_shortcode_thumb] => Array
(
[width] => 590
[height] => 352
[crop] => 1
)
[ts_blog_thumb] => Array
(
[width] => 1180
[height] => 704
[crop] => 1
)
[ts_product_cat_thumb] => Array
(
[width] => 500
[height] => 970
[crop] => 1
)
[ts_product_deal_thumb] => Array
(
[width] => 242
[height] => 242
[crop] => 1
)
[ppec_logo_image_size] => Array
(
[width] => 190
[height] => 60
[crop] =>
)
[ppec_header_image_size] => Array
(
[width] => 750
[height] => 90
[crop] =>
)
[pdf-full] => Array
(
[width] => 99999
[height] => 99999
[crop] =>
)
)

disabled sizes:
thumbnail: optimization=+ creation=+
medium: optimization=+ creation=+
medium_large: optimization=+ creation=+
large: optimization=+ creation=+
ts_portfolio_thumb: optimization=+ creation=+
ts_team_thumb: optimization=+ creation=+
ts_testimonial_thumb: optimization=+ creation=+
ts_logo_thumb: optimization=+ creation=+
1536x1536: optimization=+ creation=+
2048x2048: optimization=+ creation=+
woocommerce_thumbnail: optimization=+ creation=+
woocommerce_single: optimization=+ creation=+
woocommerce_gallery_thumbnail: optimization=+ creation=+
shop_catalog: optimization=+ creation=+
shop_single: optimization=+ creation=+
shop_thumbnail: optimization=+ creation=+
ywrr_picture: optimization=+ creation=+
custom-size-1: optimization=+ creation=+
custom-size-2: optimization=+ creation=+
custom-size-3: optimization=+ creation=+
ts_menu_icon_thumb: optimization=+ creation=+
ts_blog_shortcode_thumb: optimization=+ creation=+
ts_blog_thumb: optimization=+ creation=+
ts_product_cat_thumb: optimization=+ creation=+
ts_product_deal_thumb: optimization=+ creation=+
ppec_logo_image_size: optimization=+ creation=+
ppec_header_image_size: optimization=+ creation=+
pdf-full: optimization=+ creation=+
delete originals: off
jpg2png: off
png2jpg: off
gif2png: off
png2jpg fill:
ewww_image_optimizer_jpg_background()
webp conversion: on
js webp rewriting: on
picture webp rewriting: off
WebP Rewrite exclusions:

webp paths:
https://cdn.harborshoppers.com/
forced webp: off
cloud-based media (no local copies), force webp auto-enabled
forced gif2webp: off
enable help beacon: no
origin (SERVER_ADDR): 127.0.0.1
EIO_Base::content_url()
wp-content/uploads/
found S3 domain of harborshoppers.sfo2.digitaloceanspaces.com with bucket harborshoppers and region sfo2
found WOM delivery domain of cdn.harborshoppers.com
object versioning enabled
upload_url: https://harborshoppers.com/wp-content/uploads/
EIO_Base::__construct()
plugin (resource) content_url: https://harborshoppers.com/wp-content/ewww/
plugin (resource) content_dir: /srv/users/harbors/apps/harborshoppers/public/wp-content/ewww/
home url: https://harborshoppers.com/
relative home url: //harborshoppers.com/
home domain: harborshoppers.com
site/upload url: https://harborshoppers.sfo2.digitaloceanspaces.com
site/upload domain: harborshoppers.sfo2.digitaloceanspaces.com
checking 167.172.234.57 from gethostbyname
not a Cloudflare host: 167.172.234.57
max_execution_time: 300
ewww_image_optimizer_stl_check()
disable_functions:
detected memory limit is: 8388608000

    Thanks.

    • This topic was modified 2 years, 10 months ago by tanmaydwivedit. Reason: spacing fix
    • This topic was modified 2 years, 10 months ago by tanmaydwivedit. Reason: added config
Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support adamewww

    (@adamewww)

    I think I understand that you don’t have local copies of your images and as such, you have to use the Force WebP option to generate WebP versions of your images, correct? Unfortunately, unless you are using our Easy IO CDN service, there isn’t a way to do it without using Force WebP. So all of your images will get a WebP version.

    For the background optimization question, the Bulk optimizer should optimize your existing media library. Our “background optimization’ has to do with automatically optimizing your new images as they are uploaded.

    Thread Starter tanmaydwivedit

    (@tanmaydwivedit)

    let me clarify, we need it such that the images served via offloaded media should serve webp format (for images which are converted) while for unavailble webp, serve default png/jpg format (which are not converted).

    I already know what you’re saying regarding the background optimization, what we need is bulk optimization happening in background as we can’t keep the tab open for optimization (as it’ll take days for converting all files) as our files are in thousands in amount (around 400k), so is there any solution for this.

    Thanks.
    Tanmay

    Plugin Support adamewww

    (@adamewww)

    As it’s processing those in that window, bulk optimize has to keep that window open. Using the force WebP option only generates the WebP version of images. It doesn’t force that image type to be served. The delivery method you chose (probably JS WebP) would provide the WebP version unless the browser can’t support it and then it would fall back to the original JPG/PNG. However, when using Force WebP, make sure that you enable JS WebP after you have generated a WebP version of your images: https://docs.ewww.io/article/121-webp-urls-and-force-webp

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Not serving webp images & background bulk optimization’ is closed to new replies.