I tried to disable the Defer Render Blocking JS, and this made no difference at all to me or my customers. Only disabling the entire plugin worked for me.
Something changed here, and theres a lot of people with the issue, not sure how many of them have figured out it is related to the SG Optimizer yet though!