esowers

@tnolte I’d love to hear more about your project too. We’re working on rolling out a salesforce WordPress portal as well for our donors and various committees. Shoot me an email or something as I’d love to hear more. [email protected]

We are using the plugin on 2 separate WordPress installed. In our first install we did the initial refresh after we mapped all the fields to bring over about 2-3000 records which took a little while, then after that individual record updates really only take about 15min to come over (which isn’t bad). We have 4 different Salesforce objects mapped through the plugin, so it gets some good use as our staff are regularly updating salesforce records (as well as process builder and workflow processes doing their thing).

As for our second install, that’s where we’re running into more of a bottleneck. For some reason the processing seems to go slower on the second install. However, that’s on a server with our other sites, so it may just be server resources are limited. The update @jonathanstegall did to limit record types helped limit the queries, however it does still take some time to run.

@jonathanstegall That would be awesome if 3.1 would help speed that up. I’m happy to help test any changes, however my coding skills are still fairly limited. =) Thanks!

@tnolte Yea, I’ve tried a number of different settings with the query record limit and the pull throttle, however, neither of those seemed to speed up our syncing process. The part I’m stuck on is I’m not sure where the bottleneck is. I’ve tried high query limits and low throttles and low throttles and high query limits. Neither of which seemed to help.

I landed on it maybe just being a limitation of the server we’re on as I know actionscheduler is supposed to be able to process a lot more records than what we’re sending at it. I’ve just run out of ideas.

For example I did a refresh of 1,000 records yesterday and it took about 10 hours to finish the sync in the WordPress site. Here are the settings at the time
Query Limit: 200
Pull Throttle: 5 seconds
Batch size: 100
Concurrent Batches: 5
Run Schedule every 5 min.

Not sure if those can go higher without timing out the cron job. Normally this isn’t a problem as one-off salesforce updates come over within a couple of minutes, it’s just the large refreshes that take a while.

Awesome, thanks!

Ok, this has been resolved.

I was using the parameter tag in the “custom field identifier” field. This needed to just be the database name of the field.

Working as expected.

Thanks. I did turn on the debug and it looks like the query doesn’t include the record type. This is pulling from the Salesforce accounts. Am I missing something?

Debug: on Salesforce API HTTP Request to URL: https://xxx.salesforce.com/services/data/v50.0/query?q=SELECT+Id%2C+Name%2C+field0__c%2C+field1__c%2C+field2__c%2C+field3__c%2C+field4__c%2C+field5__c%2C+Phone%2C+field6__c%2C+Website%2C+field7__c%2C+field8__c%2C+field9__c%2C+LastModifiedDate%2C+CreatedDate+FROM+Account+WHERE+LastModifiedDate+%3E+2021-02-26T22%3A18%3A36Z+ORDER+BY+LastModifiedDate+ASC+LIMIT+100.

so I think I’m narrowing down our problem and just wanted to circle back with some follow-up questions.

Our total salesforce contact records are around 300k. The record type we’re trying to sync is around 4k records. When we set the field mapping, we’ve selected the specific record type we want, however Action Scheduler > pending shows processes for records outside of that record type. Those records are filling up the Action Scheduler queue and take a while to process. The problem is with those record types there are no logs or any other information on that because it looks like they just get ignored because they’re the wrong record type?

So my question.
1) When the salesforce query is run, is it supposed to pull all records first, then let action scheduler process through the batch for the ones that match record types? Or is the pull really only supposed to be the record type selected in the fieldmap?

2) From my test we’re processing about 53 records in an hour. That seems quite slow as my batch size is 100 and concurrent batches is 5 running every 4 minutes. Could there be a PHP limit that it’s hitting or something? Adjusting batch size and concurrent batches doesn’t seem to do anything.

Thanks for any help you can provide.

Awesome! Got it working. I think the plugin was caching the field type of TEXT from salesforce so when I changed the field type it wasn’t pulling over the correct values. I deleted the mapping and re-mapped it and now it’s serializing the values correctly from the multi-select list in Salesforce.

Thanks for your help!

Oh, I just realized. I am using User Role Editor plugin to manage permissions and assign multiple user roles. Could that be the issue?

Hmm, that doesn’t seem to be working correctly for me then. I’m syncing to a TEXT field in Salesforce. I then remove a permission value (along with the preceding semicolon) and then I go to the user’s record in WordPress and do a manual “pull from Salesforce”. The value that gets pulled back to the wp database is the text value.

Does my Salesforce field need to be a picklist(multiselect) instead?

I am trying to map to the wp_capabilities field.

• This reply was modified 4 years, 1 month ago by esowers.