CSV file for very large upload

Yes, you have to break the CSV file up into smaller files. If you understand the structure of a CSV file, this is very easy to do. Each file must have a header line.

Ok. And Thank you.
One more doubt after having split do you know if there is any way I can select all the files to upload at a single time and worpress does the process of uploading the files separately or will I have to upload file by file manually? Is that divided I will have some 2,000 files to upload

2000…wow. How many records do you need to upload? You should be able to do several thousand per file.

For a truly massive upload, it may be best to upload through the hosting control panel to the db directly, but you will need to do some data conversion.

Thanks for the feedback one more time.
The spreadsheet has a total of 10 million lines, if the plugin could pause the processing every x line quantities would facilitate the upload, because, by my test I could only successfully upload a file with a maximum of 2500 lines … That way you would have to upload some 4,000 files. I’ll try to do the uplaod right in the hosting panel.

Another question, I saw that the page to open the details of a registration takes by default the value of Redord ID to generate the link: (example: https://makeparfum.com/informacoes/?pdb=17). Can I change it to generate the link through another specific column or cause the Record ID to consider the same value as my cnpj column which is the one I use as: “Check Field for Duplicate Records”?

No, the plugin is pretty much hardwired to use the id column for identifying a record. This is optimized in the database as well.

It is possible to create a custom shortcode that can use a different column to uniquely identify the record. If you want the “single record link” to also use that column there is a filter by which you can alter the URL that is used for the single record link.You would use the pdb-single_record_url filter for that.

10 million lines will most definitely require alternate means for getting that into the database. Even using the web interface (phpmyadmin) would possibly fail.

I would caution you to familiarize yourself with the storage formats the Participants Database uses for the various field types before loading the database directly.

Well, I’ll see if I split into several files and make a macro to go up by the same plugin. Thanks again.

About using the pdb-single_record_url filter to create a link based on a column, where do I find more details on how to do this?
Another similar question, can I make the page that will display the details of a record (?pdb=xx) take as title one of its columns?
Note: Both the custom link and the title issue has the intention of making Google display results that appears in the database in a more pleasant

• This reply was modified 5 years, 5 months ago by mermejo.

I am in the process of uploading the files, but now I am facing another problem, I have reached 250,000 registrations and now the shortcode page [pdb_total filter=”approved=yes”] is showing error loading, I believe that the site tries to load all the records at once and display , even though I selecting to display only 10 records per page. Can you tell if there is any way to get the site to only load the next data when the user advances to the next 10 records?
See the page that is displaying error: https://cnpjachei.com/consulta-de-cnpj/
If that does not work, I will not be able to get Google to index all the records in the search, or can you tell me if there is another way for google to index the records without having to have a page with this shortcode [pdb_list filter = “approved = yes”]?

• This reply was modified 5 years, 5 months ago by mermejo.
• This reply was modified 5 years, 5 months ago by mermejo.

So… best to post new questions in a new thread in case it’s helpful to others.

So, to answer your previous question, I suggest you take a look at the Pretty Permalinks or the Directory Tools add-ons I offer for other way to accomplish what you are asking about.

For your second question, you need to check your php error log.

Ok, new questions I’ll make in new posts.
Thank you, I believe these tools will help in what I need!