Assistance Required with GGMN Data Upload Issues

[EliVolsch]

Dear Kartoza,
I hope this email finds you well.
I encountered some issues while uploading data to the GGMN. During the upload process, the system crashed, and now I can no longer access the admin panel or view the batch upload.

Additionally, the process did not proceed as expected when attempting to upload monitoring data. Instead, I encountered a "Resume" button, which, after being pressed, redirected me back to the same "Resume" prompt without making any progress.
At the moment, I am unable to move forward and am currently stuck.
I would greatly appreciate your assistance in resolving this issue.
Best regards,
Elie

[meomancer]

Hi @Eliegergesgerges
Could you retry? The database was down

[Eliegergesgerges]

monitoring_data.ods

Still not working when it comes to monitoring data; It is working with Well information.
I have attached the file.

[meomancer]

Hi @Eliegergesgerges
Could you split the files, 100k per file?
The files has a lot of rows, that eating all memory when reading it
So the solution is we can split the files to be smaller

[Eliegergesgerges]

It works when I split the files into chunks of 100,000 rows each, but we need to find a better solution. Some countries have very large datasets. For example, I want to add Spain, which has both depth measurements and water level measurements. Each file contains 1.4 million rows, resulting in a total of 2.4 million rows for Spain. This means I would need to divide the dataset into 24 files, which is not a feasible solution, especially as we plan to include data from more countries.

[meomancer]

Hi @Eliegergesgerges yes, we will find the solution for that as this is coming from the library to read the excel

[Eliegergesgerges]

Thank you. I will postpone the activities related to downloading large datasets for now. Please let me know once it becomes possible to proceed.

[Elie114]

Hi going back to this issue; We need to upload files that have big datasets splitting the files to 100k is not feasible.
Can you arrange that?