Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recreate PDS EN Registry from scratch and load only necessary data #352

Closed
jordanpadams opened this issue Dec 7, 2024 · 5 comments
Closed

Comments

@jordanpadams
Copy link
Member

jordanpadams commented Dec 7, 2024

💡 Description

During initial load of EN Registry, there was a lot of data and context information loaded that we do not want in the index. Task is to delete, recreate, and load only the necessary data. See slack for specific paths to data we want to load.

Let's also document on the wiki how the re-indexing is done, and the paths that were loaded.

⚔️ Parent Epic / Related Tickets

#338

@alexdunnjpl
Copy link
Contributor

@jordanpadams @tloubrieu-jpl the plan was (previously, as I understood it) to nuke the EN index and then load data back in afresh.

Has that plan changed to "re-index using in-development AOSS migration script, dropping a subset of the data"?

@jordanpadams
Copy link
Member Author

@alexdunnjpl delete and start anew is still the plan.

@alexdunnjpl
Copy link
Contributor

@jordanpadams in that case, best to add @sjoshi-jpl (who is required to delete/recreate the three indices)and @tloubrieu-jpl (who may end up being the one to re-load the data)

@alexdunnjpl
Copy link
Contributor

@alexdunnjpl to clarify loading process details with @tloubrieu-jpl, then tag up with @sjoshi-jpl once prepared to co-ordinate cutover

@tloubrieu-jpl
Copy link
Member

Done by @jordanpadams last Friday

@github-project-automation github-project-automation bot moved this from ToDo to 🏁 Done in B15.1 Jan 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: 🏁 Done
Development

No branches or pull requests

4 participants