Skip to content

feat(north-area): add NA6* migration models - #590

Open
palkerecsenyi wants to merge 3 commits into
CERNDocumentServer:masterfrom
palkerecsenyi:north-area
Open

feat(north-area): add NA6* migration models #590
palkerecsenyi wants to merge 3 commits into
CERNDocumentServer:masterfrom
palkerecsenyi:north-area

Conversation

@palkerecsenyi

@palkerecsenyi palkerecsenyi commented Aug 27, 2026

Copy link
Copy Markdown
Member

Depends on CERNDocumentServer/cds-rdm#945

Closes #494

Closes #464

Closes #501

Closes #507

Closes #594

Closes #512

"035__h", # OAI harvest tag or timestamp
"035__d", # OAI harvest tag or timestamp
"035__m", # OAI harvest format (e.g. `marcxml`)
"035__t", # oai harvest tag

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

were these aligned with SIS?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No not yet, I have just put them here on the basis of them being ignored in nearly all models. But we can check with them

Comment thread cds_migrator_kit/rdm/records/transform/models/north_area.py Outdated
Comment thread cds_migrator_kit/rdm/records/transform/models/north_area.py
Comment on lines +26 to +29
"773__t", # from SIS: can be ignored
"773__0", # from SIS: can be ignored
"773__o", # from SIS: can be ignored
"773__x", # INSPIRE publication note

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i'm not sure adding these to a common ignore keys list, it might be used differently for some collections. SIS team said we can ignore these for NA6* or these fields can be ignored everywhere?

Comment on lines +678 to +743
na61:
data_dir: cds_migrator_kit/rdm/data/north_area/na61
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na61/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na61/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""
na62:
data_dir: cds_migrator_kit/rdm/data/north_area/na62
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na62/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na62/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""
na63:
data_dir: cds_migrator_kit/rdm/data/north_area/na63
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na63/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na63/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""
na64:
data_dir: cds_migrator_kit/rdm/data/north_area/na64
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na64/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na64/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""
na65:
data_dir: cds_migrator_kit/rdm/data/north_area/na65
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na65/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na65/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""
na66:
data_dir: cds_migrator_kit/rdm/data/north_area/na66
plots: true
create_inclusion_request: true
extract:
dirpath: cds_migrator_kit/rdm/data/north_area/na66/dump/
transform:
files_dump_dir: cds_migrator_kit/rdm/data/north_area/na66/files/
missing_users: cds_migrator_kit/rdm/data/users
communities_ids:
- ""

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are these gonna migrated to separate communities?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

migration: NA66 (AMBER) migration: NA64 migration: NA63 migration: NA61 (SHINE) migration: NA62

4 participants