Skip to content

Conversation

@ziadhany
Copy link
Collaborator

@ziadhany ziadhany commented Feb 4, 2026

Issue:

Pipeline logs:

Importing data using retiredotnet_importer_v2
INFO 2026-02-04 00:01:09.309041 UTC Pipeline [RetireDotnetImporterPipeline] starting
INFO 2026-02-04 00:01:09.309174 UTC Step [clone] starting
INFO 2026-02-04 00:01:09.309225 UTC Cloning `git+https://github.com/RetireNet/Packages/`
INFO 2026-02-04 00:01:11.091335 UTC Step [clone] completed in 2 seconds
INFO 2026-02-04 00:01:11.091539 UTC Step [collect_and_store_advisories] starting
INFO 2026-02-04 00:01:11.092470 UTC Collecting 20 advisories
INFO 2026-02-04 00:01:11.181689 UTC Progress: 10% (2/20) ETA: 1 seconds
INFO 2026-02-04 00:01:11.213413 UTC Progress: 20% (4/20)
INFO 2026-02-04 00:01:11.232434 UTC Progress: 30% (6/20)
INFO 2026-02-04 00:01:11.251705 UTC Progress: 40% (8/20)
INFO 2026-02-04 00:01:11.270308 UTC Progress: 50% (10/20)
INFO 2026-02-04 00:01:11.288061 UTC Progress: 60% (12/20)
INFO 2026-02-04 00:01:11.314961 UTC Progress: 70% (14/20)
INFO 2026-02-04 00:01:11.342083 UTC Progress: 80% (16/20)
INFO 2026-02-04 00:01:11.365225 UTC Progress: 90% (18/20)
INFO 2026-02-04 00:01:11.389351 UTC Progress: 100% (20/20)
INFO 2026-02-04 00:01:11.397801 UTC Successfully collected 20 advisories
INFO 2026-02-04 00:01:11.397891 UTC Step [collect_and_store_advisories] completed in 0 seconds
INFO 2026-02-04 00:01:11.397942 UTC Step [clean_downloads] starting
INFO 2026-02-04 00:01:11.397987 UTC Removing cloned repository
INFO 2026-02-04 00:01:11.399833 UTC Step [clean_downloads] completed in 0 seconds
INFO 2026-02-04 00:01:11.399904 UTC Pipeline completed in 2 seconds

Process finished with exit code 0
from vulnerabilities.models import AdvisoryV2
from django.db.models import Count
duplicates = (
    AdvisoryV2.objects
    .values('avid')
    .annotate(count=Count('id'))
    .filter(count__gt=1)
)
len(duplicates)
Out[2]: 0
AdvisoryV2.objects.count()
Out[3]: 20

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Update advisory_id
Simplify grouped_packages structure

Signed-off-by: ziad hany <ziadhany2016@gmail.com>
Signed-off-by: ziad hany <ziadhany2016@gmail.com>
@ziadhany ziadhany requested a review from TG1999 February 4, 2026 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants