Skip to content

feat: add dataset dimensions to chart records#5939

Merged
mlbrgl merged 5 commits intomasterfrom
index-dataset-dim
Feb 13, 2026
Merged

feat: add dataset dimensions to chart records#5939
mlbrgl merged 5 commits intomasterfrom
index-dataset-dim

Conversation

@mlbrgl
Copy link
Member

@mlbrgl mlbrgl commented Jan 16, 2026

Add ETL dataset dimensions to Algolia search index

This PR adds ETL dataset dimensions to the Algolia search index to enable faceting by dataset namespace, version, name and producer. These dimensions are extracted from variable catalog paths and added to chart, explorer, and multi-dimensional view records. Producers come from the DB.

The changes:

  • Extract dataset namespace, version, and name from catalog paths
  • Extract producers from the DB
  • Add these dimensions to all chart types in the search index
  • Configure Algolia to include these new fields in attributes for faceting
  • Add unit tests for the catalog path parsing function

Testing guidance

Verify that chart records in the Algolia index now include the new fields:

  • datasetNamespaces
  • datasetVersions
  • datasetProducts
  • dataProducers

The easiest is to use the preview feature added in the next PR up the stack #5940.

  • Does the staging experience have sign-off from product stakeholders?

@mlbrgl mlbrgl mentioned this pull request Jan 16, 2026
1 task
@owidbot
Copy link
Contributor

owidbot commented Jan 16, 2026

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-index-dataset-dim

Archive:
SVG tester:

Number of differences (graphers): 0 ✅
Number of differences (grapher views): skipped
Number of differences (mdims): skipped
Number of differences (explorers): skipped

Edited: 2026-02-05 10:53:29 UTC
Execution time: 1.43 seconds

@mlbrgl mlbrgl force-pushed the index-dataset-dim branch 2 times, most recently from 4a775e0 to 9b03113 Compare January 16, 2026 17:44
@mlbrgl mlbrgl marked this pull request as ready for review January 16, 2026 20:30
Copy link
Member Author

mlbrgl commented Jan 16, 2026

@codex review

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 9b03113e31

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from 9b03113 to d164e04 Compare January 16, 2026 21:06
@mlbrgl mlbrgl changed the base branch from master to graphite-base/5939 January 21, 2026 11:34
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from 00aaf00 to ecc783d Compare January 21, 2026 11:35
@mlbrgl mlbrgl changed the base branch from graphite-base/5939 to 01-21-_add_graphite_branch_creation_skill January 21, 2026 11:35
@mlbrgl mlbrgl force-pushed the 01-21-_add_graphite_branch_creation_skill branch from 9e12ef0 to ee8bff1 Compare January 21, 2026 18:00
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from ecc783d to 2e14960 Compare January 21, 2026 18:00
@mlbrgl mlbrgl changed the base branch from 01-21-_add_graphite_branch_creation_skill to graphite-base/5939 January 23, 2026 18:20
@mlbrgl mlbrgl force-pushed the graphite-base/5939 branch from ee8bff1 to 77888f5 Compare January 26, 2026 12:52
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from 2e14960 to 73dc2a9 Compare January 26, 2026 12:52
@mlbrgl mlbrgl changed the base branch from graphite-base/5939 to master January 26, 2026 12:52
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from dedf9b2 to 2645770 Compare January 28, 2026 13:47
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch 2 times, most recently from f47e1c1 to 16ee01a Compare February 5, 2026 10:45
@mlbrgl mlbrgl mentioned this pull request Feb 5, 2026
1 task
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from 16ee01a to ba4d7e2 Compare February 6, 2026 15:23
@mlbrgl mlbrgl force-pushed the index-dataset-dim branch from ba4d7e2 to 18e9957 Compare February 9, 2026 17:29
Copy link
Member Author

mlbrgl commented Feb 13, 2026

Merge activity

  • Feb 13, 7:55 PM UTC: A user started a stack merge that includes this pull request via Graphite.
  • Feb 13, 7:55 PM UTC: @mlbrgl merged this pull request with Graphite.

@mlbrgl mlbrgl merged commit 3a14c14 into master Feb 13, 2026
28 of 30 checks passed
@mlbrgl mlbrgl deleted the index-dataset-dim branch February 13, 2026 19:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants