Skip to content

Conversation

@olizilla
Copy link
Contributor

@olizilla olizilla commented Mar 7, 2023

cron jobs to handle ElasticIPFS as cluster service.

  • Update pins and pins-failed cron jobs to check pin status in pickup instead of cluster

Fixes #2309
Extracted from #2310 so we can deploy the api change first, but leave the old cron running for a few hours.

TODO

  • add PICKUP_BASIC_AUTH_TOKEN as a secret to the repo for cron jobs.
  • update CLUSTER-* api env vars.

License: MIT

pickup pulls dags into E-IPFS, so this PR updates the api and cron jobs to reflect that in our db.

- Update pins and pins-failed cron jobs to check pin status in pickup instead of cluster

Fixes #2309

TODO

- [x] add `PICKUP_BASIC_AUTH_TOKEN` as a secret to the repo for cron jobs.
- [ ] update `CLUSTER-*` api env vars.

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
@olizilla olizilla changed the title feat: use pickup from cron pins job feat: use 🛻 pickup from cron pins job Mar 7, 2023
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Mar 7, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: f1826fd
Status: ✅  Deploy successful!
Preview URL: https://62dce27d.nft-storage-1at.pages.dev
Branch Preview URL: https://cron-use-pickup.nft-storage-1at.pages.dev

View logs

olizilla added a commit that referenced this pull request Mar 7, 2023
cron changes now in #2339

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
olizilla added a commit that referenced this pull request Mar 7, 2023
cron changes now in #2339

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
@olizilla olizilla mentioned this pull request Mar 7, 2023
4 tasks
Copy link
Contributor

@vasco-santos vasco-santos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. So #2310 will land first right?

olizilla added a commit that referenced this pull request Mar 22, 2023
pickup pulls dags into E-IPFS, so this PR updates the api to reflect
that.

- Update the pinning service add and update api routes to record
`ElasticIpfs` as the service that the pin is queued on.
- Update `GET /pins/:req-id` to check for a status change from pickup
and update out DB, so we can inform users early when a pin request is
pinned or failed.

Cron changes are in #2339 

Fixes #2309 

License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
@alanshaw
Copy link
Contributor

@olizilla can it merge now?

Copy link
Contributor

@alanshaw alanshaw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM apart from the URLs that need fixing.

olizilla and others added 2 commits May 10, 2023 11:27
Co-authored-by: Alan Shaw <alan.shaw@protocol.ai>
License: MIT
Signed-off-by: Oli Evans <oli@protocol.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use 🛻 pickup to handle pinning service requests

3 participants