Skip to content

Question about FISS vs. API in timeout and getting workflow metadata #196

@zhwshen

Description

@zhwshen

I have some questions about FISS vs. API in getting workflow metadata and timeouts. Thank you!

I am using FireCloud inside a Python script for 3 purposes:

  1. Download TSV from Terra (api.get_entities_tsv)
  2. Upload TSV to Terra (api.upload_entities)
  3. Query workflow input configuration (api.get_workflow_metadata).

My main issue is that API authentication times out often in the middle of a long run or when Terra workspace content changes. But when I call api._set_session() at the beginning of each run, it interferes with other features in the repo code. I want to switch to FISS which doesn't seem to have the timeout issue, but it doesn't seem to have a workflow metadata query function.

So I would really appreciate help with:

  1. How to auto-restart API auth session in the middle of a long run gracefully so the job doesn't crash midway due to API connection timeout?
  2. What will be an alternative way to do api.get_workflow_metadata but using FISS and not having timeout issues?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions