Surreal DB Migration Fails on Fresh Install

[gadgetb0y]

I'm trying to deploy Open Notebook using Docker Compose on macOS with OrbStack. I'm using the suggested default environment variables.

# Required: Your OpenAI API key
OPENAI_API_KEY=sk-your-actual-key-here

# Optional: Security for public deployments
OPEN_NOTEBOOK_PASSWORD=your_secure_password

# Database settings (auto-configured)
SURREAL_URL=ws://localhost:8000/rpc
SURREAL_USER=root
SURREAL_PASSWORD=root
SURREAL_NAMESPACE=open_notebook
SURREAL_DATABASE=production

Each time I attempt to deploy, the application indicates that I must Run Migration. Running migration presents the same authentication error each time. Are the default (auto-configured) credentials incorrect?

**Exception: {'code': -32000, 'message': 'There was a problem with the database: There was a problem with authentication'}**

File "/app/.venv/lib/python3.12/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 128, in exec_func_with_error_handling
    result = func()
             ^^^^^^
File "/app/.venv/lib/python3.12/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 667, in code_to_exec
    _mpa_v1(self._main_script_path)
File "/app/.venv/lib/python3.12/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 165, in _mpa_v1
    page.run()
File "/app/.venv/lib/python3.12/site-packages/streamlit/navigation/page.py", line 300, in run
    exec(code, module.__dict__)  # noqa: S102
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/app_home.py", line 15, in <module>
    setup_page("📒 Open Notebook", sidebar_state="collapsed")
File "/app/pages/stream_app/utils.py", line 177, in setup_page
    check_migration()
File "/app/pages/stream_app/utils.py", line 111, in check_migration
    mm.run_migration_up()
File "/app/open_notebook/database/migrate.py", line 26, in run_migration_up
    asyncio.run(self._async_manager.run_migration_up())
File "/app/.venv/lib/python3.12/site-packages/nest_asyncio.py", line 30, in run
    return loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.12/site-packages/nest_asyncio.py", line 98, in run_until_complete
    return f.result()
           ^^^^^^^^^^
File "/usr/local/lib/python3.12/asyncio/futures.py", line 202, in result
    raise self._exception.with_traceback(self._exception_tb)
File "/usr/local/lib/python3.12/asyncio/tasks.py", line 314, in __step_run_and_handle_result
    result = coro.send(None)
             ^^^^^^^^^^^^^^^
File "/app/open_notebook/database/async_migrate.py", line 137, in run_migration_up
    await self.runner.run_all()
File "/app/open_notebook/database/async_migrate.py", line 72, in run_all
    await self.up_migrations[i].run(bump=True)
File "/app/open_notebook/database/async_migrate.py", line 39, in run
    async with db_connection() as connection:
               ^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/contextlib.py", line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
File "/app/open_notebook/database/repository.py", line 50, in db_connection
    await db.signin(
File "/app/.venv/lib/python3.12/site-packages/surrealdb/connections/async_ws.py", line 139, in signin
    response = await self._send(message, "signing in")
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/.venv/lib/python3.12/site-packages/surrealdb/connections/async_ws.py", line 88, in _send
    self.check_response_for_error(response, process)
File "/app/.venv/lib/python3.12/site-packages/surrealdb/connections/utils_mixin.py", line 6, in check_response_for_error
    raise Exception(response.get("error"))

[lfnovo]

Yes, they seem right. Can you show your docker-compose?

[gadgetb0y]

I'm using the suggested docker-compose. As always, I'll refine it once I have a positive result. However, I've also tried the Multi-Container Setup and Single Container Deployment and received the same authentication error message.

services:
  open_notebook:
    image: lfnovo/open_notebook:latest-single
    ports:
      - "8502:8502"
    environment:
      - OPENAI_API_KEY=your_openai_key_here
    volumes:
      - ./notebook_data:/app/data
      - ./surreal_data:/mydata
    restart: always

[lfnovo]

@gadgetb0y you should either reference your env file or pass all the env variables in the docker container. (yes, I can probably set some defaults when building the docker image -- will do that in the next release). For the time being, either do this:

services:
  open_notebook_single:
    image: lfnovo/open_notebook:latest-single
    ports:
      - "8502:8502"  # Streamlit UI
      - "5055:5055"  # REST API
    env_file:
      - ./docker.env
    volumes:
      - ./notebook_data:/app/data          # Application data
      - ./surreal_single_data:/mydata      # SurrealDB data
    restart: always

Or this:

services:
  open_notebook_single:
    image: lfnovo/open_notebook:latest-single
    ports:
      - "8502:8502"  # Streamlit UI
      - "5055:5055"  # REST API
    environment:
      - OPENAI_API_KEY=sk-your-actual-key-here
      - SURREAL_URL=ws://localhost:8000/rpc
      - SURREAL_USER=root
      - SURREAL_PASSWORD=root
      - SURREAL_NAMESPACE=open_notebook
      - SURREAL_DATABASE=production
    volumes:
      - ./notebook_data:/app/data          # Application data
      - ./surreal_single_data:/mydata      # SurrealDB data
    restart: always

Let me know if that works?

[gadgetb0y]

The latter option works great. Thank you.

[pierrecorsini]

The quick start method in README.md will result is that error for me.

Resolved using the instructions at : https://github.com/lfnovo/open-notebook/blob/main/docs/deployment/docker.md .