Spotfire Copilot Data Loader Error

[Naoki Nakamichi]

Hi Team,

I'd like to consult about a Python error I encountered while working with a "Data Loader" that utilizes Azure Blob and Azure AI Search.

I started the Data Loader using the "docker-compose-azblob-azcog.yml" file.
When I executed the /load endpoint, the following error occurred:

 

INFO:     Started server process [1]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     10.110.140.161:54405 - "GET / HTTP/1.1" 200 OK
INFO:     10.110.140.161:54405 - "GET /favicon.ico HTTP/1.1" 404 Not Found
INFO:     10.110.140.161:54406 - "GET /docs HTTP/1.1" 200 OK
email-validator not installed, email fields will be treated as str.
To install, run: pip install email-validator
INFO:     10.110.140.161:54406 - "GET /openapi.json HTTP/1.1" 200 OK
(trapped) error reading bcrypt version
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/passlib/handlers/bcrypt.py", line 620, in _load_backend_mixin
    version = _bcrypt.__about__.__version__
AttributeError: module 'bcrypt' has no attribute '__about__'
INFO:     10.110.140.161:54408 - "POST /token HTTP/1.1" 200 OK
INFO:     10.110.140.161:54439 - "POST /load/ HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/langchain_community/document_loaders/azure_blob_storage_file.py", line 26, in load
    from azure.storage.blob import BlobClient
ModuleNotFoundError: No module named 'azure'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/app/main.py", line 371, in handle_request
    docs = loader.load()
  File "/usr/local/lib/python3.10/site-packages/langchain_community/document_loaders/azure_blob_storage_file.py", line 28, in load
    raise ImportError(
ImportError: Could not import azure storage blob python package. Please install it with pip install azure-storage-blob.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 407, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 69, in __call__
    return await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 123, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 186, in __call__
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 164, in __call__
    await self.app(scope, receive, _send)
  File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 65, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    await app(scope, receive, sender)
  File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 756, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 776, in app
    await route.handle(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 297, in handle
    await self.app(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 77, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
    raise exc
  File "/usr/local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    await app(scope, receive, sender)
  File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 72, in app
    response = await func(request)
  File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 278, in app
    raw_response = await run_endpoint_function(
  File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 193, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/usr/local/lib/python3.10/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool
    return await anyio.to_thread.run_sync(func, *args)
  File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2144, in run_sync_in_worker_thread
    return await future
  File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 851, in run
    result = context.run(func, *args)
  File "/app/main.py", line 376, in handle_request
    raise HTTPException(status_code=404, detail=json.dumps(e))
  File "/usr/local/lib/python3.10/json/__init__.py", line 231, in dumps
    return _default_encoder.encode(obj)
  File "/usr/local/lib/python3.10/json/encoder.py", line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File "/usr/local/lib/python3.10/json/encoder.py", line 257, in iterencode
    return _iterencode(o, 0)
  File "/usr/local/lib/python3.10/json/encoder.py", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type ImportError is not JSON serializable

 

I'd be happy to provide further information if needed.
The following is for your reference. Thank you for your assistance.

Copilot Version : 1.1.0

.env (sensitive information masked)

LOG_LEVEL=INFO
ACCESS_TOKEN_EXPIRE_DAYS=1000
SECRET_KEY="********"
HASHED_ADMIN_PASSWORD="********"
AZSEARCH_EP="https://[my-search-service-name].search.windows.net"
AZSEARCH_KEY="********"
AZURE_STORAGE_CONNECTION="https://[my-storage-account-name].blob.core.windows.net/[my-container-name]"

[Prashant Maske]

Hi @Naoki Nakamichi,

Please try pulling the new image for the data loader.  Ensure that you have removed the old docker image first before pulling the new image.

Thanks