Markku Mikkola
-
Posts
4 -
Joined
-
Last visited
-
Days Won
1
Markku Mikkola's Achievements
-
Hi Marcelo, Is there any general guideline and documentation available how to configure data-loaders/orchestrator with onprem embedding and LLM models and APIs and if possible how to develop and "extend" Copilot backend components with user environment specific plugins? I'm referring to the plugin support mentioned in "Getting Started with Spotfire Copilot" PDF document included in the Copilot 1.1.0 release. BR, Markku
-
Hi Marcelo, We have internally fine tuned embedding models and Allenai's specter-2 model: https://huggingface.co/allenai/specter2_base available via a text embedding API endpoint (onprem). I tried to reach you on email where we can discuss more in details. BR, Markku
-
Hi Marcelo, Thanks for you quick response. I'm using Spotfire Copilot 1.1.0 package and instructions included in it with small deviation that I deployed the backend components on k8s. If necessary to discuss about the interfaces used I think better to setup a call, but first if possible if you could help with the data loader configuration problem and I guess some additional configuration would be needed for the orchestrator as well? BR, Markku
-
Hi, I'm trying also to setup and experiment the spotfire-copilot backend with on-prem LLMs (e.g. LLaMA3.1-8b..) using an API endpoint compatible with OpenAI's API request and response structures. Now I have this issue with Milvus "data-loader" when loading the Spotfire documents, that even if I point my "AZURE_OPENAI_ENDPOINT" to the on-prem API endpoint still the "data-loader" makes request towards "https://api.openai.com/v1/embeddings" which result "401 Unauthorized" as it tries to authenticate with my on-prem API key. Also Im wondering the Description for "AZURE_OPENAI_ENDPOINT" variable in the documentation: "Defines the endpoint URL for the Azure OpenAI API, enabling users to set the API endpoint in the system and establish the connection to Azure OpenAI service. Not required if not using Azure OpenAI" So how do I correctly configure data-loader with onprem API endpoint when not using Azure OpenAI API? Thanks!
